Houdry Fabric and Houdry Agent

Quickstart

Bring up Fabric, connect Agent, and run the first on-prem task.

This is the smallest useful loop: one GPU workstation, one desk, one prompt.

Before you start

Fabric is installed on the GPU machine. Agent is installed on the desk. Ollama is running on the GPU host with at least one model pulled. See Installation.

Start the fabric

On the GPU workstation, terminal 1:

houdry serve --listen 0.0.0.0:8080

Terminal 2 on that machine (or on a second GPU box):

houdry gpu detect
houdry gpu register

Leave register running. Cluster dashboard: http://127.0.0.1:8080/.

Connect Houdry Agent

Open Houdry Agent. Choose Houdry server URL.

Agent is on…URL
The same machine as houdry servehttp://127.0.0.1:8080/v1
Another machine on the LANhttp://HOST:8080/v1

Optional key: houdry. On one control plane on Wi‑Fi, the URL often fills in. Confirm with Connect. The model should read as fabric auto unless you pin a name.

Put your files in Knowledge

In Agent, open Knowledge base. Add the SOPs, inspection reports, and manuals this site is allowed to read.

  • Files stay on this computer. They are not uploaded to a public model host.
  • On each SOP, set standing rules (cite the SOP, do not invent procedure, stay on this network).

Do not paste whole manuals into chat if they already live in Knowledge.

Run one real task

Start a New session. Keep the first prompt narrow:

Read 01_Inspection_Report_E204.pdf and the matching SOP.
Draft an approval note. Quote every finding from the source. Do not invent values.

The fabric routes the work (model=auto) to a READY GPU node. The answer comes back in Agent. Nothing is mailed out.

If chat does not answer

  1. houdry discover on the GPU machine: is the control plane visible?
  2. houdry gpu detect: is a GPU listed?
  3. Is houdry gpu register still running (not exited)?
  4. Is Ollama up, with a model pulled?
  5. Is Agent pointed at :8080/v1, not a public LLM URL?

More in Troubleshooting.

Next