You install two things, usually on two machines.
On the GPU
Install Fabric
houdry servehoudry gpu register
Ollama running, with at least one model pulled.
On the desk
Install Agent
Point it at http://HOST:8080/v1
Do not install Fabric on every laptop.
One machine can be both (a workstation that also has a keyboard). Same commands. Agent then uses http://127.0.0.1:8080/v1.
GPU / ops workstation. This is the houdry CLI.
Desk app. Point it at http://HOST:8080/v1.
curl -fsSL https://raw.githubusercontent.com/houdry-genomex/houdry-agent/main/scripts/install.sh | bash1. GPU workstation: Houdry Fabric
Linux / macOS:
curl -fsSL https://github.com/houdry-genomex/houdry/releases/latest/download/install.sh | sh
export PATH="$HOME/.houdry/bin:$PATH"
houdry version
houdry gpu detect
Windows PowerShell:
irm https://github.com/houdry-genomex/houdry/releases/latest/download/install.ps1 | iex
& "$HOME\.houdry\bin\houdry.exe" version
& "$HOME\.houdry\bin\houdry.exe" gpu detect
Put ~/.houdry/bin (Windows: $HOME\.houdry\bin) on PATH so later terminals can run houdry without the full path.
Binaries also ship on the Fabric releases page (houdry-linux-amd64, houdry-windows-amd64.exe, and so on). Prefer the install script unless you need a specific architecture.
2. Models: Ollama on the GPU host
Fabric’s working runtime is Ollama. Without it, chat has nowhere to run.
- Install Ollama from ollama.com.
- Pull at least one chat model, for example:
ollama pull llama3.2
For drawings / scanned PDFs, also pull a vision model your catalog expects (for example qwen2.5vl). Leave Ollama running.
A workstation with no discrete GPU can still run houdry serve as the control plane. Another box then registers as compute. With no READY GPU node, /v1 can still talk to Ollama on the serve host.
3. Start the fabric
Two terminals is the usual setup. Leave both running.
# Terminal 1: control plane (any machine on the Wi‑Fi; GPU not required)
houdry serve --listen 0.0.0.0:8080
# Terminal 2: this GPU workstation
houdry gpu register
gpu register finds houdry serve on the same Wi‑Fi, stays READY, and takes work from Houdry Agent. Extra workstations only need detect + register. They do not start a second serve.
Dashboard: http://127.0.0.1:8080/ on the serve host.
If discovery fails (guest Wi‑Fi):
houdry gpu register --server http://127.0.0.1:8080
4. Desk: Houdry Agent
Linux / macOS:
curl -fsSL https://raw.githubusercontent.com/houdry-genomex/houdry-agent/main/scripts/install.sh | bash
Windows: download Houdry-Agent-*-win-x64.exe from Agent releases.
On first run:
- Choose Houdry server URL (not a public OpenAI / Azure endpoint).
- Same machine as Fabric:
http://127.0.0.1:8080/v1. - Another machine on the LAN:
http://HOST:8080/v1. The/v1suffix is required. - Optional API key:
houdry(use this if you passed--tokentoserve).
If one control plane is visible on Wi‑Fi, Agent can fill the URL. Confirm with Connect.
Check that it worked
On the GPU / ops machine:
houdry version
houdry gpu detect
houdry discover
discover should list the control plane. Open Agent and send “Say hello.” If chat fails, see Troubleshooting.