Your hardware. Your models. Zero tokens billed.

LocalAI serves open models from your own hardware over an OpenAI-compatible API. Big-AGI is the workspace. Self-host the whole stack, keep your data in the building, and still reach frontier models when you want them.

Free ยท Open source ยท OpenAI-compatible

Why LocalAI in Big-AGI

LocalAI, with a real workspace on top.

Private by physics

Prompts and outputs stay on the hardware that runs the model. There is no remote inference path, so there is no second copy.

No token markup

You bought the silicon once. Inference is compute you already own, with zero per-token meter running in the background.

OpenAI-compatible

LocalAI speaks the OpenAI API, so Big-AGI points at it the way it points at any endpoint. No custom glue, no waiting on support.

Beam across both

Beam runs your local model against Claude, GPT, or Gemini in parallel, then merges the answers. Consensus is signal, disagreement is where you dig deeper.

Set it up

Three steps to your first local chat.

01

Run LocalAI

Start LocalAI on your machine, for example docker run -p 8080:8080 localai/localai, then load the models you want. Full options are on localai.io.

02

Open Big-AGI

Use the hosted workspace or self-host it. No account needed. Big-AGI becomes your one chat surface for local and cloud models alike.

03

Point it at LocalAI

In Models, add LocalAI as an OpenAI-compatible service and set the host to http://localhost:8080. Your models show up ready to run. Add cloud keys later for hybrid runs.

Run models locally in Big-AGI.

Free and open source. Your models on your hardware, frontier models one click away, all in one workspace.

ยฉ 2026 Token FabricsยทBuilt with passion in San Diego