LocalAI serves open models from your own hardware over an OpenAI-compatible API. Big-AGI is the workspace. Self-host the whole stack, keep your data in the building, and still reach frontier models when you want them.
Free ยท Open source ยท OpenAI-compatible
Why LocalAI in Big-AGI
Private by physics
Prompts and outputs stay on the hardware that runs the model. There is no remote inference path, so there is no second copy.
No token markup
You bought the silicon once. Inference is compute you already own, with zero per-token meter running in the background.
OpenAI-compatible
LocalAI speaks the OpenAI API, so Big-AGI points at it the way it points at any endpoint. No custom glue, no waiting on support.
Beam across both
Beam runs your local model against Claude, GPT, or Gemini in parallel, then merges the answers. Consensus is signal, disagreement is where you dig deeper.
Set it up
01
Run LocalAI
Start LocalAI on your machine, for example docker run -p 8080:8080 localai/localai, then load the models you want. Full options are on localai.io.
02
Open Big-AGI
Use the hosted workspace or self-host it. No account needed. Big-AGI becomes your one chat surface for local and cloud models alike.
03
Point it at LocalAI
In Models, add LocalAI as an OpenAI-compatible service and set the host to http://localhost:8080. Your models show up ready to run. Add cloud keys later for hybrid runs.
Jul 4, 2026
v4.6.0
๐ LocalAI 4.6.0 Release! ๐
Jun 30, 2026
v4.5.6
<!-- Release notes generated using configuration in .github/release.yml at master -->
Jun 27, 2026
v4.5.5
<!-- Release notes generated using configuration in .github/release.yml at master -->
Jun 27, 2026
v4.5.4
<!-- Release notes generated using configuration in .github/release.yml at master -->
Jun 26, 2026
v4.5.3
<!-- Release notes generated using configuration in .github/release.yml at master -->
Free and open source. Your models on your hardware, frontier models one click away, all in one workspace.
BIG-AGI
Resources
ยฉ 2026 Token FabricsยทBuilt with passion in San Diego