Local AI, without the setup
dotcore loads models, fits them to your hardware, and puts a single endpoint in front of everything.
Pick a model, get a running endpoint
Choose a model and dotcore starts it for you: a build that matches your GPU, a sensible quantization, up behind an OpenAI-compatible endpoint. No engine flags, no driver versions to match by hand.
Fit the model to your hardware
dotcore looks at the memory you have, the context length you want, and the way requests arrive, then tunes batching and the engine to match. You get the most out of the machine you already paid for, without turning knobs.
One endpoint in front of everything
Every model and every machine sits behind a single endpoint. Requests go where they should, and your apps keep pointing at the same address even as you start, stop, and move models around.
Many machines, working as one
Begin on a single laptop, then add a second, or a few more. It's the same system the whole way, nothing to rewrite, and dotcore helps every machine act like one pool of compute behind a single endpoint.
An app catalog, too
Open-source chat UIs, RAG tools, and agents that install and connect to your models in one step, all running on your own hardware.
AnythingLLM
Hermes Agent