dotcore

Local AI, without the setup

dotcore loads models, fits them to your hardware, and puts a single endpoint in front of everything.

Pick a model, get a running endpoint

Choose a model and dotcore starts it for you: a build that matches your GPU, a sensible quantization, up behind an OpenAI-compatible endpoint. No engine flags, no driver versions to match by hand.

LlamaMistralDeepSeekQwenGemma+ more

Fit the model to your hardware

dotcore looks at the memory you have, the context length you want, and the way requests arrive, then tunes batching and the engine to match. You get the most out of the machine you already paid for, without turning knobs.

memoryfit to VRAM
contextsized for you
batchingtuned
enginematched to GPU

One endpoint in front of everything

Every model and every machine sits behind a single endpoint. Requests go where they should, and your apps keep pointing at the same address even as you start, stop, and move models around.

Mac MiniSparkRTX 5090dotcoreOne endpoint:2673/v1

Many machines, working as one

Begin on a single laptop, then add a second, or a few more. It's the same system the whole way, nothing to rewrite, and dotcore helps every machine act like one pool of compute behind a single endpoint.

one pool:2673/v1
Mac MiniSparkRTX 5090

An app catalog, too

Open-source chat UIs, RAG tools, and agents that install and connect to your models in one step, all running on your own hardware.

Open WebUILibreChatAnythingLLMOpenClawHermes Agent+ more

Run AI on the hardware you already have