Route anywhere. Or run it on our metal.
We host open frontier weights and sovereign deployments in our own data centers. Same API key, same model IDs, published per-token prices — and no preferential routing just because we own the GPUs.
Zero margin routing
Route to any vetted provider at their list price. We take no cut, ever. Our own fleet sits in that same registry and wins traffic only when it wins on price, latency or quality.
Our own inference
5 open-weight models live today on our accelerators, with sovereign regions, dedicated endpoints and fine-tuning rolling out. This is the product we charge for — which is exactly why routing stays free.
Why run it here
The price floor
We publish per-token rates on our own hardware and let the router undercut us when someone else is cheaper. No credit float, no markup.
Weights you asked for
Served precision is published per model. No community quant swapped in under load, no silent model substitution.
Region pinning
Pin a request to a jurisdiction and it stays there — inference, cache and logs. Sovereign deployments extend this to operator-of-record.
Capacity we control
Reserved accelerators mean rate limits we can actually promise, and burn-in data we measure ourselves.
Your weights, our GPUs
Fine-tune an open model and serve the adapter behind the same model ID your code already uses.
No home-field advantage
Our fleet passes the same published admission bar as everyone else and carries a public trust score. Routing never prefers it.
Serving modes
| Mode | Billing | What it is | Status |
|---|---|---|---|
| Shared serverless | Per token, published rates | Pay per token on shared capacity. No minimum, no reservation, scales to zero. | Live |
| Dedicated endpoint | Per GPU-hour | Isolated replicas pinned to a region and a precision. Your own rate limits and SLA. | Beta |
| Reserved cluster | Annual commit | Reserved accelerators with capacity guarantees, custom models and support SLA. | Coming soon |
curl https://api.llmcloud.ai/v1/chat/completions \
-H "Authorization: Bearer $LLMCLOUD_KEY" \
-d '{
"model": "llmcloud/deepseek-v3.2-exp",
"messages": [{"role":"user","content":"hi"}]
}'{
"model": "auto:cost",
"provider": { "region": "eu-west" },
"messages": [{"role":"user","content":"hi"}]
}Does the router favour your own models?+
No. The hosted fleet is registered as an ordinary provider with the same trust score and the same scoring inputs. If a third party is cheaper or faster for your policy, the router sends the request there.
How is this consistent with zero margin?+
Routing is free forever. Hosted inference is a product with its own published price — you are paying us for compute, not for the privilege of routing.
What happens if your capacity runs out?+
The gateway fails over to another qualified provider for the same model and records the substitution in the response metadata.
Can I get a dedicated endpoint today?+
Dedicated endpoints are in beta with design-partner customers. Reserved clusters and fine-tuning are coming soon — join the waitlist.
Prices and performance figures on hosted pages are illustrative until published measurement lands. See provider standards for how we measure ourselves.