Models
How Kortix picks a model, and how billing works for managed vs. your-own-key models.
Kortix runs each session on a model. This page explains managed models vs. your own provider key (BYOK), how Kortix picks a model automatically, and two billing gotchas to know.
This page applies to projects with the LLM Gateway on. LLM Gateway is an experimental setting, and it is on by default for cloud projects. Check or toggle it in Customize → Experimental.
Managed models and BYOK
A model id has one of three shapes:
- Managed — a bare id, like
claude-opus-4.8orglm-5.2. Kortix supplies the credentials. Cloud accounts pay with Kortix credits. - BYOK — a
provider/modelid, likeanthropic/claude-opus-4-8. You supply the key. Your provider account pays. - ChatGPT — a
codex/<id>id. You connect your ChatGPT plan once through OAuth, and it pays.
Connect a BYOK key on the project's Model settings page, or set the provider's env var directly as a secret.
How auto picks a model
Set no model, and Kortix resolves one through five layers, in order. (The
id auto covers this same behavior, but it is not yet a selectable option
in the model picker.)
- An explicit pin — a session, channel, or trigger's own
model:field. - The agent's default for this project.
- The project's default.
- The account's default.
- The platform default.
Kortix uses the first layer that has a value it can still serve. A saved
default that stops working — a disconnected key, a retired model — is
skipped automatically. A session never dies from a stale default. See the
manifest reference for the trigger model:
field.
Billing surprises on BYOK
Two costs are easy to miss on a paid cloud account:
- Platform fee. Kortix adds a 10% fee, billed as credits, on top of what your own provider charges. Free-tier and self-hosted accounts are exempt.
- Silent failover. If your BYOK key hits a rate limit or billing error mid-turn, Kortix retries on a managed model and bills your credits instead of failing the session.
If you see credit charges on a BYOK-only project, check these two causes before reporting a billing bug.
Shared, not private, keys
A connected provider key applies to the whole project. There is no private,
per-user key — setting a personal override for a provider key fails with a
llm_credentials_project_wide error. Update the shared key on the
secrets page instead.