v0.10.11
LatestLLM Gateway
- Rebuilt on the Vercel AI SDK + live models.dev. The gateway now runs a single AI-SDK transport for every provider (OpenAI, Anthropic, Bedrock, OpenRouter and more), with the model catalog served verbatim from models.dev. The old per-provider transports and the LiteLLM sidecar have been removed.
- Per-model generation controls. Set reasoning effort, temperature, top_p, and max output tokens per model — each control only appears when the model actually supports it (driven by the live catalog), and applies to every client (chat, SDK, and direct API).
- Reasoning-effort selector in the chat composer for models that expose it (including a thinking-effort control for Claude models).
- Two drop-in API surfaces: OpenAI-compatible
/v1/chat/completionsand Anthropic-compatible/v1/messages, plus/v1/models— all now documented in the API reference. - Provider & model manager overhaul: connect providers (incl. Bedrock via bearer token), browse models with pricing, context windows, and capabilities, verify that a key actually works, and see everything grouped under its real provider.
- Anthropic extended thinking and prompt caching are applied correctly, and cost/usage are recorded accurately per request.
- A gen_ai.* OpenTelemetry span is emitted per gateway call for downstream observability.
Templates
- Many new business use-case templates across finance, sales, customer support, marketing, data, and recruiting — each with its own cover art.
Fixes & hardening
- Sandbox proxy no longer times out healthy long reasoning/tool turns.
- Blank projects can start sessions immediately (no more "agent not declared").
- Project-scoped API tokens can drive their own project's sessions.
- Per-project agent model pins no longer collide across projects.
- Faster session/gateway paths and clearer errors on upstream failures.
- Security & compliance: GuardDuty runtime monitoring, IAM baseline, root-login and patch/detection alerting, and corrected SSO/SCIM setup guides.
What's Changed
- chore(release): VERSION → 0.10.11 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4890
- feat(iam-web): 4 more SAML providers + change-provider confirmation by @Ino-Bagaric in https://github.com/kortix-ai/suna/pull/4892
- feat(iam-web): OneLogin, JumpCloud, PingOne Directory Sync (SCIM) guides by @Ino-Bagaric in https://github.com/kortix-ai/suna/pull/4894
- fix(llm): Bedrock connects with bearer+region, live verbatim models.dev catalog by @markokraemer in https://github.com/kortix-ai/suna/pull/4893
- chore(dev-eks): deploy gateway dev-5392ac7b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4895
- chore(dev-eks): deploy dev-5392ac7b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4896
- fix(compliance): close AWS patch and detection gaps by @markokraemer in https://github.com/kortix-ai/suna/pull/4897
- feat(connectors): add first-class Postman ingestion by @markokraemer in https://github.com/kortix-ai/suna/pull/4898
- feat(web): overhaul LLM gateway + provider/key manager UX by @markokraemer in https://github.com/kortix-ai/suna/pull/4899
- chore(dev-eks): deploy gateway dev-0919c1c2 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4901
- chore(dev-eks): deploy dev-0919c1c2 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4903
- feat(llm-gateway): AI-SDK transport engine (flag-gated) behind LLM_TRANSPORT_ENGINE by @markokraemer in https://github.com/kortix-ai/suna/pull/4902
- chore(dev-eks): deploy gateway dev-25b574fd [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4904
- chore(dev-eks): deploy dev-25b574fd [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4905
- feat(llm-gateway): gen_ai.* OTel span per gateway call by @markokraemer in https://github.com/kortix-ai/suna/pull/4906
- feat(llm-gateway): Anthropic /v1/messages ingress on the gateway by @markokraemer in https://github.com/kortix-ai/suna/pull/4907
- chore(dev-eks): deploy gateway dev-dad64456 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4909
- feat(api): /v1/generation + /v1/usage OpenRouter-parity read endpoints by @markokraemer in https://github.com/kortix-ai/suna/pull/4908
- chore(dev-eks): deploy dev-cc465f35 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4910
- fix(compliance): codify EC2 CPU alarm coverage by @markokraemer in https://github.com/kortix-ai/suna/pull/4900
- content: publish AGI-ready architecture blog post by @agent-kortix in https://github.com/kortix-ai/suna/pull/4911
- fix(llm-gateway): AI-SDK streaming error handling + bedrock tool-loop + cost-hint parity by @markokraemer in https://github.com/kortix-ai/suna/pull/4914
- chore(dev-eks): deploy gateway dev-2072d456 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4915
- chore(dev-eks): deploy dev-2072d456 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4916
- feat: 12 more business use-case templates (marketing, CS, data, revops) by @lillyboga in https://github.com/kortix-ai/suna/pull/4917
- chore(dev-eks): deploy dev-754cf631 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4918
- fix(compliance): safely adopt IAM group baseline by @markokraemer in https://github.com/kortix-ai/suna/pull/4913
- feat(use-cases): cover art for the 12 new use-case templates by @lillyboga in https://github.com/kortix-ai/suna/pull/4919
- feat(connectors): add unified Discover marketplace by @markokraemer in https://github.com/kortix-ai/suna/pull/4920
- chore(dev-eks): deploy dev-be5dce44 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4921
- feat(llm-gateway): absorb OpenAI Responses API into the ai-sdk engine by @markokraemer in https://github.com/kortix-ai/suna/pull/4924
- chore(dev-eks): deploy gateway dev-760450fa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4925
- feat(llm-gateway): mount Anthropic /v1/messages ingress, delete legacy /router/messages by @markokraemer in https://github.com/kortix-ai/suna/pull/4922
- chore(dev-eks): deploy gateway dev-bf7de02b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4926
- fix(llm-gateway): fail fast on terminal upstream auth errors instead of hanging by @markokraemer in https://github.com/kortix-ai/suna/pull/4923
- chore(dev-eks): deploy gateway dev-81e47a87 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4928
- feat: 20 more business use-case templates + covers (USE CASE MAX, 42→62) by @lillyboga in https://github.com/kortix-ai/suna/pull/4927
- revert(connectors): move unified Discover marketplace back to draft by @markokraemer in https://github.com/kortix-ai/suna/pull/4929
- chore(dev-eks): deploy dev-14e31468 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4931
- fix(llm-gateway): strip Bedrock cross-region prefix for pricing lookup by @markokraemer in https://github.com/kortix-ai/suna/pull/4932
- fix(llm-gateway): terminal upstream auth errors surface as non-retryable, not silent 502 by @markokraemer in https://github.com/kortix-ai/suna/pull/4933
- fix(llm-gateway): ai-sdk engine parity — response_format, seed, penalties, logit_bias/logprobs/etc by @markokraemer in https://github.com/kortix-ai/suna/pull/4934
- chore(dev-eks): deploy gateway dev-369cde6e [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4935
- chore(dev-eks): deploy dev-369cde6e [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4936
- fix(llm-gateway): fail fast + clear on a descriptor with no usable baseUrl by @markokraemer in https://github.com/kortix-ai/suna/pull/4938
- chore(dev-eks): deploy gateway dev-0d0bb114 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4939
- chore(dev-eks): deploy dev-0d0bb114 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4940
- fix(compliance): allow Drata SNS subscription inspection by @markokraemer in https://github.com/kortix-ai/suna/pull/4937
- test(llm-gateway): remove unused test declarations by @markokraemer in https://github.com/kortix-ai/suna/pull/4942
- chore(dev-eks): deploy gateway dev-ebf18dfa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4944
- chore(dev-eks): deploy dev-ebf18dfa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4945
- test(accessibility): scope decorative contrast audit by @markokraemer in https://github.com/kortix-ai/suna/pull/4946
- feat(llm-gateway): make ai-sdk the sole transport engine; delete native transports + LiteLLM sidecar by @markokraemer in https://github.com/kortix-ai/suna/pull/4943
- chore(dev-eks): deploy gateway dev-ba6b2364 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4948
- chore(dev-eks): deploy dev-ba6b2364 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4949
- Fix release QA staging environment isolation by @markokraemer in https://github.com/kortix-ai/suna/pull/4951
- fix(llm-gateway): catch GatewayResolutionError in /resolve-upstream — stop "Connect Codex" spike (incident 991624588) by @agent-kortix in https://github.com/kortix-ai/suna/pull/4953
- chore(dev-eks): deploy gateway dev-22c1e4ca [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4955
- chore(dev-eks): deploy dev-22c1e4ca [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4956
- Fix staging release QA contracts by @markokraemer in https://github.com/kortix-ai/suna/pull/4954
- chore(dev-eks): deploy dev-06332c1c [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4957
- Fix residual release QA contracts by @markokraemer in https://github.com/kortix-ai/suna/pull/4959
- chore(dev-eks): deploy dev-3cd55231 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4960
- Fix release QA runtime identities by @markokraemer in https://github.com/kortix-ai/suna/pull/4962
- Preserve staging secrets during deployment by @markokraemer in https://github.com/kortix-ai/suna/pull/4964
- test(release): authenticate protected metrics coverage by @markokraemer in https://github.com/kortix-ai/suna/pull/4966
- fix(self-host): isolate black-box compose probes by @markokraemer in https://github.com/kortix-ai/suna/pull/4968
- chore(dev-eks): deploy dev-88330aaa [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4969
- fix(llm-gateway): agent-scope model pins now apply to sessions on the 'default' sentinel by @markokraemer in https://github.com/kortix-ai/suna/pull/4971
- chore(dev-eks): deploy dev-c92f20b0 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4972
- fix(sandbox-proxy): stop 502ing healthy long reasoning/tool turns on blocking POST /session/:id/message by @markokraemer in https://github.com/kortix-ai/suna/pull/4975
- fix(projects): synthesize v2 manifest w/ declared agent for blank projects by @markokraemer in https://github.com/kortix-ai/suna/pull/4974
- fix(snapshots): retry Platinum template builds that never register by @markokraemer in https://github.com/kortix-ai/suna/pull/4977
- fix(auth): project-scoped PATs can drive their own project's sandbox proxy by @markokraemer in https://github.com/kortix-ai/suna/pull/4973
- fix(llm-gateway): scope agent-model pins per project, not per account by @markokraemer in https://github.com/kortix-ai/suna/pull/4978
- chore(dev-eks): deploy dev-7722d516 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4979
- fix(projects): close blank-project AGENT_NOT_DECLARED gaps #4974 left open by @markokraemer in https://github.com/kortix-ai/suna/pull/4980
- chore(dev-eks): deploy dev-e05b805b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4981
- feat(connectors): auto-discover source authentication by @markokraemer in https://github.com/kortix-ai/suna/pull/4982
- chore(dev-eks): deploy dev-0b9f4edb [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4985
- docs(llm-gateway): register inference routes in OpenAPI spec by @markokraemer in https://github.com/kortix-ai/suna/pull/4986
- feat(llm-gateway): Models tab in depth — pricing, capabilities, copyable ids by @markokraemer in https://github.com/kortix-ai/suna/pull/4984
- feat(gateway): in-UI API reference for OpenAI/Anthropic/models endpoints by @markokraemer in https://github.com/kortix-ai/suna/pull/4983
- docs(self-host): correct stale ':stable not yet published' claim by @agent-kortix in https://github.com/kortix-ai/suna/pull/4988
- feat(gateway): add Playground tab for comparing models side by side by @markokraemer in https://github.com/kortix-ai/suna/pull/4989
- feat(llm-gateway): verify BYOK provider keys live + disclose custom-provider gateway bypass by @markokraemer in https://github.com/kortix-ai/suna/pull/4990
- docs(self-host): add Backup & DR (enterprise) subsection with RPO/RTO + restore drill by @agent-kortix in https://github.com/kortix-ai/suna/pull/4992
- feat(gateway): routing availability preview + vision-model override editor by @markokraemer in https://github.com/kortix-ai/suna/pull/4991
- ci(self-host): bump fast e2e per-test timeout to 30s (fix release-blocker flake) by @agent-kortix in https://github.com/kortix-ai/suna/pull/4993
- feat(llm-gateway): per-model generation controls (ingest, UI, persistence, injection) by @markokraemer in https://github.com/kortix-ai/suna/pull/4995
- chore(dev-eks): deploy gateway dev-bb305e48 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4997
- chore(dev-eks): deploy dev-bb305e48 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/4998
- fix(api): block sandbox agent tokens from account-scoped usage + gateway forensics reads by @agent-kortix in https://github.com/kortix-ai/suna/pull/4999
- chore(dev-eks): deploy dev-9971614f [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5001
- feat(connectors): feature-flag Discover beside Easy Connect by @markokraemer in https://github.com/kortix-ai/suna/pull/5000
- chore(dev-eks): deploy dev-73a5f282 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5003
- feat(session): reasoning-effort selector in the chat composer by @markokraemer in https://github.com/kortix-ai/suna/pull/5002
- fix(llm-catalog): only show reasoning-effort control for models with real reasoning_options by @markokraemer in https://github.com/kortix-ai/suna/pull/5004
- fix(routing): routing-policy PUT 500 when defaultModel is set (missed partial-index ON CONFLICT predicate from #4978) by @markokraemer in https://github.com/kortix-ai/suna/pull/5006
- fix(llm-gateway): linear-time trimTrailingSlash (CodeQL js/polynomial-redos, high) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5005
- chore(dev-eks): deploy gateway dev-832d9fea [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5008
- chore(dev-eks): deploy dev-832d9fea [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5009
- apps/web: React Doctor cleanup — dead code purge, session hot-path perf, correctness + a11y fixes by @sutharjay1 in https://github.com/kortix-ai/suna/pull/4994
- chore(dev-eks): deploy gateway dev-0823ba05 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5011
- chore(dev-eks): deploy dev-0823ba05 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5012
- fix(llm-gateway): full models.dev field fidelity + fix selector provider-grouping bug by @markokraemer in https://github.com/kortix-ai/suna/pull/5010
- chore(dev-eks): deploy gateway dev-f4127030 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5015
- chore(dev-eks): deploy dev-f4127030 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5016
- test(ke2e): refresh two stale flow assertions (GW-4 modelGenerationConfig, PROJ-19 v2 blank manifest) by @markokraemer in https://github.com/kortix-ai/suna/pull/5017
- chore(db): reconcile main to staging's shipped migration (main<>staging sync) by @markokraemer in https://github.com/kortix-ai/suna/pull/5020
- chore(dev-eks): deploy dev-266366e9 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5021
- test(ke2e): cover github-app + managed-git + marketplace install-session routes → 83.8% by @agent-kortix in https://github.com/kortix-ai/suna/pull/5023
- chore: remove 11 unused imports flagged by CodeQL js/unused-local-variable by @agent-kortix in https://github.com/kortix-ai/suna/pull/5025
- chore(dev-eks): deploy dev-434498d0 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5026
- test(ke2e): cover the remaining API routes → ~100% coverage by @markokraemer in https://github.com/kortix-ai/suna/pull/5024
- chore: remove 27 more unused imports (CodeQL js/unused-local-variable batch 2) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5028
- chore(dev-eks): deploy dev-a3a87883 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5029
- feat(git-backends): code.storage (Pierre) managed git provider, flag-gated by @markokraemer in https://github.com/kortix-ai/suna/pull/5027
- chore(dev-eks): deploy dev-08787efc [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5030
- docs(runbooks): add enterprise onboarding packet (customer-facing) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5031
- spec(session-boot): 1-second threshold gap analysis + attack sequence by @agent-kortix in https://github.com/kortix-ai/suna/pull/5032
- spec(teams): MS Teams connector Phase D scoping — backend done, CLI surface is the gap by @agent-kortix in https://github.com/kortix-ai/suna/pull/5033
- feat(cli): kortix channels --platform teams (status/connect/manifest) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5034
- fix(github-app): install-callback no longer 500s on a bare hit (no state) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5035
- chore(dev-eks): deploy dev-bf38c80b [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5037
- test(ke2e): add AUD-5 audit surface edge cases (authz, pagination, SSRF, secret-once, cross-account isolation) by @agent-kortix in https://github.com/kortix-ai/suna/pull/5036
- bench(session-boot): Phase 0 benchmark harness — measure create→ready P50/P95/P99 by @agent-kortix in https://github.com/kortix-ai/suna/pull/5038
- chore(dev-eks): deploy dev-3f0aa945 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5039
- spec(llm-gateway): routing/fallback/cost/latency/evals audit + proposal by @agent-kortix in https://github.com/kortix-ai/suna/pull/5040
- seo(aeo): order /api/ai recency-first so freshest content leads by @agent-kortix in https://github.com/kortix-ai/suna/pull/4976
- fix(sandbox): decouple Chromium bake from per-project warm-repo cache miss by @markokraemer in https://github.com/kortix-ai/suna/pull/5042
- chore(dev-eks): deploy gateway dev-03ce16b7 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5043
- chore(dev-eks): deploy dev-03ce16b7 [skip ci] by @github-actions[bot] in https://github.com/kortix-ai/suna/pull/5045
- content: publish self-hosted AI agent platforms listicle by @agent-kortix in https://github.com/kortix-ai/suna/pull/5041
Full Changelog: https://github.com/kortix-ai/suna/compare/v0.10.10...v0.10.11