Skip to main content
Tracecat ships with built-in connections for the major model providers. Connect a provider once at the organization level, allow the models you want to expose, and pick an organization-wide default.
Agent configuration page showing the default model selector and provider connections

​
Supported providers

Tracecat lists providers in this order in Organization settings > Agent > Configuration. Ollama, vLLM, and LiteLLM base URLs must include the /v1 segment and be reachable from the Tracecat services. Inside a container, localhost points at the container itself, not your host.
Can’t find the provider you’re using? Add it as a custom source instead. See Custom LLM providers to connect any OpenAI-compatible gateway.

​
Connect a provider

1

Open agent configuration

Go to Organization settings, open Agent, then click Configuration.
2

Enter credentials

Click Connect next to the provider. Fill in the fields the dialog asks for, then click Save credentials.
Configure Ollama credentials dialog with base URL, API key, and passthrough fields
3

Allow models

Expand the provider row and click Allow next to each model you want to expose. The pill on the row shows how many models are enabled.Ollama, vLLM, LiteLLM, and OpenRouter discover models from the provider’s /models endpoint when you save credentials. Click Refresh models on the row after you add or remove models upstream.
4

Set the default model

Under Default model, pick one of the enabled models. Agents and AI actions use it whenever a preset or action does not set its own model.
Click Configure on a connected provider to rotate credentials, or expand the row and click Disconnect to remove them.

​
Passthrough

Ollama, vLLM, LiteLLM, and OpenRouter expose a Passthrough toggle that controls how agent requests reach the provider. Leave passthrough off unless the endpoint serves the Anthropic Messages API itself. LiteLLM defaults to on because a LiteLLM proxy already handles routing; a second gateway in front of it adds a hop without adding capability.
  • See Custom LLM providers for connecting an OpenAI-compatible gateway that is not listed above.
  • See AI agent for the ai.agent and ai.preset_agent action reference, including per-agent model overrides.
  • See AI action for single-call LLM workflow actions.
  • See Air-gapped deployment for running Ollama or vLLM without internet access.