Tetrate Agent Router Service

The Tetrate Agent Router Service provides a unified Gateway for accessing various AI models with fast inference capabilities.

This gateway acts as an intelligent router that can distribute requests across multiple model providers, offering enterprise-grade reliability and performance optimization.

Want to get started quickly? Sign up for the Tetrate Agent Router Service to get an API key, then follow the configuration examples below.

Setup

1. Sign in or sign up

   Visit the Agent Router Service portal and create an account to get your API key

   
2. Get your API key

   Go to the API keys page to get your key

   
3. Configure Continue

   • Choose a configuration method below.
   • If you use the Continue VS Code extension, install version >=1.2.3.

Configuration Methods

In Local Agent Configuration

Define models directly in your local agent configuration.

Using Local Model Blocks

Create a local model block for reuse across agents.

Configuration Examples

Click a tab to see an example.

In Local Agent Configuration

When to use: Simple local setups (like using the VS Code extension) when you don’t need shared or published blocks.

Use a Tetrate model block in your local agent configuration:

~/.continue/config.yaml

name: Local Agent
version: 1.0.0
schema: v1
models:
  - uses: tetrate/claude-sonnet-4
    with:
      TETRATE_API_KEY: ${{ secrets.TETRATE_API_KEY }}
context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase

Or define the model directly:

~/.continue/config.yaml

name: Local Agent
version: 1.0.0
schema: v1
models:
  - name: Claude Sonnet 4
    provider: tars
    model: claude-4-sonnet-20250514
    apiKey: ${{ secrets.TETRATE_API_KEY }}
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
context:
  - provider: code
  - provider: docs
  - provider: diff
  - provider: terminal
  - provider: problems
  - provider: folder
  - provider: codebase

Using Local Model Blocks

When to use: Reuse configurations across agents and keep them local or in GitHub.

The Local Model Block:

Name the file my-claude-4-model.yaml so you can reference it in the Agent.

~/.continue/models/my-claude-4-model.yaml

name: Claude Sonnet 4
version: 1.0.1
schema: v1
models:
  - name: Claude Sonnet 4
    provider: tars
    model: claude-4-sonnet-20250514
    apiKey: ${{ inputs.TETRATE_API_KEY }}
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use

Reference it as my-claude-4-model in your Agent configuration:

~/.continue/agents/simple-agent.yaml

name: Simple Agent
version: 1.0.0
schema: v1
models:
  - uses: my-claude-4-model
    with:
      TETRATE_API_KEY: ${{ secrets.TETRATE_API_KEY }}
context:
  - uses: continuedev/diff-context
  - uses: continuedev/terminal-context
  - uses: continuedev/file-context

Learn more about model blocks.

---

Troubleshooting Common Issues

Invalid API key

Verify your API key is active and has no extra spaces.

Model not found

Confirm the model ID matches the Tetrate catalog.

Slow responses

Check your network or try a less-loaded model. Contact Tetrate support if issues persist.

Configuration not loading

Validate YAML syntax and review error messages in Continue.

---

Join the Community

Connect with Tetrate and other builders for help and discussion.

Join the Tetrate Community

Get answers, insights, and best practices for secure, scalable infrastructure