Llama Stack

Get started with Lllama Stack

YAML

config.yaml

name: My Config
version: 0.0.1
schema: v1

models:
  - name: <MODEL_NAME>
    provider: llamastack
    model: <MODEL_ID>
    apiBase: http://<LLAMA_STACK_ENDPOINT>/v1/openai/v1/

JSON (Deprecated)

config.json

{
  "models": [
    {
      "title": "<MODEL_NAME>",
      "provider": "llamastack",
      "model": "<MODEL_ID>",
      "apiBase": "http://<LLAMA_STACK_ENDPOINT>/v1/openai/v1/"
    }
  ]
}