ld
Getting started

Connect a client

Send your first request through the gateway.

llama-dash exposes one OpenAI- and Anthropic-compatible /v1/* endpoint. Any client that can target a custom base URL works — point it at llama-dash instead of your inference backend.

Base URL

Use the llama-dash origin with a /v1 suffix:

http://localhost:3000/v1

Authentication

If any API keys exist in the database, the proxy requires a bearer token:

Authorization: Bearer sk-...

Create a key from the API Keys page in the dashboard — the secret is shown once on creation. If no keys exist yet, the proxy accepts unauthenticated requests so you can get started.

First request

curl http://localhost:3000/v1/chat/completions \
  -H "Authorization: Bearer sk-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "your-model-id",
    "messages": [{ "role": "user", "content": "Hello!" }]
  }'

The request appears in the Requests log within the dashboard, with routing, token counts, latency, and an estimated cost.

Use the model IDs declared in your llama-swap config.yaml, or a model alias you have configured.

More clients

The dashboard's Endpoints page generates ready-to-paste snippets for many clients. See Connecting clients for curl, Python, TypeScript, Continue, Open WebUI, Home Assistant, opencode, and Claude Code.

Last updated on

On this page