letta-ai/letta-configuration

Letta Configuration

Complete guide for configuring models on agents and providers on servers.

When to Use This Skill

Agent-level (model configuration):

• Creating agents with specific model configurations
• Adjusting model settings (temperature, max tokens, context window)
• Configuring provider-specific features (OpenAI reasoning, Anthropic thinking)
• Changing models on existing agents

Server-level (provider configuration):

• Setting up BYOK (bring your own key) providers
• Configuring self-hosted deployments with environment variables
• Validating provider credentials
• Setting up custom OpenAI-compatible endpoints

Not covered here: Model selection advice (which model to choose) - see agent-development skill.

---

Part 1: Model Configuration (Agent-Level)

Model Handles

Models use a provider/model-name format:

| Provider | Handle Prefix | Example | |----------|---------------|---------| | OpenAI | openai/ | openai/gpt-4o, openai/gpt-4o-mini | | Anthropic | anthropic/ | anthropic/claude-sonnet-4-5-20250929 | | Google AI | google_ai/ | google_ai/gemini-2.0-flash | | Azure OpenAI | azure/ | azure/gpt-4o | | AWS Bedrock | bedrock/ | bedrock/anthropic.claude-3-5-sonnet | | Groq | groq/ | groq/llama-3.3-70b-versatile | | Together | together/ | together/meta-llama/Llama-3-70b | | OpenRouter | openrouter/ | openrouter/anthropic/claude-3.5-sonnet | | Ollama (local) | ollama/ | ollama/llama3.2 |

Basic Model Configuration

from letta_client import Letta

client = Letta(api_key="your-api-key")

agent = client.agents.create(
    model="openai/gpt-4o",
    model_settings={
        "provider_type": "openai",  # Required - must match model provider
        "temperature": 0.7,
        "max_output_tokens": 4096,
    },
    context_window_limit=128000
)

Common Settings

| Setting | Type | Description | |---------|------|-------------| | provider_type | string | Required. Must match model provider (openai, anthropic, google_ai, etc.) | | temperature | float | Controls randomness (0.0-2.0). Lower = more deterministic. | | max_output_tokens | int | Maximum tokens in the response. |

Changing an Agent's Model

client.agents.update(
    agent_id=agent.id,
    model="anthropic/claude-sonnet-4-5-20250929",
    model_settings={"provider_type": "anthropic", "temperature": 0.5},
    context_window_limit=64000
)

Note: Agents retain memory and tools when changing models.

Provider-Specific Settings

For OpenAI reasoning models and Anthropic extended thinking, see references/provider-settings.md.

---

Part 2: Provider Configuration (Server-Level)

Quick Start

# Add provider via API
python scripts/setup_provider.py --type openai --api-key sk-...

# Generate .env for Docker
python scripts/generate_env.py --providers openai,anthropic,ollama

# Validate credentials
python scripts/validate_provider.py --provider-id provider-xxx

Add BYOK Provider

# Via REST API
curl -X POST http://localhost:8283/v1/providers \
  -H "Content-Type: application/json" \
  -d '{
    "name": "My OpenAI",
    "provider_type": "openai",
    "api_key": "sk-your-key-here"
  }'

Supported Provider Types

openai, anthropic, azure, google_ai, google_vertex, ollama, groq, deepseek, xai, together, mistral, cerebras, bedrock, vllm, sglang, hugging_face, lmstudio_openai

For detailed configuration of each provider, see:

• references/common_providers.md - OpenAI, Anthropic, Azure, Google
• references/self_hosted_providers.md - Ollama, vLLM, LM Studio
• references/all_providers.md - Complete reference
• references/environment_variables.md - Docker/self-hosted setup

---

Anti-Hallucination Checklist

Before configuring:

• [ ] Model handle uses correct provider/model-name format
• [ ] model_settings includes required provider_type field
• [ ] context_window_limit is set at agent level, not in model_settings
• [ ] Provider-specific settings use correct nested structure
• [ ] For self-hosted: embedding model is specified
• [ ] Temperature is within valid range (0.0-2.0)

Scripts

Model configuration:

• scripts/basic_config.py - Basic model configuration
• scripts/basic_config.ts - TypeScript equivalent
• scripts/change_model.py - Changing models on existing agents
• scripts/provider_specific.py - OpenAI reasoning, Anthropic thinking

Provider configuration:

• scripts/setup_provider.py - Add providers via REST API
• scripts/validate_provider.py - Check provider credentials
• scripts/generate_env.py - Generate .env for Docker