Model Configuration

Model configuration has two layers:

1. Providers & Profiles – connection/auth + parameter bundles per vendor.
2. Model Sets – routing rules mapping agent complexity & tags to profiles.

Routing enables: cost efficiency (cheap models for simple tasks), specialization (domain tags), experimentation (controlled trials via tags), and multi-vendor resilience.

Explore details:

• Providers & Profiles
• Model Sets

Design Tips:

• Start with minimal profiles (one fast, one high capability) then expand based on trace evidence.
• Centralize tuning changes in profiles; avoid scattering temperature adjustments in agent instructions.
• Use tags purposefully—only where they drive routing differences.