Configuration
Configure LLM backends and API keys for Trace2
Configuration
Trace2 supports multiple LLM backends through LiteLLM and AutoGen.
LLM Backend Setup
Default: LiteLLM
By default, Trace2 uses LiteLLM which supports 100+ LLM providers.
OpenAI
import os
os.environ["OPENAI_API_KEY"] = "sk-..."
os.environ["TRACE_LITELLM_MODEL"] = "gpt-4o"Anthropic
import os
os.environ["ANTHROPIC_API_KEY"] = "sk-ant-..."
os.environ["TRACE_LITELLM_MODEL"] = "claude-3-5-sonnet-20241022"Other Providers
See LiteLLM documentation for other providers.
AutoGen Backend
For backward compatibility, Trace2 supports AutoGen v0.2:
pip install trace-opt[autogen][Add AutoGen configuration details]
Switching Backends
import os
os.environ["TRACE_DEFAULT_LLM_BACKEND"] = "LiteLLM" # or "AutoGen"