Choose your LLM provider and manage API keys
add LLM key
. You’ll be prompted to provide a name, description, Model provider name, and the API key value.Manage LLM keys
.Backend
module automatically detects whether you’ve configured custom credentials. If so, it securely retrieves the key from the vault and injects it into the LLM client at runtime. This process is completely transparent to your code, allowing you to use backend.get_args()
without any changes.
For local development, you can still use the override
parameter to test with different keys without affecting your production configuration. This hybrid approach gives you the best of both worlds: secure key management in production and flexibility during development.
.env
files for local API keysbackend.get_args()
backend.get_args()
override
parameter