Don’t want to host it yourself? DeepInfra can run Hermes for you — see Hosted Agents: Hermes-Agent.
/v1/chat/completions) — so you add DeepInfra as a custom provider and use any LLM from our catalog.
Configure ~/.hermes/config.yaml
provider: customis required for any non-built-in OpenAI-compatible endpoint, andbase_urloverridesprovider.- The DeepInfra model id passes through verbatim in
default— no reformatting needed. api_keyfalls back to theOPENAI_API_KEYenvironment variable if omitted, and secrets can live in~/.hermes/.envinstead of the YAML.- Set
context_lengthexplicitly. Above it’s the model’s full 1M-token window; Hermes needs roughly 64k minimum for agent functionality. Check a model’s window via/v1/openai/models?filter=with_meta.
Interactive alternative
Instead of editing the YAML by hand, run the model wizard and pick the custom endpoint:Run it
Learn more
AI Providers
Hermes’ provider overview and custom-endpoint option.
Configuration
The full
config.yaml reference.Chat Completions
DeepInfra’s OpenAI-compatible API.
Authentication
API keys and scoped JWTs.