Skip to content

Hugging Face

Use the hf provider for Hugging Face Inference Providers.

hf:
  api_key: "${HF_TOKEN}"
  # default_provider: groq # optional: groq, fireworks-ai, cerebras, etc.

Use hf.<model_name>[:provider] to specify models. If no provider suffix is supplied, Hugging Face auto-routes the request.

fast-agent --model kimi
fast-agent --model kimi26instant
fast-agent --model hf.openai/gpt-oss-120b
fast-agent --model hf.moonshotai/kimi-k2-instruct-0905:groq
fast-agent --model "hf.moonshotai/Kimi-K2.6:novita?reasoning=on"

Curated aliases such as kimi, deepseek-hf, glm, and minimax include provider choices and request defaults tested with fast-agent features such as structured outputs and tool use. Capability can still vary by backing provider.

Kimi instant mode

Kimi models that support instant mode can disable reasoning with the instant query parameter:

fast-agent --model "hf.moonshotai/Kimi-K2.5?instant=on"  # thinking disabled
fast-agent --model "hf.moonshotai/Kimi-K2.5?instant=off" # thinking enabled

Gemma thinking mode

gemma4 routes Gemma 4 31B through Hugging Face Inference Providers on Cerebras:

fast-agent --model gemma4
fast-agent --model "hf.google/gemma-4-31B-it:cerebras?temperature=1.0&top_p=0.95"

Gemma 4 reasoning is disabled by default on Cerebras. Enable it with reasoning_effort values through fast-agent's reasoning query parameter:

fast-agent --model "gemma4?reasoning=medium" # sends reasoning_effort=medium
fast-agent --model "gemma4?reasoning=none"   # sends reasoning_effort=none

Hugging Face MCP authentication

HF_TOKEN is automatically applied when connecting to Hugging Face MCP servers:

  • hf.co / huggingface.co uses Authorization: Bearer {HF_TOKEN}
  • *.hf.space uses both Authorization: Bearer {HF_TOKEN} and X-HF-Authorization: Bearer {HF_TOKEN}

Model aliases

Model Alias Maps to
deepseek-ai/deepseek-v4-pro deepseek-ai/deepseek-v4-pro
deepseek-hf hf.deepseek-ai/DeepSeek-V4-Pro:together
deepseek32 hf.deepseek-ai/DeepSeek-V3.2:fireworks-ai
deepseek4-hf hf.deepseek-ai/DeepSeek-V4-Pro:together
deepseek4pro-hf hf.deepseek-ai/DeepSeek-V4-Pro:together
deepseekv4pro-hf hf.deepseek-ai/DeepSeek-V4-Pro:together
gemma4 hf.google/gemma-4-31B-it:cerebras?temperature=1.0&top_p=0.95
glm hf.zai-org/GLM-5.2:zai-org
glm47 hf.zai-org/GLM-4.7:cerebras
glm5 hf.zai-org/GLM-5:novita
glm51 hf.zai-org/GLM-5.1:together
glm52 hf.zai-org/GLM-5.2:zai-org
google/gemma-4-31b-it google/gemma-4-31b-it
gpt-oss hf.openai/gpt-oss-120b:cerebras
gpt-oss-20b hf.openai/gpt-oss-20b
kimi hf.moonshotai/Kimi-K2.7-Code:fireworks-ai?temperature=1.0&top_p=0.95&reasoning=on
kimi-2.5 hf.moonshotai/Kimi-K2.5:novita?temperature=1.0&top_p=0.95&reasoning=on
kimi-2.6 hf.moonshotai/Kimi-K2.6:novita?temperature=1.0&top_p=0.95&reasoning=on
kimi25 hf.moonshotai/Kimi-K2.5:novita?temperature=1.0&top_p=0.95&reasoning=on
kimi25instant hf.moonshotai/Kimi-K2.5:novita?temperature=0.6&top_p=0.95&reasoning=off
kimi26 hf.moonshotai/Kimi-K2.6:novita?temperature=1.0&top_p=0.95&reasoning=on
kimi26instant hf.moonshotai/Kimi-K2.6:novita?temperature=0.6&top_p=0.95&reasoning=off
kimi27 hf.moonshotai/Kimi-K2.7-Code:fireworks-ai?temperature=1.0&top_p=0.95&reasoning=on
kimi27code hf.moonshotai/Kimi-K2.7-Code:fireworks-ai?temperature=1.0&top_p=0.95&reasoning=on
kimithink hf.moonshotai/Kimi-K2.6:novita?temperature=1.0&top_p=0.95&reasoning=on
minimax hf.MiniMaxAI/MiniMax-M3:together?temperature=1.0&top_p=0.95&top_k=40
minimax2.5 hf.MiniMaxAI/MiniMax-M2.5:novita?temperature=1.0&top_p=0.95&top_k=40
minimax21 hf.MiniMaxAI/MiniMax-M2.1:novita
minimax25 hf.MiniMaxAI/MiniMax-M2.5:fireworks-ai?temperature=1.0&top_p=0.95&top_k=40
minimax27 hf.MiniMaxAI/MiniMax-M2.7:fireworks-ai?temperature=1.0&top_p=0.95&top_k=40
minimax3 hf.MiniMaxAI/MiniMax-M3:together?temperature=1.0&top_p=0.95&top_k=40
moonshotai/kimi-k2 moonshotai/kimi-k2
moonshotai/kimi-k2-instruct-0905 moonshotai/kimi-k2-instruct-0905
moonshotai/kimi-k2-thinking moonshotai/kimi-k2-thinking
moonshotai/kimi-k2.5 moonshotai/kimi-k2.5
moonshotai/kimi-k2.6 moonshotai/kimi-k2.6
moonshotai/kimi-k2.7-code moonshotai/kimi-k2.7-code
qwen/qwen3.5-397b-a17b qwen/qwen3.5-397b-a17b
qwen/qwen3.6-35b-a3b qwen/qwen3.6-35b-a3b
qwen35 hf.Qwen/Qwen3.5-397B-A17B:novita?temperature=0.6&top_p=0.95&top_k=20&min_p=0.0&presence_penalty=0.0&repetition_penalty=1.0&reasoning=on
qwen35instruct hf.Qwen/Qwen3.5-397B-A17B:novita?temperature=0.7&top_p=0.8&top_k=20&min_p=0.0&presence_penalty=1.5&repetition_penalty=1.0&reasoning=off
qwen36 hf.Qwen/Qwen3.6-35B-A3B:deepinfra?temperature=0.6&top_p=0.95&top_k=20&min_p=0.0&presence_penalty=0.0&repetition_penalty=1.0&reasoning=on
qwen36instruct hf.Qwen/Qwen3.6-35B-A3B:deepinfra?temperature=0.7&top_p=0.8&top_k=20&min_p=0.0&presence_penalty=1.5&repetition_penalty=1.0&reasoning=off
zai-org/glm-5.2 zai-org/glm-5.2