# FastRouter.AI Docs ## FastRouter Docs - [Welcome](https://docs.fastrouter.ai/readme.md) - [Dashboard](https://docs.fastrouter.ai/explore-features/quickstart.md): The Dashboard and Activity Log are essential for monitoring, analyzing, and optimizing your API usage with large language models (LLMs). - [Automatic Model Selection](https://docs.fastrouter.ai/explore-features/automatic-model-selection.md) - [Virtual Model Aliases](https://docs.fastrouter.ai/explore-features/virtual-model-aliases.md): Virtual Model Aliases make it easy to manage and optimize amongst multiple LLMs without changing your code. - [Fallback Models](https://docs.fastrouter.ai/explore-features/fallback-models.md) - [Free Models (:free)](https://docs.fastrouter.ai/explore-features/free-models-free.md): FastRouter exposes select models at no charge via the :free slug — up to 10 requests per org per day, with no payment required. - [Flex Pricing](https://docs.fastrouter.ai/explore-features/flex-pricing.md): Access OpenAI and Google Gemini models at up to 50% lower cost by opting into flexible inference — ideal for background tasks, batch workloads, and latency-tolerant applications. - [Provider Routing Strategies](https://docs.fastrouter.ai/explore-features/provider-routing-strategies.md) - [Organization & Members](https://docs.fastrouter.ai/explore-features/organization-and-members.md): FastRouter supports role-based access control at the organization level to manage permissions and responsibilities effectively. - [Projects](https://docs.fastrouter.ai/projects.md): Projects in FastRouter.ai provide a structure for specifying access and limits for keys used. - [Keys & Settings](https://docs.fastrouter.ai/keys-and-settings.md): API keys in FastRouter allow granular control over access, usage, and budget. You can generate multiple keys with custom configurations for different users, projects, or integrations. - [Add External Keys (BYOK)](https://docs.fastrouter.ai/add-external-keys-byok.md): Bring Your Own Key — Connect your own provider credentials to FastRouter and route traffic through your own accounts while retaining FastRouter's full routing, observability, and governance layer. - [Custom Evaluations](https://docs.fastrouter.ai/custom-evaluations.md): FastRouter’s Custom Evaluations lets you benchmark and compare AI models on your own data—using LLM-based judges to automatically score accuracy, latency, and cost. - [Video Evaluations](https://docs.fastrouter.ai/video-evaluations.md): Evaluate AI-generated videos at scale using LLM-based judges, with automated scoring across motion, sync, quality, and prompt adherence. - [Prompt Library](https://docs.fastrouter.ai/prompt-library.md): Manage, version, optimize, and deploy prompts independently of your code—enabling instant updates and rollbacks without application redeploys. - [Prompt Optimizations](https://docs.fastrouter.ai/prompt-optimizations.md): Automatically refine your system prompts using GEPA — a reflective prompt evolution algorithm that iteratively improves prompts using LLM-judged feedback as gradients. - [Prompt Caching](https://docs.fastrouter.ai/prompt-caching.md): FastRouter supports prompt caching on all major providers that offer it, with automatic sticky routing to maximize cache hits. - [Guardrails](https://docs.fastrouter.ai/guardrails.md): Add deterministic and LLM-based guardrails to protect your AI applications from unwanted behaviors and ensure compliance. - [Batch Processing](https://docs.fastrouter.ai/batch-processing.md): FastRouter supports batch processing for efficient handling of multiple API requests at scale. - [Image Processing](https://docs.fastrouter.ai/image-processing.md): A guide to sending images via Base64 or URLs in API requests. - [PDF Processing](https://docs.fastrouter.ai/pdf-processing.md): End-to-end guide to PDF ingestion in FastRouter chat completions, including plugin config, request examples, and billing details. - [Dynamic Tags Per Request](https://docs.fastrouter.ai/dynamic-tags-per-request.md): Leverage dynamic tags for reporting, billing, or feature tracking with custom tags sent per request. - [Credits](https://docs.fastrouter.ai/credits.md) - [Provisioning Keys](https://docs.fastrouter.ai/provisioning-keys.md): Provisioning Keys are special-purpose administrative tokens used to securely create, update, list, and delete Service Account Keys within your organization. - [Structured Outputs](https://docs.fastrouter.ai/structured-outputs.md): FastRouter supports structured JSON outputs, allowing you to enforce a specific schema in LLM responses. This feature ensures that responses are machine-readable and conform to a predefined structure. - [Function Calling](https://docs.fastrouter.ai/function-calling.md): FastRouter supports Function Calling for models capable of planning and invoking tools or functions. This allows LLMs to return structured function calls instead of natural language responses. - [Reasoning Tokens](https://docs.fastrouter.ai/reasoning-tokens.md): FastRouter can return Reasoning Tokens (also known as thinking tokens) for supported models. - [Response Caching](https://docs.fastrouter.ai/response-caching.md): Response Caching allows FastRouter.ai users to cache LLM responses for repeated or similar prompts. - [Custom Alerts](https://docs.fastrouter.ai/alerts.md): Alerts help you monitor your API usage and performance in real-time. Set up custom thresholds to get notified when metrics exceed expected values or change compared to historical baselines. - [System Alerts](https://docs.fastrouter.ai/system-alerts.md): System alerts are automatic, pre-configured notifications that fire when your organization's credit balance or project/key budgets cross critical thresholds - [Tracing](https://docs.fastrouter.ai/tracing.md): Group related LLM API calls into a single trace using a simple traceparent header. - [MCP Gateway](https://docs.fastrouter.ai/mcp-gateway.md) - [Web Search](https://docs.fastrouter.ai/web-search.md) - [skill](https://docs.fastrouter.ai/skill.md): Use FastRouter's official skill.md file to give your AI coding assistants knowledge of FastRouter features - [Chat Completions](https://docs.fastrouter.ai/api-reference/chat-completions.md) - [Responses](https://docs.fastrouter.ai/api-reference/responses.md) - [Anthropic Messages Format](https://docs.fastrouter.ai/api-reference/anthropic-messages-format.md) - [Gemini Native Format](https://docs.fastrouter.ai/api-reference/gemini-native-format.md) - [Embeddings](https://docs.fastrouter.ai/api-reference/embeddings.md) - [Image](https://docs.fastrouter.ai/api-reference/image.md) - [Image Generation](https://docs.fastrouter.ai/api-reference/image/image-generation.md) - [Image Edit](https://docs.fastrouter.ai/api-reference/image/image-edit.md) - [Audio](https://docs.fastrouter.ai/api-reference/audio.md) - [Text to Speech](https://docs.fastrouter.ai/api-reference/audio/text-to-speech.md) - [Audio to Text](https://docs.fastrouter.ai/api-reference/audio/audio-to-text.md) - [Text to Audio](https://docs.fastrouter.ai/api-reference/audio/text-to-audio.md) - [Video](https://docs.fastrouter.ai/api-reference/video.md) - [Realtime](https://docs.fastrouter.ai/api-reference/realtime.md) - [Moderations](https://docs.fastrouter.ai/api-reference/moderations.md) - [List Models](https://docs.fastrouter.ai/api-reference/models.md) - [Models x Provider Breakdown](https://docs.fastrouter.ai/api-reference/models-x-provider-breakdown.md) - [List Providers](https://docs.fastrouter.ai/api-reference/list-providers.md) - [Provider x Model Supported Parameters](https://docs.fastrouter.ai/api-reference/provider-x-model-supported-parameters.md) - [Auto Router](https://docs.fastrouter.ai/api-reference/auto-router.md) - [Batch Processing](https://docs.fastrouter.ai/api-reference/batch-processing.md) - [Generations](https://docs.fastrouter.ai/api-reference/generations.md) - [Error Codes](https://docs.fastrouter.ai/api-reference/error-codes.md) - [Changelog](https://docs.fastrouter.ai/product-updates/changelog.md): New updates and improvements - [Coding Assistants](https://docs.fastrouter.ai/integrations/coding-assistants.md): Use FastRouter as an OpenAI-compatible provider inside your coding assistant. One key, 100+ models, full observability and cost control. - [Aider](https://docs.fastrouter.ai/integrations/coding-assistants/aider.md): Track usage, control costs, and add guardrails to your Aider coding sessions - [Claude Code](https://docs.fastrouter.ai/integrations/coding-assistants/claude-code.md): This guide walks you through setting up Claude Code to work with FastRouter.ai as your API provider. - [Codex CLI](https://docs.fastrouter.ai/integrations/coding-assistants/codex-cli.md): Integrating Codex CLI with FastRouter. - [Cursor](https://docs.fastrouter.ai/integrations/coding-assistants/cursor.md): Track usage, control costs, and add guardrails to your Cursor AI editor - [Cline](https://docs.fastrouter.ai/integrations/coding-assistants/cline.md): Track usage, control costs, and add guardrails to your Cline coding agent - [Roo Code](https://docs.fastrouter.ai/integrations/coding-assistants/roo-code.md): Track usage, control costs, and add guardrails to your Roo Code coding agent - [OpenCode](https://docs.fastrouter.ai/integrations/coding-assistants/opencode.md): Track usage, control costs, and add guardrails to your OpenCode coding agent - [DeepSeek Reasonix CLI](https://docs.fastrouter.ai/integrations/coding-assistants/deepseek-reasonix-cli.md): Integrating DeepSeek Reasonix CLI with FastRouter. - [Kilo Code](https://docs.fastrouter.ai/integrations/coding-assistants/kilo-code.md): Track usage, control costs, and add guardrails to your Kilo Code coding sessions - [DeepSeek Reasonix CLI](https://docs.fastrouter.ai/integrations/coding-assistants/deepseek-reasonix-cli-1.md): Route DeepSeek Reasonix CLI through FastRouter for unified model access, observability, failover, and organizational controls. - [XCode](https://docs.fastrouter.ai/integrations/coding-assistants/xcode.md): Track usage, control costs, and add guardrails to your Xcode AI coding sessions. - [Agents](https://docs.fastrouter.ai/integrations/agents.md): Route any Python agent framework through FastRouter. One key, 100+ models, and full cost visibility across every agent call. - [AutoGen](https://docs.fastrouter.ai/integrations/agents/autogen.md): Track usage, control costs, and add guardrails to your AutoGen multi-agent apps - [Agno](https://docs.fastrouter.ai/integrations/agents/agno.md): Track usage, control costs, and add guardrails to your Agno agents - [CrewAI](https://docs.fastrouter.ai/integrations/agents/crewai.md): Track usage, control costs, and add guardrails to your CrewAI multi-agent crews - [Langgraph](https://docs.fastrouter.ai/integrations/agents/langgraph.md): Track usage, control costs, and add guardrails to your LangGraph agents - [OpenAI Agent SDK](https://docs.fastrouter.ai/integrations/agents/openai-agent-sdk.md): Track usage, control costs, and add guardrails to your OpenAI Agents SDK applications - [OpenClaw](https://docs.fastrouter.ai/integrations/agents/openclaw.md) - [Running Hermes Agent with FastRouter](https://docs.fastrouter.ai/integrations/agents/running-hermes-agent-with-fastrouter.md) - [Pydantic AI](https://docs.fastrouter.ai/integrations/agents/pydantic-ai.md): Track usage, control costs, and add guardrails to your Pydantic AI agents - [App](https://docs.fastrouter.ai/integrations/app.md): Point ready-to-run agent apps and chat gateways at FastRouter. Install once, run a setup command, get 100+ models with full cost visibility. - [Instructor](https://docs.fastrouter.ai/integrations/app/instructor.md): Track usage, control costs, and add guardrails to your Instructor structured outputs - [LlamaIndex](https://docs.fastrouter.ai/integrations/app/llamaindex.md): Track usage, control costs, and add guardrails to your LlamaIndex applications - [LangChain](https://docs.fastrouter.ai/integrations/app/langchain.md): Track usage, control costs, and add guardrails to your LangChain applications - [n8n](https://docs.fastrouter.ai/integrations/app/n8n.md): Track usage, control costs, and add guardrails to your n8n AI workflows - [Open WebUI](https://docs.fastrouter.ai/integrations/app/open-webui.md): Track usage, control costs, and add guardrails to your Open WebUI deployment - [Scalekit](https://docs.fastrouter.ai/integrations/app/scalekit.md): Add per-user OAuth tool calling to your FastRouter agent with Scalekit. Gmail, GitHub, Slack, and more, with zero custom OAuth code. --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on a page URL with the `ask` query parameter: ``` GET https://docs.fastrouter.ai/readme.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.