# FastRouter.AI Docs ## FastRouter Docs - [Welcome](https://docs.fastrouter.ai/readme.md) - [Dashboard](https://docs.fastrouter.ai/explore-features/quickstart.md): The Dashboard and Activity Log are essential for monitoring, analyzing, and optimizing your API usage with large language models (LLMs). - [Automatic Model Selection](https://docs.fastrouter.ai/explore-features/automatic-model-selection.md) - [Virtual Model Aliases](https://docs.fastrouter.ai/explore-features/virtual-model-aliases.md): Virtual Model Aliases make it easy to manage and optimize amongst multiple LLMs without changing your code. - [Fallback Models](https://docs.fastrouter.ai/explore-features/fallback-models.md) - [Free Models (:free)](https://docs.fastrouter.ai/explore-features/free-models-free.md): FastRouter exposes select models at no charge via the :free slug — up to 10 requests per org per day, with no payment required. - [Flex Pricing](https://docs.fastrouter.ai/explore-features/flex-pricing.md): Access OpenAI and Google Gemini models at up to 50% lower cost by opting into flexible inference — ideal for background tasks, batch workloads, and latency-tolerant applications. - [Provider Routing Strategies](https://docs.fastrouter.ai/explore-features/provider-routing-strategies.md) - [Organization & Members](https://docs.fastrouter.ai/explore-features/organization-and-members.md): FastRouter supports role-based access control at the organization level to manage permissions and responsibilities effectively. - [Projects](https://docs.fastrouter.ai/projects.md): Projects in FastRouter.ai provide a structure for specifying access and limits for keys used. - [Keys & Settings](https://docs.fastrouter.ai/keys-and-settings.md): API keys in FastRouter allow granular control over access, usage, and budget. You can generate multiple keys with custom configurations for different users, projects, or integrations. - [Add External Keys (BYOK)](https://docs.fastrouter.ai/add-external-keys-byok.md): Bring Your Own Key — Connect your own provider credentials to FastRouter and route traffic through your own accounts while retaining FastRouter's full routing, observability, and governance layer. - [Custom Evaluations](https://docs.fastrouter.ai/custom-evaluations.md): FastRouter’s Custom Evaluations lets you benchmark and compare AI models on your own data—using LLM-based judges to automatically score accuracy, latency, and cost. - [Video Evaluations](https://docs.fastrouter.ai/video-evaluations.md): Evaluate AI-generated videos at scale using LLM-based judges, with automated scoring across motion, sync, quality, and prompt adherence. - [Prompt Library](https://docs.fastrouter.ai/prompt-library.md): Manage, version, optimize, and deploy prompts independently of your code—enabling instant updates and rollbacks without application redeploys. - [Prompt Optimizations](https://docs.fastrouter.ai/prompt-optimizations.md): Automatically refine your system prompts using GEPA — a reflective prompt evolution algorithm that iteratively improves prompts using LLM-judged feedback as gradients. - [Prompt Caching](https://docs.fastrouter.ai/prompt-caching.md): FastRouter supports prompt caching on all major providers that offer it, with automatic sticky routing to maximize cache hits. - [Guardrails](https://docs.fastrouter.ai/guardrails.md): Add deterministic and LLM-based guardrails to protect your AI applications from unwanted behaviors and ensure compliance. - [Batch Processing](https://docs.fastrouter.ai/batch-processing.md): FastRouter supports batch processing for efficient handling of multiple API requests at scale. - [Image Processing](https://docs.fastrouter.ai/image-processing.md): A guide to sending images via Base64 or URLs in API requests. - [PDF Processing](https://docs.fastrouter.ai/pdf-processing.md): End-to-end guide to PDF ingestion in FastRouter chat completions, including plugin config, request examples, and billing details. - [Dynamic Tags Per Request](https://docs.fastrouter.ai/dynamic-tags-per-request.md): Leverage dynamic tags for reporting, billing, or feature tracking with custom tags sent per request. - [Credits](https://docs.fastrouter.ai/credits.md) - [Provisioning Keys](https://docs.fastrouter.ai/provisioning-keys.md): Provisioning Keys are special-purpose administrative tokens used to securely create, update, list, and delete Service Account Keys within your organization. - [Structured Outputs](https://docs.fastrouter.ai/structured-outputs.md): FastRouter supports structured JSON outputs, allowing you to enforce a specific schema in LLM responses. This feature ensures that responses are machine-readable and conform to a predefined structure. - [Function Calling](https://docs.fastrouter.ai/function-calling.md): FastRouter supports Function Calling for models capable of planning and invoking tools or functions. This allows LLMs to return structured function calls instead of natural language responses. - [Reasoning Tokens](https://docs.fastrouter.ai/reasoning-tokens.md): FastRouter can return Reasoning Tokens (also known as thinking tokens) for supported models. - [Response Caching](https://docs.fastrouter.ai/response-caching.md): Response Caching allows FastRouter.ai users to cache LLM responses for repeated or similar prompts. - [Alerts](https://docs.fastrouter.ai/alerts.md): Alerts help you monitor your API usage and performance in real-time. Set up custom thresholds to get notified when metrics exceed expected values or change compared to historical baselines. - [Tracing](https://docs.fastrouter.ai/tracing.md): Group related LLM API calls into a single trace using a simple traceparent header. - [MCP Gateway](https://docs.fastrouter.ai/mcp-gateway.md) - [Web Search](https://docs.fastrouter.ai/web-search.md) - [skill](https://docs.fastrouter.ai/skill.md): Use FastRouter's official skill.md file to give your AI coding assistants knowledge of FastRouter features - [Chat Completions](https://docs.fastrouter.ai/api-reference/chat-completions.md) - [Responses](https://docs.fastrouter.ai/api-reference/responses.md) - [Anthropic Messages Format](https://docs.fastrouter.ai/api-reference/anthropic-messages-format.md) - [Gemini Native Format](https://docs.fastrouter.ai/api-reference/gemini-native-format.md) - [Embeddings](https://docs.fastrouter.ai/api-reference/embeddings.md) - [Image](https://docs.fastrouter.ai/api-reference/image.md) - [Image Generation](https://docs.fastrouter.ai/api-reference/image/image-generation.md) - [Image Edit](https://docs.fastrouter.ai/api-reference/image/image-edit.md) - [Audio](https://docs.fastrouter.ai/api-reference/audio.md) - [Audio to Text](https://docs.fastrouter.ai/api-reference/audio/audio-to-text.md) - [Text to Audio](https://docs.fastrouter.ai/api-reference/audio/text-to-audio.md) - [Video](https://docs.fastrouter.ai/api-reference/video.md) - [Realtime](https://docs.fastrouter.ai/api-reference/realtime.md) - [Moderations](https://docs.fastrouter.ai/api-reference/moderations.md) - [Models](https://docs.fastrouter.ai/api-reference/models.md) - [Providers](https://docs.fastrouter.ai/api-reference/providers.md) - [Auto Router](https://docs.fastrouter.ai/api-reference/auto-router.md) - [Batch Processing](https://docs.fastrouter.ai/api-reference/batch-processing.md) - [Generations](https://docs.fastrouter.ai/api-reference/generations.md) - [Error Codes](https://docs.fastrouter.ai/api-reference/error-codes.md) - [Changelog](https://docs.fastrouter.ai/product-updates/changelog.md): New updates and improvements - [IDE Integrations](https://docs.fastrouter.ai/integrations/ide-integrations.md): Step-by-step guides to configure Cursor, Cline, and Roo Code with FastRouter's OpenAI-compatible API for seamless access to the latest models. - [Claude Code](https://docs.fastrouter.ai/integrations/claude-code.md): This guide walks you through setting up Claude Code to work with FastRouter.ai as your API provider. - [Cursor](https://docs.fastrouter.ai/integrations/cursor.md): Track usage, control costs, and add guardrails to your Cursor AI editor - [Cline](https://docs.fastrouter.ai/integrations/cline.md): Track usage, control costs, and add guardrails to your Cline coding agent - [Roo Code](https://docs.fastrouter.ai/integrations/roo-code.md): Track usage, control costs, and add guardrails to your Roo Code coding agent - [OpenCode](https://docs.fastrouter.ai/integrations/opencode.md): Track usage, control costs, and add guardrails to your OpenCode coding agent - [DeepSeek Reasonix CLI](https://docs.fastrouter.ai/integrations/deepseek-reasonix-cli.md): Integrating DeepSeek Reasonix CLI with FastRouter. - [Codex CLI](https://docs.fastrouter.ai/integrations/codex-cli.md): Integrating Codex CLI with FastRouter. - [OpenClaw](https://docs.fastrouter.ai/integrations/openclaw.md) - [Scalekit](https://docs.fastrouter.ai/integrations/scalekit.md): Add per-user OAuth tool calling to your FastRouter agent with Scalekit. Gmail, GitHub, Slack, and more, with zero custom OAuth code. - [Running Hermes Agent with FastRouter](https://docs.fastrouter.ai/integrations/running-hermes-agent-with-fastrouter.md) - [OpenAI Agent SDK](https://docs.fastrouter.ai/integrations/openai-agent-sdk.md): Track usage, control costs, and add guardrails to your OpenAI Agents SDK applications - [LangChain](https://docs.fastrouter.ai/integrations/langchain.md): Track usage, control costs, and add guardrails to your LangChain applications - [CrewAI](https://docs.fastrouter.ai/integrations/crewai.md): Track usage, control costs, and add guardrails to your CrewAI multi-agent crews - [Pydantic AI](https://docs.fastrouter.ai/integrations/pydantic-ai.md): Track usage, control costs, and add guardrails to your Pydantic AI agents - [Agno](https://docs.fastrouter.ai/integrations/agno.md): Track usage, control costs, and add guardrails to your Agno agents --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on a page URL with the `ask` query parameter: ``` GET https://docs.fastrouter.ai/readme.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.