Liquid Inference icon

Liquid Inference

Liquid Inference is an AI inference router that sends each LLM request to the lowest-priced provider meeting selected model, region, speed, and quality rules. It helps developers and teams manage provider choice, compatibility, and inference costs through OpenAI- and Anthropic-compatible APIs.

Liquid Inference

What is Liquid Inference?

Liquid Inference is an inference router and auction exchange for large language model requests. It lets multiple providers compete on a request, then selects the lowest-priced offer that meets the customer's specified model, region, speed, and minimum-quality requirements.

The service is designed to fit into existing API workflows: its site documents OpenAI Chat Completions and Anthropic Messages through one base URL, with a Liquid Inference API key. It also exposes request cost information, provider quality measurements, and market price history for customers evaluating or managing inference spend.

Core features

Per-request provider auction

Providers quote a price per token for each model, and the request is sent to the lowest-priced provider that satisfies the rules selected by the customer.

Configurable routing rules

Customers can specify the model, region, speed, and minimum quality requirements used to determine which providers are eligible.

Upfront cost control

A price limit is set before generation begins, so the maximum request cost is known before the first token. Billing is based on produced tokens, with input tokens priced separately.

OpenAI and Anthropic API compatibility

The service offers one base URL for OpenAI Chat Completions and Anthropic Messages, allowing compatible existing clients to change the endpoint and API key rather than rebuild the request workflow.

Provider quality benchmarks

Liquid Inference says it tests providers regularly with standard benchmarks and publishes the resulting quality measurements for comparison.

Billing and market data

Customers can view itemized request costs and download live and historical prices for models, supporting cost review and workload timing.

Potential use cases

  • Add routing to an existing LLM application

    Teams with an existing OpenAI- or Anthropic-compatible application can test provider competition by changing the API base URL and API key while retaining their client workflow.

  • Balance inference cost and requirements

    Engineering teams can set model, region, speed, and minimum-quality rules for workloads where cost matters but requests still need to meet operational or output requirements.

  • Monitor and manage inference spend

    Operations or finance teams can inspect itemized request charges and use live or historical price information to compare model costs and decide when to send workloads.

  • Offer inference capacity

    AI infrastructure providers can register a deployment, submit it for review, connect an agent, and quote their own prices while controlling load by stopping quotes or changing prices.

  • Use with coding and agent tools

    Developers using compatible tools such as Claude Code, Codex, Cursor, LiteLLM, LangChain, or SDK-based clients can point supported workflows at the shared router endpoint.

Pros and Cons

Pros

  • Routes each request among competing provider offers instead of using only a fixed provider rate.
  • Lets customers constrain routing by model, region, speed, and minimum quality.
  • Shows a maximum request price before generation and provides itemized billing.
  • Supports OpenAI Chat Completions and Anthropic Messages through a shared base URL.
  • Publishes provider benchmark results and live or historical model price data.

Cons

  • The source does not document the complete API schema, limits, reliability guarantees, security controls, or the full provider and model coverage.
  • Prices are dynamic and depend on current provider offers, selected routing rules, and token usage; input and output token pricing are treated separately.

FAQ

How do I connect an application to Liquid Inference?

Liquid Inference provides a router endpoint for OpenAI Chat Completions and Anthropic Messages. The site says existing clients can use the service by changing the base URL and supplying a Liquid Inference API key.

How does request routing work?

For each request, providers quote prices for the selected model. Liquid Inference applies the customer's rules, including model, region, speed, and minimum quality, and routes the request to the cheapest provider that meets them.

How is usage priced?

The service displays a maximum price for a request before generation begins. Customers are billed for the tokens the request produces, while input tokens are priced separately from output tokens.

What tools and APIs can I use with it?

The site lists OpenAI-compatible and Anthropic-compatible API workflows, and names clients and tools such as Claude Code, Codex, Cursor, OpenAI SDK, Anthropic SDK, LiteLLM, LangChain, and the Vercel AI SDK. The source does not provide full compatibility or model-coverage documentation.

Quick Facts

Category
AI inference routing
Primary users
Teams and developers sending LLM API requests
API formats
OpenAI Chat Completions and Anthropic Messages
Routing inputs
Model, region, speed, and minimum quality
Billing basis
Produced tokens; input tokens priced separately
Provider model
Independent providers quote prices and compete for requests

Alternatives à Liquid Inference