Inference API developer tools
Every listing tagged inference-api, A to Z: 8 tools across 1 category. Listed in alphabetical order, not ranked.
Baseten
Per-token Model APIs for open models such as GLM, DeepSeek and Kimi, with OpenAI and Anthropic-compatible endpoints, plus dedicated deployments of your own or fine-tuned models packaged with the open-source Truss, billed by the minute.
Cerebras Inference
Open models such as GPT OSS 120B and Qwen 3.8 27B served on Cerebras hardware through an OpenAI-compatible API: a pay-as-you-go Developer tier for building and testing, Enterprise plans for production and fine-tuning.
DeepInfra
OpenAI-compatible API for open models such as Llama, DeepSeek and Qwen, billed per token with Standard, Priority and Flex tiers. Also open text-to-speech models such as Kokoro, billed per character, open embedding models such as Qwen3-Embedding and bge-m3, FLUX image generation models billed per image, and dedicated GPUs for your own LLMs billed by the minute.
Fireworks AI
Inference platform for open models: per-token serverless with Standard, Priority and Fast modes, batch at half the serverless price, on-demand GPUs billed per second, and LoRA or full fine-tuning (SFT, DPO) with tuned models served at the base price. Serverless embedding models too, from Qwen3 Embedding 8B to small BERT-size models. OpenAI-compatible.
Groq
GroqCloud runs a short list of open models, including gpt-oss and Whisper for speech-to-text, on Groq's own LPU hardware behind an OpenAI-compatible API, with a free tier and a pay-as-you-go Developer plan.
Modal Endpoints
Modal's inference product: OpenAI-compatible Shared Endpoints for open models billed per token, or Dedicated Endpoints that run open models or your own weights, billed per second of compute.
RunInfra
Open-model APIs built for agents: fast responses, warm replicas with up to 98% cache hits for repeated context, and one API key that works with the OpenAI and Anthropic SDKs. Backed by Y Combinator.
Together AI
Serverless API for open models such as gpt-oss, GLM and Kimi, OpenAI-compatible and billed per token, with batch, provisioned throughput, dedicated endpoints, fine-tuning (LoRA or full, SFT and DPO, priced per training token) and GPU clusters when you outgrow shared capacity. Image generation models too, such as FLUX.2, GPT Image 2 and Nano Banana Pro, priced per image. Video generation models as well, such as Seedance 2.5, HappyHorse and Hailuo 02.