Inference providers
Inference providers covers hosted APIs that run open models for you.
In brief
Inference providers, in brief.
What it isInference providers covers hosted APIs that run open models for you.
Where it sitsOne of 13 categories in the Inference and serving layer. Inference and serving is everything that turns a trained model into a running service: hosted inference providers, gateways that route between them, serving engines, and the tools that make models smaller and faster.
What we track38 products, including Alibaba Cloud Model Studio, Amazon Bedrock, Azure AI Foundry Models, Baseten and Cerebras Inference.
The products
38 products in Inference providers.
Each name opens a search for that product in our index.
ProductMakerIts own site
From our census of 2026-11-08. A product listed here is one that belongs in this category; the search answer says whether we have checked it.
Questions
Inference providers, answered.
What is Inference providers in AI infrastructure?Inference providers covers hosted APIs that run open models for you.
Which layer of AI infrastructure is Inference providers in?Inference providers is in the Inference and serving layer. Inference and serving is everything that turns a trained model into a running service: hosted inference providers, gateways that route between them, serving engines, and the tools that make models smaller and faster.
Which products are in Inference providers?We track 38 products in Inference providers, including Alibaba Cloud Model Studio, Amazon Bedrock, Azure AI Foundry Models, Baseten, Cerebras Inference, Chutes, Clarifai and Cloudflare Workers AI. The full list is on this page.
Inference and serving
The other categories in Inference and serving.
AI gateways & model routersBatch inferenceGenerative media inference platformsGenerative media workflow toolsInference benchmarking & load testingInference kernels & attention librariesKV-cache & prompt-caching infrastructureLoRA serving & adapter hubsModel compilers & graph optimizersOn-device / edge runtimesQuantization / optimizationServing engines & model servers