Quantization / optimization
Quantization / optimization covers tools that compress models and make them faster to run.
In brief
Quantization / optimization, in brief.
What it isQuantization / optimization covers tools that compress models and make them faster to run.
Where it sitsOne of 13 categories in the Inference and serving layer. Inference and serving is everything that turns a trained model into a running service: hosted inference providers, gateways that route between them, serving engines, and the tools that make models smaller and faster.
What we track27 products, including AIMET, AMD Quark, AQLM, AutoAWQ (archived; AWQ lives on in llm-compressor) and AutoRound.
The products
27 products in Quantization / optimization.
Each name opens a search for that product in our index.
ProductMakerIts own site
From our census of 2026-11-08. A product listed here is one that belongs in this category; the search answer says whether we have checked it.
Questions
Quantization / optimization, answered.
What is Quantization / optimization in AI infrastructure?Quantization / optimization covers tools that compress models and make them faster to run.
Which layer of AI infrastructure is Quantization / optimization in?Quantization / optimization is in the Inference and serving layer. Inference and serving is everything that turns a trained model into a running service: hosted inference providers, gateways that route between them, serving engines, and the tools that make models smaller and faster.
Which products are in Quantization / optimization?We track 27 products in Quantization / optimization, including AIMET, AMD Quark, AQLM, AutoAWQ (archived; AWQ lives on in llm-compressor), AutoRound, BitNet / bitnet.cpp, bitsandbytes and Brevitas. The full list is on this page.
Inference and serving
The other categories in Inference and serving.
AI gateways & model routersBatch inferenceGenerative media inference platformsGenerative media workflow toolsInference benchmarking & load testingInference kernels & attention librariesInference providersKV-cache & prompt-caching infrastructureLoRA serving & adapter hubsModel compilers & graph optimizersOn-device / edge runtimesServing engines & model servers