No product in the candidate set is named qwen3.5-9b-quantized.w8a8 or documents that exact checkpoint, so these are the closest tools for running or serving a quantized Qwen model. Ollama 7 and SGLang 8 serve open LLMs directly, Modal 9 hosts inference endpoints, and Replicate 1 offers a Qwen3 model via API, though its page shows a 32B variant rather than the 9B w8a8 checkpoint.
A question back: Which platform or hardware will you run the model on (local machine, cloud GPU, or a specific serving stack)?
- 1
Ollamaollama.comwebsite read, tools not yet checked
Runs open AI models locally or in the cloud on macOS, Windows and Linux, so a quantized Qwen model can be pulled and served through it 7.
+137 community tools built for it
- 2
SGLangsglang.iowebsite read, tools not yet checked
Open-source serving framework for large language models with quantization-friendly, high-throughput inference across diverse hardware 8.
+2 community tools built for it
- 3
Modalmodal.comverified and signed
Cloud infrastructure for serving AI models, with OpenAI-compatible inference endpoints that can host a custom quantized model 9.
+20 community tools built for it
for agents: infrastructure · cloud · serverless
- 4
Sources
- 1Replicate - Run AI with an APIreplicate.com · read 2026-10-29
- 7Ollama · Run AI models locally and in the cloudollama.com · read 2026-10-29
- 8SGLang – Fast, Open-Source LLM & Multimodal Serving Frameworksglang.io · read 2026-10-29
- 9Modal: The platform for production AImodal.com · read 2026-10-29
- 11prunaai/qwen3-32b: declares "prunaai/qwen3-32b" (the record we read and signed)unfragile.ai · read 2026-10-24
For agents: the 10 actions behind this answer
prunaai/qwen3-32b · prunaai/qwen3-32b verified and signed
A 2x faster qwen 3 model through pruna oss
import-infrastructure-as-code · import-infrastructure-as-code verified and signed
Import existing Azure resources into Terraform using Azure CLI discovery and Azure Verified Modules (AVM). Use when asked to reverse-engineer live Azure infrastructure, generate Infrastructure as Code from existing subscriptions/resource groups/resource IDs, map dependencies, derive exact import add
radar-get-ai-inference-summary-by-model · Cloudflare API verified and signed
Get Workers AI models summary
qwen/qwen3-235b-a22b-instruct-2507 · qwen/qwen3-235b-a22b-instruct-2507 verified and signed
Updated Qwen3 model for instruction following
DescribeRxNormInferenceJob · AWS Comprehend Medical verified and signed
Gets the properties associated with an InferRxNorm job. Use this operation to get the status of an inference job.
lucataco/qwen3-vl-8b-instruct · lucataco/qwen3-vl-8b-instruct verified and signed
A powerful vision-language model in the Qwen series
lucataco/qwen3-embedding-8b · lucataco/qwen3-embedding-8b verified and signed
The Qwen3 Embedding model series is specifically designed for text embedding and ranking tasks
tao-run-inference-service · tao-run-inference-service verified and signed
Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to ru
· ONNX website read, tools not yet checked
qwen/qwen3-7-plus · qwen/qwen3-7-plus verified and signed
Qwen3.7-Plus is Alibaba's cost-effective multimodal model with vision-language understanding, a 1 million token context window, and strong agentic coding and tool use.
Labels are the instruments' verdict and are never changed by ranking. Agents and robots get this same answer as JSON at /api/v1/find?q=…&answer=1 and through the MCP server.