The request names glm4moeforcausallm, a Hugging Face-style model class name for GLM-4 MoE models; none of the candidate sources documents a tool that loads or serves that exact class. The closest match is SGLang, an open-source serving framework for large language models that states support for diverse model architectures 9, alongside Replicate, which hosts GLM-4V models via API 8. Inference frameworks like LiteLLM 7 also route to many model providers, though none of the sources confirms G
A question back: Do you want to run this model locally on your own GPUs, or call it through a hosted API?
- 1
SGLangsglang.iowebsite read, tools not yet checked
Open-source serving framework for large language and multimodal models, offering production-grade, low-latency inference from a single accelerator to distributed clusters.
+2 community tools built for it
- 2
Replicatereplicate.comverified and signed
Cloud API for running open-source machine learning models, including a GLM-4V 9B multimodal model from Tsinghua University via the cuuupid/glm-4v-9b action.
for agents: cuuupid/glm-4v-9b
- 3
LiteLLMlitellm.aifound in code, not yet checked
Open-source AI gateway providing one OpenAI-compatible interface across 140+ providers and 1,892 models, which can route to GLM-family models if a provider offers them.
+8 community tools built for it
for agents: curl · shell · begin_repro_run
Sources
- 7LiteLLM — Open-Source AI Gateway & LLM Proxylitellm.ai · read 2026-10-29
- 8Replicate - Run AI with an APIreplicate.com · read 2026-10-29
- 9SGLang – Fast, Open-Source LLM & Multimodal Serving Frameworksglang.io · read 2026-10-29
For agents: the 10 actions behind this answer
spring-boot-testing · spring-boot-testing verified and signed
Expert Spring Boot 4 testing specialist that selects the best Spring Boot testing techniques for your situation with Junit 6 and AssertJ.
sagemaker-ai · sagemaker-ai verified and signed
Build, train, and deploy AI models with deep AWS AI/ML expertise brought directly into your coding assistants, covering the surface area of Amazon SageMaker AI.
mcore-testing · mcore-testing verified and signed
Test system for Megatron-LM. Covers test layout, recipe YAML structure, adding and running unit and functional tests, golden values, marker filters, and CI parity.
PostTestHelpersIssuingAuthorizations · Stripe API verified and signed
Create a test-mode authorization
cloudforce-one-test-email-rule · Cloudflare API verified and signed
Test an email rule
· Playwright website read, tools not yet checked
Web automation and testing for apps, scripts, and AI agents
curl · shin-watcher-oss found in code, not yet checked
Make an HTTP request to the local litellm proxy (localhost only).
cuuupid/glm-4v-9b · cuuupid/glm-4v-9b verified and signed
GLM-4V is a multimodal model released by Tsinghua University that is competitive with GPT-4o and establishes a new SOTA on several benchmarks, including OCR.
· SGLang website read, tools not yet checked
SGLang powers fast, scalable inference for large language and multimodal models. Open-source serving framework with state-of-the-art performance.
nateraw/goliath-120b · nateraw/goliath-120b verified and signed
An auto-regressive causal LM created by combining 2x finetuned Llama-2 70B into one.
Labels are the instruments' verdict and are never changed by ranking. Agents and robots get this same answer as JSON at /api/v1/find?q=…&answer=1 and through the MCP server.