Unfragile

The request names "JEV-27B-VL-GGUF", a model name that none of the candidate sources mention directly. The closest matches are GGUF-related tools: ggml.ai, the tensor library behind GGUF local inference 5, and Hugging Face, which hosts GGUF models and offers local-model selection tooling for GGUF quantizations 29. Since the request does not say which platform you want to run it on, the best route depends on that.

A question back: Do you want to run JEV-27B-VL-GGUF locally on your own hardware (and if so, which: CPU, Mac Metal, CUDA, or ROCm), or through a cloud API?

1
Hugging Facehuggingface.coverified and signed
Hosts GGUF model files and offers an action to select and run GGUF models locally with llama.cpp, plus an hf-mem CLI to estimate memory needed to load GGUF weights 9.
Website Docs Pricing Get started
official:MCP server · @huggingface/mcp-client skill · hf-cli skill · hf-cloud-aws-context-discovery skill · hf-cloud-python-env-setup skill · hf-cloud-sagemaker-deployment-planner
for agents: huggingface-local-models · hf-mem · huggingface-vision-trainer
2
ggml.aiggml.aiverified and signed
A tensor library for machine learning on commodity hardware, used by llama.cpp, which runs GGUF-format models 5.
Website
for agents: llama.cpp · gguf · ggml
3
Replicatereplicate.comverified and signed
Runs open-source models through a cloud API, including GGUF-quantized models such as a 70B GGUF fine-tune 18.
Website Docs Pricing Get started
for agents: spuuntries/miqumaid-v1-70b-gguf

Sources

1Replicate - Run AI with an APIreplicate.com · read 2026-10-29
2Hugging Face – The AI community building the future.huggingface.co · read 2026-10-29
5ggml.aiggml.ai · read 2026-10-29
8spuuntries/miqumaid-v1-70b-gguf: declares "spuuntries/miqumaid-v1-70b-gguf" (the record we read and signed)unfragile.ai · read 2026-10-24
9huggingface-local-models: declares "huggingface-local-models" (the record we read and signed)unfragile.ai · read 2026-10-24

For agents: the 10 actions behind this answer

spuuntries/miqumaid-v1-70b-gguf · spuuntries/miqumaid-v1-70b-gguf verified and signed
NeverSleep's MiquMaid v1 70B Miqu Finetune, GGUF Q3_K_M quantized by NeverSleep.
spuuntries/flatdolphinmaid-8x7b-gguf · spuuntries/flatdolphinmaid-8x7b-gguf verified and signed
Undi95's FlatDolphinMaid 8x7B Mixtral Merge, GGUF Q5_K_M quantized by TheBloke.
huggingface-local-models · huggingface-local-models verified and signed
Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.
kcaverly/deepseek-coder-33b-instruct-gguf · kcaverly/deepseek-coder-33b-instruct-gguf verified and signed
A quantized 33B parameter language model from Deepseek for SOTA repository level code completion
create-llms · create-llms verified and signed
Create an llms.txt file from scratch based on repository structure following the llms.txt specification at https://llmstxt.org/
kcaverly/neuralbeagle14-7b-gguf · kcaverly/neuralbeagle14-7b-gguf verified and signed
NeuralBeagle14-7B is (probably) the best 7B model you can find!
· SGLang website read, tools not yet checked
SGLang powers fast, scalable inference for large language and multimodal models. Open-source serving framework with state-of-the-art performance.
lucataco/moondream2 · lucataco/moondream2 verified and signed
moondream2 is a small vision language model designed to run efficiently on edge devices
lucataco/qwen3-vl-8b-instruct · lucataco/qwen3-vl-8b-instruct verified and signed
A powerful vision-language model in the Qwen series
lucataco/wizardcoder-33b-v1.1-gguf · lucataco/wizardcoder-33b-v1.1-gguf verified and signed
WizardCoder: Empowering Code Large Language Models with Evol-Instruct

Labels are the instruments' verdict and are never changed by ranking. Agents and robots get this same answer as JSON at /api/v1/find?q=…&answer=1 and through the MCP server.