The request names a specific model, Gemma-4-12B-it-AEON-Abliterated-MLX-8bit, which none of the sources identify directly. Ollama 3 runs open AI models locally on macOS, Windows, and Linux, so it is the most direct route to run a local Gemma model, and Replicate 1 hosts a Gemma 4 31B Instruct model via API, a related but different size. A specific MLX 8-bit build is not shown in any source, so the user may need to confirm which platform and runtime they intend to use.
A question back: Do you want to run this model locally on a Mac with MLX, or through a cloud API?
- 1
Ollamaollama.comwebsite read, tools not yet checked
Runs open AI models locally or in the cloud on macOS, Windows, and Linux, which is the closest local route to running a Gemma model 3.
+137 community tools built for it
- 2
- 3
GPUs Marketgpusmarket.comwebsite read, tools not yet checked
Rents GPUs and runs models on Mac or rented hardware, with gemma3 examples in its terminal demo 4.
Sources
- 1Replicate - Run AI with an APIreplicate.com · read 2026-10-29
- 3Ollama · Run AI models locally and in the cloudollama.com · read 2026-10-29
- 4GPUs Market — Make & Rent AI: Images, Voice, Video & LLMs on Mac + GPUsgpusmarket.com · read 2026-10-29
- 5lucataco/gemma-4-31b-it: declares "lucataco/gemma-4-31b-it" (the record we read and signed)unfragile.ai · read 2026-10-24
For agents: the 10 actions behind this answer
lucataco/gemma-4-31b-it · lucataco/gemma-4-31b-it verified and signed
Gemma 4 31B Instruct - Google open-weight VLM (image + text in, text out)
nano-banana-pro-openrouter · nano-banana-pro-openrouter verified and signed
Generate or edit images via OpenRouter with the Gemini 3 Pro Image model. Use for prompt-only image generation, image edits, and multi-image compositing; supports 1K/2K/4K output.
prunaai/gemma-4-26b-a4b-fast · prunaai/gemma-4-26b-a4b-fast verified and signed
This is a version of the MoE Gemma 4 26B optimised by Pruna AI.
google-deepmind/gemma-7b-it · google-deepmind/gemma-7b-it verified and signed
7B instruct version of Google’s Gemma model
google-deepmind/gemma-2b-it · google-deepmind/gemma-2b-it verified and signed
2B instruct version of Google’s Gemma model
· Ollama website read, tools not yet checked
Ollama is the easiest way to run and build with open AI models locally or in the cloud on macOS, Windows, and Linux.
google-deepmind/gemma2-27b-it · google-deepmind/gemma2-27b-it verified and signed
Google's Gemma2 27b instruct model
google-deepmind/gemma2-9b-it · google-deepmind/gemma2-9b-it verified and signed
Google's Gemma2 9b instruct model
google-deepmind/gemma-3-12b-it · google-deepmind/gemma-3-12b-it verified and signed
Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models.
ibm-granite/granite-4.1-8b · ibm-granite/granite-4.1-8b verified and signed
Granite-4.1-8B is a 8B parameter long-context instruct model finetuned from Granite-4.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets.
Labels are the instruments' verdict and are never changed by ranking. Agents and robots get this same answer as JSON at /api/v1/find?q=…&answer=1 and through the MCP server.