Local Model Management And Execution

via “model-registry-and-layer-based-composition”

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Unique: Content-addressed blob storage with manifest-based composition enables deduplication across model variants — a 7B and 13B model sharing the same base weights only store weights once, with deltas tracked separately. Modelfile syntax provides declarative model composition without requiring code.

vs others: More efficient than Hugging Face model downloads because layer-level deduplication avoids re-downloading shared weights; simpler than vLLM's model serving because composition happens at pull-time rather than runtime