Thinking Result Formatting And Extraction

via “reasoning model output parsing with thinking extraction”

OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.

Unique: Parses and separates thinking tokens from final output during streaming, enabling real-time access to model reasoning without waiting for generation completion; supports multiple reasoning formats with configurable parsing strategies

vs others: More transparent than black-box reasoning (exposes thinking process); enables streaming reasoning display unlike batch-only parsing; supports multiple model formats