Tag: MLX

Parallax by Gradient is a distributed model serving framework that transforms personal devices into a decentralized AI cluster. Run 70B+ models across Mac, NVIDIA, and cloud nodes with pipeline parallelism, paged KV caching, and dynamic routing—no cloud API required.

llmfit is a Rust-powered terminal tool that automatically matches LLM models to your hardware. Detects GPU/CPU/RAM, scores hundreds of models across quality, speed, fit and context dimensions, and tells you what actually runs on your machine.

Discover F5-TTS-MLX, the breakthrough non-autoregressive zero-shot TTS system running natively on Apple Silicon. Generate human-quality speech in 4 seconds, completely offline, with voice cloning capabilities that rival expensive cloud APIs.

Discover mlx-tune: the Unsloth-compatible fine-tuning framework that brings LLM, vision, audio, and OCR training to Apple Silicon. Write once, run on Mac and cloud. Complete guide with real code examples.

Discover oMLX, the Mac-optimized LLM inference server with continuous batching, tiered RAM/SSD KV caching, and native menu bar control. Run production-grade local AI on Apple Silicon without cloud dependencies.