Tag: gpu-optimization

Transform idle GPU hours into autonomous ML research with Litmus on OpenClaw. Multiple agents experiment overnight, a Director steers every 2 hours, and a Synthesizer builds reusable skills. Wake up to discoveries.

Discover how AirLLM enables running 70B parameter LLMs on 4GB GPUs and 405B models on 8GB VRAM through innovative layer-wise inference streaming. Complete setup guide, real code examples, and performance optimization tips included.

TurboQuant-GPU achieves 5.02x KV cache compression for LLM inference with 0.98 cosine similarity. Learn how this open-source tool outperforms NVIDIA's FP4 formats, works on any GPU, and installs in seconds.

Discover pegainfer, a radical pure Rust + CUDA LLM inference engine with zero PyTorch overhead. Achieve 91 tok/s on RTX 5070 Ti, explore custom GPU kernels, and deploy with minimal dependencies. Complete setup guide and benchmarks inside.