A collection of 6 posts
Baidu's Unlimited-OCR parses entire multi-page PDFs in a single forward pass. Here's how to run the 3.3B open-weights model locally with Transformers, vLLM, or SGLang.
Ornith 1.0 is DeepReinforce's open-source, self-scaffolding family of agentic coding models, post-trained on Qwen 3.5 and Gemma 4. This guide shows how to run each variant locally - 9B on a laptop, 35B MoE on a 24GB card, 397B on an 8-GPU box - with Ollama, LM Studio and vLLM, plus agent settings.
A 1,620-upvote 'Stop using Ollama' thread set off a real 2026 debate about switching. Here is why developers are leaving, who is overstating it, and which alternative to pick by use case: GUI, speed, production, or Apple Silicon.
May 2026 was a heavy ship month for local AI runtimes. Ollama added Codex App support. vLLM 0.21 stabilised DeepSeek V4 on Blackwell. llama.cpp merged MTP speculative decoding. MLX hit 4x faster on M5. LM Studio shipped stable MTP. Practical runtime-by-runtime changelog.
Honest 2026 comparison of the five dominant local LLM runtimes: Ollama, LM Studio, vLLM, llama.cpp, and MLX. Throughput numbers, feature matrix, and a decision tree.
A 2026 decision framework for vLLM, Ollama, and LM Studio — when each one wins on throughput, hardware support, and cost, with cited benchmarks instead of fabricated numbers.