10:30
Ornith-1.5-9B: Great on Paper, Struggled in My Tests Locally
Fahd Mirza tests the Ornith 1.5 9B model — the smallest and densest member of the Ornith 1.5 family — on a single NVIDIA A100 with 80...
Sort by: Newest Items
There are 89 items in this page
09:20
DFlash 2: Qwen3.8-27B at 2× Speed – Live Benchmark Locally
Fahd Mirza benchmarks DFlash 2, a community-developed speculative decoding enhancement for the Qwen3.8-27B model, running live on an...
11:35
Ornith 1.5 35B-A3B: Self-Improving Model Goes General-Purpose: Run Locally
Fahd Mirza walks through deploying Ornith 1.5 35B-A3B — the latest release from Deep Reinforce — on a single Nvidia A100 80GB GPU usi...
18:00
Qwen3.8-27B & How to Serve it Fast
Sam Witteveen takes a close look at the newly released Qwen 3.8 27B model from Alibaba's Qwen team, positioning it as the natural suc...
09:42
Qwen3.8-9B: Community Distillation of a Frontier Model: Run Locally
Fahd Mirza walks through installing and testing Qwen3.8-9B, a community-built 9-billion-parameter distillation of Alibaba's 27-billio...
06:18
Antares-1B: Vulnerability Localization with AI Locally
Fahd Mirza demonstrates Antares 1B, a 1-billion parameter model released by Cisco's Foundation AI team specifically for vulnerability...
13:13
Qwen3.8-27B Locally: Does It Live Up to the Hype?
Fahd Mirza pulls the Qwen3.8-27B weights and runs the model locally on a single Nvidia A100 80GB GPU using vLLM, providing a practica...
08:39
Why You Shouldn’t Run Qwen3.8 2.4T Locally
Fahd Mirza delivers a frank assessment of Qwen's newly released Qwen3 2.4-trillion-parameter open-weight model, making the case that...
10:42
NeMo Switchyard: NVIDIA’s Model Router, Tested Locally
Fahd Mirza installs and demonstrates NeMo Switchyard, a newly released NVIDIA tool written in Rust that acts as an intelligent model...
12:51
Nemotron 3.5 Lightning: Specialized Local AI for Long-Running Agents
Fahd Mirza walks through a complete local installation and live test of NVIDIA's newly released Nemotron 3.5 Lightning — a 30-billion...