20:28
Muse Glimmer 30B GGUF + DFlash: 3x Faster Local Inference
Fahd Mirza follows up his full-precision Muse Glimmer 30B video with a focused benchmark of the GGUF quantized version running with D...
Sort by: Newest Items
There are 12 items in this page
09:22
Nemotron Lightning – NVIDIA’s Super Fast Agent MoE
Sam Witteveen reviews NVIDIA's NeMo Tron 3.5 Lightning, a 30B-parameter mixture-of-experts model with only 3B active parameters, purp...
59:10
The 100,000 Sandbox Problem — Akshat Bubna, Modal CTO
Latent Space hosts Modal CTO Akshat Bubna for an in-depth conversation on how Modal evolved from a general serverless runtime into a...
09:39
DeepSeek DFlash on Gemma 12B Locally: Up To 5x Faster
Fahd Mirza demonstrates how to run DeepSeek's DFlash speculative decoding method locally, pairing the open-source DeepSeek drafter mo...
08:49
DSpark – DeepSeek Just Made Inference 85% Faster
DeepSeek has released DSpark, a speculative decoding system that makes their models generate text 60 to 85% faster without any change...
09:40
DFlash Just Got Faster: 4x Speed with 160 tok/s Locally
Fahd Mirza benchmarks DFlash with SGLang's new SpecV2 overlapping scheduler on an NVIDIA H100 80GB GPU, demonstrating a 4.3x throughp...
12:30
Luce KVFlash: Fit 256K Context on a Small GPU – Local Hands-On Guide
KV Flash is a new memory management engine for local LLM inference that keeps only the most relevant tokens on GPU VRAM while paging...
13:13
Adaptive PFlash + Hermes Agent – Self-Tuning Prefill on a Single GPU Locally
Fahd Mirza demonstrates the newly shipped adaptive compression feature in PFlash, the prefill-acceleration component of the open-sour...
08:41
Luce DFlash Meets OpenClaw – Local AI Agents at 2x Speed with Qwen3.6-27B
Fahd Mirza walks through a complete, reproducible integration of DFlash — a speculative decoding inference engine — with OpenClaw, an...
09:45
TurboQuant + DFlash: Supercharge Local LLM Speed
Fahd Mirza demonstrates the practical integration of two recently released local inference tools: Google Research's TurboCore KV cach...