09:45
Llama.cpp Just Got MTP – Qwen3.6 27B Runs 2x Faster Locally with Two Flags
Multi-token prediction (MTP) support has officially merged into the mainline llama.cpp repository—not a fork or custom branch, but th...
Sort by: Newest Items
There are 200 items in this page
16:50
Run HiDream-O1-Image Locally with ComfyUI
Fahd Mirza walks through the complete local installation of HiDream-O1, a newly released 8-billion-parameter image generation model f...
08:16
GroundedAI with Ollama – Universal Evaluation Interface for LLM Applications
Fahd Mirza demonstrates how to install and run GroundedAI, an open-source evaluation framework built to detect hallucinations and mea...
10:06
Toto 2.0: Datadog’s Observability AI Model – Full Install + Live Dashboard
Datadog has released Toto 2, an open-source family of time series foundation models purpose-built for observability and DevOps teleme...
10:54
Talkie: I Ran a 1930 AI Model Locally and Talked to People from the Past
Fahd Mirza explores Talkie, a 13 billion parameter language model built by Alec Radford — the researcher behind GPT-2 — that was trai...
09:22
DramaBox – Run Most Expressive TTS with Voice Cloning Locally
Fahd Mirza takes a hands-on look at DramaBox, a newly released expressive text-to-speech model that can be run locally on consumer-gr...
11:12
Qwen3.6 27B Gets 20% Faster with MTP and llama.cpp Locally
Fahd Mirza demonstrates how to enable multi-token prediction (MTP) on Qwen3.6 27B using ik_llama.cpp — a community fork of the popula...
09:49
Building AI Evals for Real-World Problems
Fahd Mirza walks through how to set up and run OpenAI's evals framework on a practical real-world task: classifying the causes of inv...
11:00
NVIDIA Nemotron Elastic: 3-in-1 Elastic LLM Like Russian Dolls in One File
NVIDIA's Nemotron Elastic model family packs three reasoning models — 30B, 23B, and 12B parameters — into a single checkpoint file us...
09:15
ZAYA1-VL-8B: Efficient Open Visual Intelligence – Run Locally
Fahd Mirza puts ZAYA1-VL-8B — the new vision-language model from Zeffa — through its paces on an NVIDIA RTX 6000 with 48GB of VRAM, s...