13:26
Under 5 minutes to a deployed LLM endpoint — Audry Hsu, RunPod
At the AI Engineer summit, Audrey Hsu, developer advocate at RunPod, delivers a live demo showing how to deploy a production-ready LL...
Sort by: Newest Items
There are 63 items in this page
10:33
Mellum2: JetBrains’ New Coding Model – vLLM + MCP Tool Use Locally
JetBrains has released Mellum 2, a 12-billion-parameter mixture-of-experts coding model that runs at the compute cost of a 2.5-billio...
09:08
Hermes Desktop + Ollama: Run a Self-Improving AI Agent on Your Own Server
Fahd Mirza walks through the installation and configuration of Hermes agent desktop, the newly released GUI for the Hermes agent fram...
12:40
What Lies Beneath the API — Benjamin Cowen, Modal
Benjamin Cowen, a forward-deployed machine learning engineer at Modal, delivers a conference talk examining one of the most consequen...
11:06
Best Qwen3.6 Quant You Can Run Right Now Locally
Fahd Mirza examines Nvidia's official FP4 quantization of Qwen3 35B A22B — a release validated by Nvidia's own model optimizer tool a...
10:07
Dolphin X1 Trinity Nano: The Model That Never Says No: Run and Test Locally
Fahd Mirza walks through the local deployment and testing of Dolphin X1 Trinity Nano, the first model trained entirely within a custo...
09:39
Step 3.7 Flash – 198B Open Source Model That Does Everything; Does it Really?
Step 3.7 Flash is a 198 billion parameter sparse mixture-of-experts model from Step One, activating only 11 billion parameters per to...
08:53
LFM2.5-8B-A1B: Local Agentic AI with Multilingual Support Tested
LFM2.5-8B-A1B is Liquid AI's latest open-weight model — an 8.3 billion parameter mixture-of-experts architecture that activates only...
10:06
DFlash Leaves Qwen Territory – Gemma 4 31B Now Runs 5x Faster with Speculative Decoding
Fahd Mirza demonstrates the first end-to-end deployment of Llama Box DFlash with Google's Gemma 4 31B model, following the merge of P...
11:11
MiniCPM5-1B: New 1B King for Local AI – Full Demo
Fahd Mirza walks through a complete local installation and live evaluation of MiniCPM 5 in its 1 billion parameter variant, released...