VLLM - Frontier Models

There are 37 items in this page

10:16

Running LLMs locally: Practical LLM Performance on DGX Spark — Mozhgan Kabiri chimeh, NVIDIA

Benchmarks1 month ago

Running LLMs locally: Practical LLM Performance on DGX Spark — Mozhgan Kabiri chimeh, NVIDIA

Mozhgan Kabiri chimeh, Developer Relations Manager at NVIDIA, presents empirical benchmarking results from running large language mod...

08:08

Mobile Agent with GUI-OWL: AI That Controls Any Screen Like a Human: Run Locally

Tutorials1 month ago

Mobile Agent with GUI-OWL: AI That Controls Any Screen Like a Human: Run Locally

GUI-OWL 1.5 is a native multimodal GUI agent from Alibaba's mPLUG team, built on top of Qwen 3 VL, capable of controlling desktops, m...

08:22

LFM2.5‑VL-450M: Liquid AI’s Tiny 450M Vision Model Does More Than You Expect

Coding & Dev Tools1 month ago

LFM2.5‑VL-450M: Liquid AI’s Tiny 450M Vision Model Does More Than You Expect

Fahd Mirza puts Liquid AI's LFM2.5-VL-450M through its paces in a hands-on local deployment, walking through exactly what this compac...

23:54

Gemma 4 26B A4B vs Qwen3.5 35B A3B: MoE Models Battle Locally

Research & Benchmarks1 month ago

Gemma 4 26B A4B vs Qwen3.5 35B A3B: MoE Models Battle Locally

Fahd Mirza runs a direct head-to-head comparison of two mixture-of-experts models — Gemma 4 26B A4B (activating 3.8 billion parameter...

23:13

Gemma-4 31B vs Qwen3.5 27B: Hands-on Local Comparison of Two Top Dense Models

Research & Benchmarks1 month ago

Gemma-4 31B vs Qwen3.5 27B: Hands-on Local Comparison of Two Top Dense Models

Fahd Mirza pits two of the strongest open-weight dense models against each other in a live local benchmark: Google DeepMind's Gemma 4...

16:57

Gemma-4 26B A4B + vLLM: Best MoE Model of 2026: Running Locally

Tutorials1 month ago

Gemma-4 26B A4B + vLLM: Best MoE Model of 2026: Running Locally

Fahd Mirza puts Google's Gemma-4 26B A4B through its paces locally, starting with a clear explanation of what the model name actually...

13:21

Gemma 4 E2B + Hermes Agent + vLLM: Multimodal AI Stack Locally for Free

Tutorials1 month ago

Gemma 4 E2B + Hermes Agent + vLLM: Multimodal AI Stack Locally for Free

Fahd Mirza demonstrates a full local stack for running Google's Gemma 4 E2B instruction-tuned model through the Hermes agentic framew...

08:33

Qwen3 Speculator Eagle: Red Hat Made Qwen3-8B 6x Faster: Full Hands-on Guide

Coding & Dev Tools2 months ago

Qwen3 Speculator Eagle: Red Hat Made Qwen3-8B 6x Faster: Full Hands-on Guide

Red Hat has quietly entered the AI inference space with a significant technical contribution: a speculative decoding model that makes...

09:20

$Run Dots.mOCR Locally — OCR, LaTeX, SVG From Any Image$

Tutorials2 months ago

Run Dots.mOCR Locally — OCR, LaTeX, SVG From Any Image

dots.m OCR is a 1.7-billion-parameter vision-language model from Red Note — the Chinese lifestyle platform also known as Little Red B...

08:53

NVIDIA NemoClaw + OpenShell: OpenClaw Agent in a Secure Sandbox – Local vLLM Setup

Coding & Dev Tools2 months ago

NVIDIA NemoClaw + OpenShell: OpenClaw Agent in a Secure Sandbox – Local vLLM Setup

At GTC 2026, NVIDIA announced NemoClaw — an official security and sandboxing layer for OpenClaw agents, built in collaboration with O...