16:30
SWE-rebench: Lessons from Evaluating Coding Agents — Ibragim Badertdinov, Nebius
Ibragim Badertdinov, an AI researcher at Nebius with an unconventional background—a trained dentist turned NeurIPS and ICML author—pr...
Sort by: Newest Items
There are 53 items in this page
23:25
The Art & Science of Benchmarking Agents — Vincent Chen, Snorkel AI
Vincent Chen, research fellow and co-founder at Snorkel AI, took the stage at AI Engineer to share meta-level lessons on what separat...
15:12
Can LLMs generate Enterprise Quality Code? — Prasenjit Sarkar, Sonar
Prasenjit Sarkar from Sonar presents an enterprise-focused LLM code quality evaluation that goes substantially beyond standard SWE-be...
25:27
The Annual AI Slowdown Panic Is Here
The AI Daily Brief examines a new coding benchmark called DeepSWE from a company called Data Curve, which is drawing wide attention f...
20:03
Agentic Evaluations at Scale, For Everybody — Nicholas Kang & Michael Aaron, Google DeepMind
Nicholas Kang, product manager for Kaggle Benchmarks at Google DeepMind, and Michael Aaron, a Kaggle software engineer, present the c...
39:16
Evals for taste: Hill-climbing a slide-generation agent
In this workshop from Anthropic's Claude channel, an Anthropic engineer walks through the complete process of designing, building, an...
17:23
AI Dev 26 x SF | Andrew Filev: Multi Model Pipelines—How to Get Better AI Results for Less
Andrew Filev, CEO of Zenoder, presents findings from his company's in-house applied research lab at AI Dev SF 2026, sharing the resul...
24:37
AI Dev 26 x SF | Ara Khan: Evals Are Broken Use Them Anyway
Ara Khan, speaking at the AI Dev 26 x SF event hosted by DeepLearningAI, argues that most developers are fundamentally wrong about AI...
31:40
Picking the right model
Lucas from Anthropicʼs applied AI team delivers a practical framework for selecting the right Claude model in production — addressing...
30:23
AI Dev 26 x SF | Erik Thorelli: Deploying AI Code Review at Scale
Erik Thorelli from CodeRabbit presents a detailed, practitioner-level breakdown of what it actually takes to deploy AI-driven code re...