Summary
Can a paid scraping service costing $249 a month be replaced with a home-built alternative? Creator Magic sets out to do exactly that, building a web scraper called Drone with Claude Code and testing it against a list of 100 AI tools.
The video is inspired by indie hacker Pieter Levels, who built his own scraper for Hotelist after being told by AI that it could not be done, reaching about 90% success at roughly $1 a month. The comparison point is ScrapingBee’s business plan, where a single page with a premium proxy and JavaScript rendering costs 25 credits, or about $2 per 1,000 pages.
The build runs step by step from an AGENTS.md plan: a dashboard, then a fetch engine deployed to a VPS in Germany. The first test from a datacenter IP shows many red failures, including blocks from robots.txt. The fix is to add DataImpulse residential proxies, priced from about $1 per gigabyte, which lets one server view sites as seen from the US, UK, Germany, India, Brazil and Japan. The scraper respects robots.txt, fetches one page at a time per site, and sticks to public pages with no logins or CAPTCHA solving.
📺 Source: Creator Magic · Published September 30, 2026
🏷️ Format: Hands On Build
