TL;DR: I built Harvest — an open-source web scraper that bypasses Cloudflare, extracts data via LLM...
I spent the last month building something I couldn't find: a web scraper that doesn't
break every time a website updates its HTML.
Three weeks ago I open-sourced it. It's called Harvest,
it's MIT-licensed, and this is the honest tour — what it does, why it exists, and
the three lessons that cost me the most time.
I spent three weeks building a web scraper for a side project that aggregated job listings from...
A while back I kept hitting the same wall. I wanted some specific slice of public data, a list of...
I’ve been building web scrapers for years. BeautifulSoup, Selenium, Playwright — I thought I’d seen...
I've been building web scrapers for years. BeautifulSoup, Scrapy, Selenium — I've used them all. But...
I've wasted days of my life maintaining CSS selectors. You know the drill - you write the perfect...
I spent six months building my own SERP scraper. It was a disaster. The short version: Month one:...
