A few months ago, I built an AI agent to automate one of the most repetitive parts of my workflow: research and content preparation.
In a controlled environment, everything worked exactly as expected. The agent could research topics, gather sources, extract insights, generate outlines, and feed the results into my writing pipeline with minimal supervision.
The problems started when I connected that workflow to real websites.
One site returned a Cloudflare challenge instead of content. Another triggered a CAPTCHA before the agent could load the page. A third served incomplete data because the browser had been flagged as automation.
Within minutes, a workflow that looked production-ready became unreliable.






