Hacker News (AI, 50+ points)Article
Websites are closing their doors to AI agents
Websites are getting serious about excluding agents from their data and operations. This isn't just content protection, it's a signal that web scraping for training and agentic workflows are conflating in the public mind, and site owners are choosing to say no to both. For builders: assume you'll need explicit permission to run agents on third-party domains, and build that into your product roadmap now. For investors: infrastructure for licensed data access just became table stakes.