Tag: crawling

  • The Cloudflare Blog: An AI Index for all our customers

    Source URL: https://blog.cloudflare.com/an-ai-index-for-all-our-customers/ Source: The Cloudflare Blog Title: An AI Index for all our customers Feedly Summary: Cloudflare will soon automatically create an AI-optimized search index for your domain, and expose a set of ready-to-use standard APIs and tools including an MCP server, LLMs.txt, and a search API. AI Summary and Description: Yes **Summary:** The…

  • Anchore: Grant’s Release 0.3.0: Smarter Policies, Faster Scans, and Simpler Compliance

    Source URL: https://anchore.com/blog/grants-release-0-3-0-smarter-policies-faster-scans-and-simpler-compliance/ Source: Anchore Title: Grant’s Release 0.3.0: Smarter Policies, Faster Scans, and Simpler Compliance Feedly Summary: Every modern application is built on a foundation of open source dependencies. Dozens, hundreds, sometimes thousands of packages can make up a unit of software being shipped to production. Each of these packages carries its own license…

  • Simon Willison’s Weblog: Cloudflare Radar: AI Insights

    Source URL: https://simonwillison.net/2025/Sep/1/cloudflare-radar-ai-insights/ Source: Simon Willison’s Weblog Title: Cloudflare Radar: AI Insights Feedly Summary: Cloudflare Radar: AI Insights Cloudflare launched this dashboard back in February, incorporating traffic analysis from Cloudflare’s network along with insights from their popular 1.1.1.1 DNS service. I found this chart particularly interesting, showing which documented AI crawlers are most active collecting…