top of page
Wissenswertes
Suche


Grimm: Agentic Crawling made easy - Cloudflare Crawl API, Chrome Dev Tools MCP & Firehose/Ahrefs
Key Takeaways: Grimm on next level crawling possibilities for Agents: Cloudflare /crawl REST API offers crawling based on Cloudflare infrastructure: "𝗖𝗹𝗼𝘂𝗱𝗳𝗹𝗮𝗿𝗲 𝗷𝘂𝘀𝘁 𝗰𝗼𝗺𝗺𝗼𝗱𝗶𝘁𝗶𝘇𝗲𝗱 𝘄𝗲𝗯 𝗰𝗿𝗮𝘄𝗹𝗶𝗻𝗴" REST API with POST request to initiate crawl and GET to retrieve results Sitemap or Spider crawl mode Javascript rendering in headless browser Result as HTML, markdown or JSON with using a prompt against the crawled pages incremental crawling (only
16. März2 Min. Lesezeit


Michalik (Claneo): Experiment shows Answer Engines can be gamed too easily
Key Takeaways: Michalik created 3 listicles for a made up matcha tea that got listed in most major AI chats Claude and AIO cited the fake Matcha quite frequently ChatGPT and AI Mode also cited the fake product from time to time Gemini did the best job in not mentioning the fake product Now all chats caught up, still, way to easy to game in the short run A while ago Fishkin reported that only in <1% of the runs of the same prompt the KI chat returns the same list of recommen
19. Feb.2 Min. Lesezeit


Landwehr & Ray: OpenAI & Grok use Google Search, Claude & Perplexity use Brave
Key Takeaways: Landwehr analyzed AI Search responses for pnewind(.)com - a former wind energy company website that has been misused by Casino Affiliates using Google cloaking and access blocking His findings suggest: OpenAI is scraping Google Grok is somehow using Google Claude is using Brave Search Perplexity might use Brave Search (but states that it uses its own index) Konitzny points out that Grok is using Brave for image search - based on the code run in Chrome. Ray con
10. Feb.1 Min. Lesezeit


Segonzac: How AI Search Agents see the Web
Key Takeaways: Segonzac analyzed the behavior of AI Search Agents on how they view websites The Good - Static HTML is visible to everyone (your safest bet) - <noscript> fallbacks work for ChatGPT, Claude & Gemini The Surprising - Only 3 crawlers execute JavaScript : Bing Copilot, Grok & DeepSeek - Bing Copilot is the ONLY one that can read iframes and Shadow DOM - Some crawlers identify themselves honestly (ChatGPT, Claude, Gemini), others operate in full stealth mode (
6. Feb.1 Min. Lesezeit


Konitzny: AI Brand Drift - Markenschäden durch ungenaue oder fehlerhafte KI Antworten
Key Takeaways: Da KI Assistenten vielerlei Quellen aggregieren, kann es zu ungenauen teils fehlerhaften Antworten bzgl. Produkten oder...
10. Sept. 20251 Min. Lesezeit


Wargnier: Anthropic drops Claude for Chrome
Key Takeaways : Anthropic about to release Claude Chrome Extension to interact with websites directly in the browser first test batch of...
30. Aug. 20251 Min. Lesezeit
bottom of page