Segonzac: How AI Search Agents see the Web

Aktualisiert: 6. März

Key Takeaways:
Segonzac analyzed the behavior of AI Search Agents on how they view websites
The Good
- Static HTML is visible to everyone (your safest bet)
- <noscript> fallbacks work for ChatGPT, Claude & Gemini
The Surprising
- Only 3 crawlers execute JavaScript: Bing Copilot, Grok & DeepSeek
- Bing Copilot is the ONLY one that can read iframes and Shadow DOM
- Some crawlers identify themselves honestly (ChatGPT, Claude, Gemini), others operate in full stealth mode (Bing, Grok)
The Broken
- Perplexity can't decode compressed responses (empty Accept-Encoding headers)
- Google AI Mode doesn't fetch URLs at all, it only uses Google's existing index
- Content loading after 2 seconds? Invisible to everyone
GEO Takeaways:
Put critical content in static HTML
Use <noscript> fallbacks for JS-dependent content
Avoid Shadow DOM for important information
Get indexed by Google
Disable compression for Perplexity-User




Sources:

![ICYMI Metehan: Statistics & Fact Checking in AI Chats and beyond the Web [Experiment]](https://static.wixstatic.com/media/24c590_b0a8e1392c1c47f28a0a46a67d59df71~mv2.jpg/v1/fill/w_980,h_653,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/24c590_b0a8e1392c1c47f28a0a46a67d59df71~mv2.jpg)
