AI Crawlers Don't Render JavaScript — Why 36% of Fintech Vanishes From ChatGPT (2026)

Key Takeaway

• AI crawlers like GPTBot, ClaudeBot, and PerplexityBot do not execute JavaScript. They are not browsers — they grab the first HTML response and leave.
• In one study, 36% of 274 fintech homepages exposed less than 80% of their content without JS, and 47 were completely blank.
• Googlebot renders, but most AI crawlers don't. So a page with a perfectly fine SEO score can still be missing entirely from ChatGPT and Perplexity answers.
• The fix is simple — put your core content in server-rendered or static HTML so it appears in the first response.

To be cited in AI search, a crawler first has to be able to read your content. But the crawlers feeding ChatGPT, Perplexity, and Claude see something different from what you see in a browser. Content painted in by JavaScript may simply not exist to them.

AI Crawlers Are Not Browsers

A browser receives HTML, then runs JavaScript to fill in the content. That's why single-page apps (SPAs) and client-rendered sites look fine to you. But the default behavior of an AI crawler is different.

"Most AI crawlers do not render JavaScript. They make HTTP fetches and walk away. They are not browsers." — Search Engine Journal

GPTBot, ClaudeBot, and PerplexityBot all read only the HTML in the first HTTP response. They may download JavaScript files, but they never run them, never wait for rendering, and never retry. Rendering every page in a browser at crawl scale would be enormously expensive, so the production default is a short timeout of one to five seconds and "take what's there."

The exception is Googlebot. Google runs a separate deferred rendering pipeline, and Gemini, which shares that infrastructure, can execute JavaScript too. In other words, the crawlers that render are essentially Google's — every other AI answer engine sees the pre-render HTML.

The Data: 36% of Fintech Vanishes Without JS

This gap is not an abstract worry — it's measured. One study tested 274 homepages from CNBC's global fintech list twice each: once with a full browser render (Playwright), once with a raw HTTP fetch and no JavaScript.

Of 274 fintech homepages, 36% returned less than 80% of their content without JavaScript. Of those, 20% (55 sites) returned under 30%, and 47 were completely blank. — Search Engine Journal

That's roughly one in three sites where most of the core content is invisible to an AI crawler. For 47 of them, only a title and an empty container remained — the body was gone entirely. A page that looks perfectly fine to a human was a blank sheet to the AI.

Why This Is More Dangerous Than an SEO Score

Traditional SEO masked this problem, because Googlebot renders for you. It's easy to shrug it off — "we rank fine on Google, so we're fine."

The catch is that AI answers are no longer distributed across just Google. ChatGPT, Perplexity, and Claude each use data collected by their own crawlers, and those crawlers don't render. The result:

• Visible in Google Search — Googlebot rendered and read the body
• Missing from ChatGPT and Perplexity — the AI crawler saw only empty pre-render HTML

This is a classic point where SEO rank and AI visibility diverge. It's a blind spot you can't see from search rankings alone, so it goes unnoticed unless you measure for it.

How to Self-Diagnose Your Pages

You can check in 30 seconds without writing any code.

1. View source. Right-click → "View Page Source." What you see here is the pre-render HTML — the same thing an AI crawler sees. If your body text isn't here, that's a red flag.
2. Disable JavaScript and reload. Turn off JS in your browser settings and reopen the page. If only the title remains and the body, pricing, and FAQ disappear, AI crawlers see the same thing.
3. Check whether the body is in the first response. See whether your core content is in the first HTML response or only filled in after an API call. If it's the latter, it's invisible to non-rendering crawlers.

Five Ways to Expose Content to AI

Item	What to do
Server rendering	Put core content in server-rendered (SSR) or static HTML (SSG) so it appears in the first response
First HTML first	Don't defer high-value text — title, body, pricing, FAQ — behind client-side rendering
Keep it as text	Don't trap key information inside images or canvas only — expose it as text
Real <a href> links	Make primary navigation real <a href="..."> links, not JavaScript events
Supporting layer	Treat llms.txt and structured data as add-ons that assume the body is already exposed

Order is everything. No matter how carefully you add llms.txt or FAQ schema, if the body itself isn't in the first HTML, the AI crawler receives a blank page. Pre-render exposure is the precondition for all AEO and GEO work.

Verify the Change by Measuring

Once you've moved to server rendering, confirm that AI crawlers actually read and cite the content. Use Site Check to verify that your core body is exposed without JavaScript so crawlers can read it, and AI Brand Visibility Analysis to measure whether ChatGPT, Perplexity, and Gemini cite your page for the same questions. Together they show, as a trend, whether rendering fixes translate into actual exposure.

FAQ

Further Reading

• Google AI Mode Optimization — 7 Signals That Matter More Than llms.txt — indexability, rendering, and crawling for Google AI Search readiness
• AI Crawler Policies Explained — access control for GPTBot, ClaudeBot, and PerplexityBot
• The End of the Ultimate Guide — Making Content Extractable — once crawlers read it, the paragraph structure that gets cited
• How to Become a Brand Recommended in Generative AI Answers — the three conditions for citable structure