Glossary / SEO, GEO & AEO

Crawler (search bot)

A crawler is an automated program that visits pages, follows links, and feeds what it finds into a search or answer engine's index. Crawlers read your HTML as delivered — many don't execute JavaScript well — which is why sites that render content only in the browser struggle to rank. Prerendered pages hand crawlers finished HTML, which is exactly how this site serves them.