Our web crawler

What it is

PaperHorseBot is an automated crawler operated by PaperHorse LLC. When a customer asks us to analyze their business or a competitor's, PaperHorseBot fetches a small number of publicly available pages from the relevant website (typically the homepage and a handful of linked pages) to help build a business profile. It does not crawl a site on a recurring schedule, browse beyond what a specific customer request needs, or republish page content.

How it behaves

• Respects robots.txt.
• Fetches a small, bounded number of pages per request, not a full-site crawl.
• Does not attempt to bypass access controls, paywalls, or bot-detection challenges.

Who operates it

PaperHorse LLC, a Utah limited liability company. PaperHorse helps businesses understand and improve how they appear in AI-generated search answers.

Questions, or want us to stay away from your site?

Email support@paperhorse.ai. Include the domain in question and we'll follow up.