PubMonitorBot

What it does

PubMonitorBot fetches a small number of public pages from a site when someone runs our AdSense Approval Checker against it. The check reads what a Google reviewer would read and reports whether the site meets Google's published AdSense requirements. Nothing is fetched on a schedule — a request only happens because a person asked for that specific site to be checked.

What it requests

Per check, at most 14 requests to a single site, all plain GET:

• the homepage
• /robots.txt, /ads.txt and /sitemap.xml
• your privacy policy, about, contact and terms pages, if they are linked
• up to five content pages, chosen from your sitemap

Each request has an 8-second timeout, and a whole check is capped at 25 seconds wall-clock. That is less load than one person browsing your site for a minute. We never submit forms, never follow links beyond that set, and never request the same site twice within 15 minutes.

What it does not do

• No scheduled or repeated crawling. One check, one visit.
• No attempt to reach anything behind a login.
• No copies of your content are stored. Page text is used to produce the report and discarded; reports themselves expire after 15 minutes.
• No probing for admin paths, backups, or vulnerabilities.

Blocking it

Add this to your robots.txt:

User-agent: PubMonitorBot
Disallow: /

We will honour it. Note what that means in practice: AdSense Approval Checker exists to tell site owners whether Google's crawlers can read their site, so blocking us means nobody — including you — can run the check against your domain.

Getting in touch

If our crawler caused a problem, or you want a domain excluded at our end rather than through robots.txt, write to support@pubmonitor.com with the domain and a log excerpt. We will confirm within two business days.