How we crawl

User-agent: PriceDiffBot/0.1 (+https://getpricediff.com/bot; contact@getpricediff.com)

PriceDiff reads public pricing pages only. It does not log in, bypass paywalls, solve CAPTCHAs, or evade bot challenges. A challenge is a skip.

Before each fetch we read robots.txt. A disallowed URL is not fetched, and that decision is rechecked weekly. Public pages are limited to one request per domain per day, with a few seconds between requests and a stop after repeated failures.

History comes from the Internet Archive CDX API: about one capture a month, at most 24 per tool, fetched slowly and cached. JavaScript-only archives that contain no prices are marked as history unavailable for that period.

Public pages show plan names, prices, limits, and a short AI note tied to that diff. They do not republish the vendor's page. Normalised text stays in private storage.

Corrections: corrections@getpricediff.com. Crawler contact: contact@getpricediff.com. An opt-out is applied by unpublishing the tool. When the database is connected, a matching domain is removed immediately and in all cases within 48 hours.