Skip to content
SUVDekho

For site operators

SUVDekhoBot

If you found this page in your server logs, this is what we are and how to control us.

How we identify

User-Agent: SUVDekhoBot/0.1 (+https://suvdekho.com/bot)
From: https://suvdekho.com/bot

What we fetch, and what we do not

  • We fetch published specification and price pages, brochure PDFs, and government open data — only from domains on an explicit allow-list. The default is deny, so if we have not deliberately added your site, we are not requesting anything from it.
  • We extract facts: numbers, measurements, prices. We do not copy photographs, editorial prose, or the selection and arrangement of your pages.
  • We never authenticate, never bypass an anti-bot measure, and never request login-walled content.
  • We never collect personal data — no user reviews with names, no staff contact details, no seller phone numbers.
  • We cache raw responses by content hash, so re-processing our own data costs you no additional requests.

Rate limits

We default to a small number of requests per minute per domain with a politeness delay between them, enforced from a shared token bucket so that adding capacity on our side cannot increase the request rate on yours. If you publish a Crawl-delay, it overrides our default.

Blocking us

User-agent: SUVDekhoBot
Disallow: /

We honour robots.txt. Where an operator publishes API terms that govern a documented API endpoint, we treat those terms as governing instead — and every such exception is recorded internally with a reason, a URL, a named reviewer and a date, and counted separately in our own audit log. There are very few of them.

Contact

If we are causing you a problem, or you want us to stop using something, we would rather hear from you than be blocked. Use the takedown and removal form, which routes to a human with a published response target.