idlidu — Bot / crawler contact
==============================
Version: 2026.09.15-counsel-approved
Date: 15 September 2026
Status: COUNSEL-APPROVED FOR PUBLISH — effective 15 September 2026.
Related: AUP §5 · Privacy · per-track SOURCES / methodology

1. Who we are

idlidu (Operator: Saptarang Ventures (OPC) Private Limited) operates modest,
allowlist-oriented fetchers to build point-in-time archives and observation
panels for Dataset products described on www.idlidu.com.

2. User-Agent

Primary:
  idlidu-bot/1.0 (+https://www.idlidu.com/bot)

Dataset-specific bots may add a product token (documented on that Dataset’s
methodology or bot notes). Prefer the URL in the UA for humans.

3. Purpose

- Archive allowlisted public surfaces (HTML, robots.txt, llms.txt, registry
  metadata, public API responses, etc.) for Dataset products.
- Produce hashes, timestamps, extracts, and indices Agents can cite.
Dataset APIs themselves require API Keys except documented public samples.

4. Cadence and rules

- Modest cadence; concurrency capped per track.
- robots.txt respected by default.
- No login, no password guessing, no paywall or CAPTCHA bypass.
- Prefer explicit allowlists; live fetch gated by each track’s SOURCES / ToS
  survey. Fixture / soft-launch modes may run with no live fetch.
- We do not use these bots to provide a general-purpose scraping API to
  customers for arbitrary URLs.

5. What site owners can do

- robots.txt Disallow for our UA if you wish us not to fetch.
- Email opt-out / rate concerns: research@idlidu.com (founders; not a support
  desk — multi-day replies).
- Include clear public ToS if you forbid archiving; we use SOURCES gates.

6. Data

Fetched bytes may be stored in Cloudflare R2 / D1 as product archives with
content hashes and timestamps. See Privacy Policy and RETENTION.md.
We do not intentionally target private personal dashboards.

7. Security researchers

If you believe our bots are misbehaving (runaway fetch, wrong host), contact
research@idlidu.com with logs / timestamps / URLs. We will investigate.

8. Related documents

Acceptable Use: https://www.idlidu.com/legal/aup/
Privacy: https://www.idlidu.com/legal/privacy/
Terms: https://www.idlidu.com/legal/terms/

9. Contact

research@idlidu.com
Saptarang Ventures (OPC) Private Limited
CIN U43900MH2023OPC413456
Nashik, Maharashtra, India
https://www.idlidu.com/bot/