Newest sealed read shown here: 2026-09-01. The days we already watched run from 9 June 2026 through 2 September 2026 in the live store, with some days missing.
What one day looks likerobots fetches on 2026-09-01
These three counts are the robots-path answers our named tool stored on 2026-09-01. They are counts of our fetch, not a reading of anyone else's rules file.
| HTTP status | Robots rows that day |
|---|---|
| 200 | 50,270 |
| 403 | 3,917 |
| 404 | 4,091 |
Three redacted sample oathsreal rows · 2026-09-01 · site names withheld
Site names are replaced by site-A, site-B, and site-C. All three rows are real fetches from 2026-09-01. Robots bodies are not reprinted. Tool user-agent token on all three: closing-web-clock/1.0. Method: closing-web-v1.
| oath_date | site_label | resource | status_or_transport | body_sha256 | our_user_agent |
|---|---|---|---|---|---|
| 2026-09-01 | site-A | /robots.txt | 200 | 8fa3036c68bfcbd32365f6225d24333264093b7cd38d306e106b4dbdc934fd5b | closing-web-clock/1.0 |
| 2026-09-01 | site-B | /robots.txt | 403 | none | closing-web-clock/1.0 |
| 2026-09-01 | site-C | /robots.txt | 404 | none | closing-web-clock/1.0 |
What you get in the oath
- One sealed oath for one named dayThat band is unverified. We sell the floor.
- Only our fetch factsThe date, the path we asked for (/robots.txt, /ai.txt, /llms.txt, or /.well-known/tdmrep.json), the HTTP status we received or the transport tag if there was no HTTP status, the SHA-256 hash of the bytes if the answer was 200, the SHA-256 hash of our stored row, and the tool user-agent token we sent: closing-web-clock/1.0.
- Redacted public form, or named-site formNamed-site form only if you already have a case, and we still only swear to our fetch facts.
What this cannot tell you
It does not reprint any site file. It does not quote a robots line. Quoting a robots line is UNKNOWN for sale. We never quote another site's robots text.
It does not say what GPTBot or ClaudeBot was allowed to do. That would need a robots line. We do not swear to what the site intended. We swear to our fetch record.
It is not a statement about a tool we did not send. The named tool on these rows is the one whose user-agent token is closing-web-clock/1.0.
It is not a feed. One oath per named day; each day is its own oath.
A 403 is only that our tool was refused. A 404 is only that this path did not return a file to us that day. Neither is a reading of the site's rules.
This is not a lawyer opinion. We believe swearing to our own fetch needs no site's permission. That is not a legal opinion. We did not get a lawyer to confirm it.
See the file
You do not have to take our word for what is in the file. Here are real fetch-fact rows, carrying the same columns as the sample CSV, cut out of the dated copies we sealed ourselves. Site names are replaced by site-A, site-B, and site-C. Nothing in it is made up and nothing in it is tidied up. Robots bodies are not reprinted.
- Open the sample as a CSVA plain spreadsheet file. It saves to your machine rather than painting itself into a browser tab, and it opens in Excel, Numbers or Google Sheets.
- The same rows as JSONThe same rows again, laid out for reading with code.
Not on sale right now
Not on sale right now. We cannot yet deliver this automatically after payment, so we are not taking payment.
Email a questionNo payment is taken on this page.
More from this feed
- What is and is not in the shopThe list of what we have and what is not on sale.