Do Orchids Sites Block AI Crawlers? 1 of 9 Do

Orchid sites publish their policies and then open the gates. We read robots.txt files for 9 of the 10 Orchids sites we checked, and only one of those nine turns an AI crawler away. The block rate lands at 11.1% — near the bottom of every category in this snapshot.

What makes Orchids interesting is how complete its coverage is. A robots.txt is the plain-text file at a site's root that tells automated visitors which paths they may fetch, and an AI crawler is the bot that pulls pages to feed a model. Nine of ten orchid sites bothered to publish such a file — and despite that diligence, almost all of them chose to allow every crawler. The diligence is real; the blocking is not.

This report is a single sealed reading rather than a trend line. We fetched each site's public robots.txt once, on one day, and counted only the rules the files literally contain — which AI user-agents each one names in a disallow directive, and which it leaves out. There is no projection and no month-over-month comparison, because the snapshot captures a single point in time.

So when the report says nine orchid sites publish a policy and only one of them blocks a crawler, those are verbatim counts. The interpretation that follows — why a diligent category stays open — is built entirely on those sealed numbers.

1 of 9 Orchids sites block at least one AI crawler.

What This Block Rate Actually Means

Of the 10 Orchids sites we checked, 9 returned a parseable robots.txt — unusually high coverage for a hobby category. Within that group, exactly one site, orchidboard.com, carries a disallow rule aimed at an AI user-agent. The blocker being the community message board is the same pattern that recurs across enthusiast verticals: the forum, full of years of member-written grower threads, is the surface most worth gating.

The eight allowers are nurseries, suppliers, and the hobby's flagship society. aos.org, orchidweb.com, repotme.com, sunsetvalleyorchids.com, andysorchids.com, carterandholmes.com, akatsukaorchid.com, and brooksideorchids.com each returned a robots.txt that names no AI crawler in a disallow rule. For a nursery that sells plants and a society that publishes care guides, being readable by answer engines is reach, not risk.

That commercial logic is worth making explicit, because it is what drives the whole category's posture. A nursery wants its catalog and care pages quoted wherever a grower asks a model how to repot a phalaenopsis or where to buy a specific species — every such mention is a path back to a sale. The society's incentive runs the same direction: wider reach for its cultivation knowledge serves its mission. Only the forum, where the value is the conversation itself rather than a product, has a reason to gate, and it is the lone site that does.

Orchids sits far below the corpus average, and its near-complete coverage makes the open posture a deliberate one rather than an accident of missing files. For the wider frame, the single-blocker pattern in the soapmaking slice mirrors this almost exactly, while a more commercial enthusiast vertical gates harder.

Of the nine Orchids sites with a published policy, only the community board blocks any AI crawler.

Who Gates the Crawlers Here

The breakdown is one blocker, eight allowers, and a single site with no parseable file — a clean, fully-readable category.

The one site that returned no parseable robots.txt — orchidsupplies.com — expresses no preference at all. Under the standard a missing file means crawlers default to allowed, so it reads open, but that is an absence rather than a decision, and it is the site most likely to move if the category ever tightens.

The makeup of the allower list deserves a closer look, because it explains why a diligent category stays open. aos.org is the American Orchid Society's hub, built to spread cultivation knowledge as widely as possible — gating an answer engine would work against its mission. The nurseries, from andysorchids.com to brooksideorchids.com, are storefronts whose pages describe plants for sale; being summarized by a model is a path to a sale, not a theft of proprietary method.

Only the community board, where growers trade hard-won troubleshooting, holds text that feels worth protecting. So the single block is not an outlier so much as the one site whose content economics differ from the rest.

That near-complete coverage is what separates Orchids from a thinner category. When nine of ten sites publish a file and still allow everything, the open posture is a choice the category has actively made, file by file — not a default inherited from missing configuration. It is the difference between a category that decided to stay open and one that simply never decided.

Orchids sites post an 11.1% AI-crawler block rate.

Where Orchids Sits Among Similar Hobbies

To place 11.1% in context, here is Orchids alongside its nearest neighbors in the ranking — the verticals filing right around the same low line, with a couple just above and below.

Reading the window vertically is revealing. Just above Orchids sit Crypto, Cannabis, and Camping at a slightly higher rate, and just below it Productivity and the cluster of single-digit-blocking categories. The whole band is the lightly-policed lower third of the snapshot, where one site of eight or nine carrying a disallow rule is the norm rather than the exception. Orchids fits that band cleanly, which is why its position reads as stable rather than coincidental — a category-level pattern, not a quirk of one nursery's configuration.

That stability matters for interpretation. Because nine of ten orchid sites published a readable file, the 11.1% rate rests on a relatively firm base for a hobby category. A single site flipping would move it, but the open posture is broad enough across nurseries and the society that one change would not rewrite the category's character.

Orchids ties its block rate with Religion, Cybersecurity, Fishkeeping, and Leathercraft — all categories where exactly one site of nine readable gates a crawler. A craft with a busier performer community such as the magic-shop slice we measured blocks at a far higher rate, which underscores how quiet the orchid corner is. The extremes bracket the whole snapshot.

The Operator-Level Picture Across the Corpus

Even though Orchids gates almost nothing, the corpus-wide operator leaderboard shows which model owners get disallowed most when sites do act — counted across all 993 sites.

Common Crawl leads because its archive feeds many downstream models, so disallowing it is the broadest single move a site can make. That ranking is corpus-wide; within Orchids the only block belongs to one community board, not a category trend.

Reading the operator list against the Orchids result sharpens the contrast. Anthropic, OpenAI, Meta, and ByteDance each appear on hundreds of sites' disallow lists across the corpus, which means a large minority of the web has made an explicit decision about those model owners. The orchid nurseries and the society have not — their files name none of these operators. The same near-silence shows up in the permissive candlemaking slice, another supply-and-craft category that publishes policies yet declines to gate. The pattern is consistent: where the content is a storefront or a mission to inform, the crawlers stay welcome.

Corpus-wide, 285 of 993 sites block at least one AI crawler — Orchids sits far below that line.

Key Takeaways

• Of 10 Orchids sites checked, 9 returned a parseable robots.txt, and only orchidboard.com blocks any AI crawler.

• The 11.1% block rate places Orchids near the floor of the ranking, tied with Religion, Cybersecurity, and Leathercraft.

• Eight nurseries, suppliers, and the flagship society publish open policies; one site returned nothing parseable.

• Corpus-wide, 285 of 993 sites — 28.7% — block at least one AI crawler, far above this category.

Corpus-wide, 285 of 993 sites block at least one AI crawler.

Frequently Asked Questions

Q: Why is orchidboard.com the only Orchids site that blocks a crawler?

A: It is the category's community message board, and forums host years of member-written grower threads — the accumulated, searchable corpus most worth gating. The nurseries and the society, like aos.org and andysorchids.com, generally want open indexing for the reach it brings, so they allow every crawler.

Q: How does Orchids have nine readable sites when most hobbies have fewer?

A: Nine of the ten Orchids sites we checked published a parseable robots.txt, unusually high coverage. Only orchidsupplies.com returned nothing parseable. That near-complete coverage means the open posture is a deliberate choice across the category, not an artifact of missing files.

Q: Is an 11.1% block rate unusual for this snapshot?

A: It is among the lowest. The corpus-wide rate is 28.7%, so Orchids sits well below it, tied with Religion, Cybersecurity, Fishkeeping, and Leathercraft. Enthusiast and supply categories cluster at this end of the ranking, where one blocker of nine is typical.

Q: Could the open orchid sites start blocking later?

A: Yes. Any of the eight allowers could add a disallow rule, and orchidsupplies.com could publish a file for the first time. The value of monitoring is catching that first edit. These figures are verbatim counts from sealed public robots.txt files; nothing is estimated, modeled, or extrapolated.

Put AI-Access Data to Work

The buyer this slice fits first is a horizontal one: a competitive-intelligence analyst watching AI-access drift across many categories. For that analyst, the recurring job is to re-crawl an Orchids watchlist that includes orchidboard.com and aos.org weekly and alert the moment one of the eight currently-open sites — say repotme.com or andysorchids.com — adds a ClaudeBot or GPTBot token to its disallow list, because in an 11.1% category each new block reshapes which pages an answer engine can quote. An AI-search agency can run the same cadence across a client corpus to protect eligibility.

The category-native second ICP is an orchid-nursery ecommerce manager who sells plants and growing media online and depends on the society and the boards for top-of-funnel referral traffic. That role can monitor whether those reference surfaces stay crawlable, since their visibility in AI answers shapes demand. US Tech Automations automates this with scheduled robots.txt crawls, change alerts, and an AI-access dashboard. See how the platform runs that watch on our agentic workflows.

Source: US Tech Automations Research — Closing Web edition; figures are verbatim counts from public robots.txt files sealed June 14, 2026 (snapshot sha 5d5458529dab2773).