Research & Data

Do Med-Spa Sites Block AI Crawlers? Zero of 10 Do

Jun 21, 2026

A consumer considering a Botox consultation or a laser treatment series rarely walks in cold — they research online, read reviews, compare providers, and increasingly ask an AI assistant which device brands have the best clinical track record or which treatment is FDA-cleared for a given indication. The aesthetic-device manufacturers, professional associations, and platform brands that populate the med-spa category are primarily marketing channels. Their websites exist to generate awareness, training enrollment, and provider demand, not to guard a proprietary data asset. That commercial posture is reflected exactly in their robots.txt files.

Zero of 10 Med-Spa sites with a parseable robots.txt block any AI crawler.

Of the 12 med-spa and aesthetics domains we checked, 10 returned a parseable robots.txt — the root-level file that tells an automated agent which paths it may fetch — and not one of them disallows a named AI crawler. That is a 0% block rate. Every figure here is read straight from the sealed snapshot; nothing is estimated, modeled, or extrapolated.

There is no holdout to single out. Against the corpus, where 318 of 1247 sites with a policy gate at least one crawler for a 25.5% rate, med-spa sits at the floor — among the categories that block nothing at all.

What an Open Policy Means for Med-Spa

A robots.txt directive is a public request, and the med-spa read is "request granted" across the board. The honest interpretation is that aesthetic-device manufacturers and their associated platforms behave like B2B marketers, not content publishers. The asset an Allergan or a Cutera protects is intellectual property in the form of device patents and clinical protocols — not the marketing content on its website, which is there specifically to be read, cited, and shared.

That logic is the opposite of a category like the news sites, where editorial content is the revenue-generating product and walling off AI training is a business decision. A med-spa device manufacturer's treatment-education pages, provider-finder tools, and clinical evidence summaries are demand-generation assets — walling them off from an answer engine would hide the very content that routes a provider to a training program or a consumer to a consultation booking.

Every policied med-spa site in the set allows every named AI crawler.

A zero-block category is a cleaner signal than a one-blocker category ever is. When a single site gates, the number hinges on one decision that could flip next quarter. When no site gates, the posture is a shared norm — and in med-spa that norm is uniform openness.

The Ten Med-Spa Sites With a Public Policy

The 10 domains with a readable file span the sector: americanmedspa.org, coolsculpting.com, hydrafacial.com, ultherapy.com, cutera.com, solta.com, skinclinical.com, revanceaesthetics.com, sciton.com, and lumenis.com. A professional trade association, a fat-reduction platform, a hydradermabrasion brand, an ultrasound-lifting brand, and a half-dozen aesthetic laser and device companies — and every one allows GPTBot, ClaudeBot, CCBot, Bytespider, and the rest of the named agents to read its pages.

That uniformity spans the full stack of the industry — from the professional association that sets training standards to the device manufacturers whose sales depend on provider adoption. Every layer has concluded that being findable by AI is a business asset.

Two domains — americanspamagazine.com and allergan.com — returned no parseable robots.txt at the seal. They are therefore silent: neither an allow nor a block, and excluded from the rate entirely. That is why the denominator is 10 rather than the 12 sites we checked.

Where Med-Spa Lands Against Other Categories

A 0% block rate places med-spa at the zero-block floor of the ranking — wide open, with company. The focused window below shows selected categories near the floor beside med-spa, verbatim from the sealed snapshot.

CategorySitesWith robots.txtBlock at least 1 crawlerBlock rate
Veterinary12800%
Staffing121100%
Construction10600%

Med-spa shares its zero with veterinary, staffing, and construction — service and B2B verticals whose websites function as discovery channels, not proprietary content libraries. The contrast with the high-block end of the ranking shows the divide.

CategorySitesWith robots.txtBlock at least 1 crawlerBlock rate
Gaming109888.9%
News20171482.4%
Healthcare109666.7%

Med-spa posts a 0% AI-crawler block rate.

The juxtaposition with Healthcare is instructive. The broader Healthcare category — large health systems, medical-information publishers, and clinical organizations — blocks at 66.7%. Med-spa, a category where the content is commercial marketing rather than clinical guidance under editorial or legal protection, blocks at 0%. The content type, not the clinical adjacency, determines the posture.

Which Crawlers the Rest of the Web Blocks First

No med-spa site gates a single bot, so the useful context here is corpus-wide: which agents get disallowed most broadly when a site does decide to close. The cut below shows the most-disallowed bots across all 1247 sites with a robots.txt, bot name first, count next.

BotSites disallowing (of 1247)Rate
CCBot23418.8%
GPTBot21116.9%
ClaudeBot20716.6%
Bytespider20316.3%
Meta-ExternalAgent17814.3%

CCBot, Common Crawl's agent, tops the corpus blocklist at 234 sites, with GPTBot and ClaudeBot just behind. Med-spa names none of these — every token the broader web gates first is allowed across the category. The bots that other industries shut out are precisely the bots the med-spa sites leave in.

Corpus-wide, 318 of 1247 sites block at least one AI crawler.

Corpus-wide, 343 of 1247 sites publish an llms.txt file.

Among the policied med-spa sites, hydrafacial.com, skinclinical.com, and lumenis.com publish llms.txt — the newer file that hands an AI agent a curated map of what to read. Those organizations are not just passively open; they are actively steering AI retrieval toward the content they want agents to find.

How We Sealed the Med-Spa Snapshot

These figures come from one point-in-time crawl of public robots.txt files, sealed June 21, 2026 under snapshot sha 1900f057e385d393. For each med-spa domain we fetched robots.txt at the root, parsed its user-agent and disallow directives, and recorded whether any AI crawler token was disallowed. We report verbatim counts; nothing is estimated, modeled, or extrapolated. The crawl spanned 1542 sites across 154 categories, of which 1247 returned a parseable file.

The counting rule is deliberately narrow. A block is an explicit Disallow aimed at a named AI agent — GPTBot, ClaudeBot, CCBot, and the other leaderboard tokens. A med-spa site can disallow e-commerce checkouts, client portals, or protected clinical-trial pages without naming an AI agent, and that does not count as an AI block here. Only a directive that names one would move a site into the blocker column, which is why the med-spa count is a clean zero: none of the 10 policied files names an AI agent in a disallow group.

Each domain is read once, at seal time, exactly as it answered. That single-read rule is what makes the result content-addressable: anyone holding sha 1900f057e385d393 can re-derive the same 10 policied files and the same zero blockers.

Frequently Asked Questions

Q: Which med-spa site blocks AI crawlers?

A: None of them. All 10 med-spa and aesthetics sites with a parseable robots.txt — americanmedspa.org, coolsculpting.com, hydrafacial.com, ultherapy.com, cutera.com, solta.com, skinclinical.com, revanceaesthetics.com, sciton.com, and lumenis.com — allow every named AI crawler.

Q: Why do med-spa and aesthetic-device brands leave AI crawlers in?

A: Discovery and demand generation. A provider researching laser platforms, a consumer comparing body-contouring options, a practice manager evaluating a new treatment — all of those research paths increasingly run through AI assistants. Being readable keeps the brand's content in front of those queries, which extends the marketing funnel. Blocking would hide the very pages that convert awareness into a training enrollment or a consultation booking.

Q: Does the 0% rate cover all the med-spa sites you checked?

A: No. It covers the 10 sites that returned a parseable robots.txt. Two more — americanspamagazine.com and allergan.com — produced no parseable file at the seal, so they are excluded from the rate rather than counted as an allow or a block.

Q: Does a Disallow in robots.txt actually stop an AI crawler?

A: Not by force. robots.txt is an honor-system standard: a cooperative crawler reads it and complies, but the file enforces nothing technically. Since no med-spa site publishes a disallow against an AI agent, the question is moot here — every policied med-spa site signals that AI agents are welcome to read its paths.

Put AI-Access Data to Work

For a med-spa group's marketing or digital lead — the person who owns how the organization appears in consumer and provider search — this snapshot is a baseline worth watching. The category gates nothing today, which means an answer engine fielding a question about a specific treatment modality, device brand, or provider certification can reach your pages.

But a zero is only true at seal time: a new CMS default, a legal-compliance update, or a vendor security policy can quietly add a disallow that walls off the very answer engines prospective patients or providers now ask. Knowing the week that happens is worth more than discovering it at the next annual site audit. US Tech Automations runs exactly that kind of scheduled robots.txt crawl with change alerts and agentic monitoring, so a policy shift surfaces the week it lands rather than at the next review.

A second fit is an AI-search or GEO analyst tracking which aesthetics and wellness categories stay eligible to surface in answer engines. US Tech Automations monitors that drift across a watchlist of competitor and partner domains and routes the alert when a site flips.

See how the agentic monitoring works, and you have a standing read on med-spa AI-access posture instead of a one-time count — the same way a watcher tracks adjacent categories like the dental sites that post an 11.1% block rate or the veterinary sites that share the 0% floor.

Key Takeaways

  • Of the 10 Med-Spa sites with a parseable robots.txt, zero block any AI crawler — a 0% rate, at the very floor of the ranking.

  • There is no blocker to name: americanmedspa.org, coolsculpting.com, hydrafacial.com, ultherapy.com, cutera.com, solta.com, skinclinical.com, revanceaesthetics.com, sciton.com, and lumenis.com all allow every crawler.

  • Two domains — americanspamagazine.com and allergan.com — returned no parseable file at the seal and are excluded from the rate.

  • Med-spa shares the zero-block floor with Veterinary, Staffing, and Construction, and sits far below Healthcare (66.7%) and Gaming (88.9%).

  • Corpus-wide, 318 of 1247 sites (25.5%) gate at least one crawler, so med-spa sits well below the average at the open end.

Source: US Tech Automations Research — Closing Web edition; figures are verbatim counts from public robots.txt files sealed June 21, 2026 (snapshot sha 1900f057e385d393).

Get this data as a daily feed

The numbers in this report come from a permit feed we monitor daily. Leave your email and we will follow up about a daily feed for your ZIPs and categories.

Prefer to talk first? Contact us.

Cite this report

US Tech Automations Research, 2026-06 edition. “Do Med-Spa Sites Block AI Crawlers? Zero of 10 Do.” https://ustechautomations.com/resources/blog/do-med-spa-sites-block-ai-crawlers-2026

Sealed snapshot sha256: 1900f057e385d393

Machine-readable data: CSV · JSON · All research & methodology

About the Author

Garrett Mullins
Garrett Mullins
Workflow Specialist

Helping businesses leverage automation for operational efficiency.