From 2b7bef795c4df94630b47b429a4629d9a1089441 Mon Sep 17 00:00:00 2001
From: Paul Duncan <pabs@pablotron.org>
Date: Thu, 30 Jan 2025 22:14:07 -0500
Subject: README.md: add brief robots.txt documentation

---
 README.md | 7 +++++++
 1 file changed, 7 insertions(+)

diff --git a/README.md b/README.md
index 5e4b156..d6a5acd 100644
--- a/README.md
+++ b/README.md
@@ -159,6 +159,11 @@ carousel:
           height: 655
 ```
 
+## Robots.txt
+
+The contents of `static/robots.txt` are from [this site][robotstxt-ai]
+and used to prevent the entire site from being indexed by LLM crawlers.
+
 ## Deploy Site
 
 To clone site repo:
@@ -248,3 +253,5 @@ The [Bulma][] [SASS][] is:
   "Progressive enhancement picture and figure shortcodes for Hugo."
 [pngquant]: https://pngquant.org/
   "Lossy compression of PNG images."
+[robotstxt-ai]: https://robotstxt.com/ai
+  "AI / LLM User-Agents: Blocking Guide"
-- 
cgit v1.2.3