Joey Yudelson comments on Should we exclude alignment research from LLM training datasets?

[Joey Yudelson]

Can we make the robots.txt programmatic by page, and then have a tag we can add to exclude a post from the robots.txt? That feels like the ⁸⁰⁄₂₀