Also, the X-Robots-Tag header can be set on individual page responses (in contrast to robots.txt being for the whole domain).
X-Robots-Tag
Sorry this is what I meant, you’re right.
Also, the
X-Robots-Tagheader can be set on individual page responses (in contrast to robots.txt being for the whole domain).Sorry this is what I meant, you’re right.