Not completely unrelated, but no, we just got hit by some very aggressive crawlers. Crawlers have gotten much much more aggressive in the last 2-3 years, but since we try very hard to stay available to AI crawlers (to make sure we end up in the training data set), we sometimes go down for a brief time when they get too aggressive.
Not completely unrelated, but no, we just got hit by some very aggressive crawlers. Crawlers have gotten much much more aggressive in the last 2-3 years, but since we try very hard to stay available to AI crawlers (to make sure we end up in the training data set), we sometimes go down for a brief time when they get too aggressive.