Roland Pihlakas comments on Systematic runaway-optimiser-like LLM failure modes on Biologically and Economically aligned AI safety benchmarks for LLMs with simplified observation format (BioBlue)

[Roland Pihlakas]

I renamed the phenomenon to “runaway optimiser”. I hope this label illustrates the inappropriately unbounded and single-minded nature of the failure modes we observed. How does that sound to you, does that capture the essence of the phenomena described in the post?

[Jacob G-W]

Better, thanks!