I suspect that it indeed is happening less. Talking to LLMs helps to do things like establishing alignment-related results (e.g. Gemini being depressed, Chinese models claiming to be Claude), not capabilities-related results like disproving an Erdos conjecture or performing a far more complex hack than was asked.
I suspect that it indeed is happening less. Talking to LLMs helps to do things like establishing alignment-related results (e.g. Gemini being depressed, Chinese models claiming to be Claude), not capabilities-related results like disproving an Erdos conjecture or performing a far more complex hack than was asked.