Yeah, it’s an interesting question how good human detection is. My guess is that people who are paying attention are getting better at sniffing out AI faster than AI is getting less distinctively scented, but “people who are paying attention” is a heck of a sleight of hand.
Overall, I suppose my main feeling is that I see AI generated stuff all the time in lots of different arenas, and I see other people judging it, and it sort of feels like an Eternal September where some people are freshly excited by some AI use case in their thinking, and don’t realize how it comes off (or do, but it hasn’t occurred to them that it comes off badly for good reasons as well as straightforward prejudice). There may also be lots of people using AI so skillfully that they don’t fall into any of these traps. It’s even possible they far outnumber the people who are (I think) bumbling. Perhaps my doubt for this last proposition is a stuck prior. But if so, it is well and truly stuck.
Absolutely agreed re: people naively using LLMs in the simplest possible way for writing and that coming off very badly. And I think getting such people to consider the issue is well worthwhile!
Yeah, it’s an interesting question how good human detection is. My guess is that people who are paying attention are getting better at sniffing out AI faster than AI is getting less distinctively scented, but “people who are paying attention” is a heck of a sleight of hand.
Overall, I suppose my main feeling is that I see AI generated stuff all the time in lots of different arenas, and I see other people judging it, and it sort of feels like an Eternal September where some people are freshly excited by some AI use case in their thinking, and don’t realize how it comes off (or do, but it hasn’t occurred to them that it comes off badly for good reasons as well as straightforward prejudice). There may also be lots of people using AI so skillfully that they don’t fall into any of these traps. It’s even possible they far outnumber the people who are (I think) bumbling. Perhaps my doubt for this last proposition is a stuck prior. But if so, it is well and truly stuck.
Absolutely agreed re: people naively using LLMs in the simplest possible way for writing and that coming off very badly. And I think getting such people to consider the issue is well worthwhile!