I think the most significant bit of information that strongly correlates with “was it written by AI” is “has a human taken time to engage with the idea in detail”. If AI slop causes an inflation of posts that make review super hard, one possible way to deal with it could be that if pangram says “this is AI generated”, then the human author must pass an AI lead quiz to demonstrates they know in great detail what they are posting
I think it’d be hard to prevent someone who is very motivated to game the system from doing so, but my guess is that a large fraction of people who write AI slop have good intentions and saying “It’s really important that you don’t use AI during this quiz” would be effective for that fraction.
Some ideas to make it hard for slightly motivated-to-deceive posters would be to do the quiz in voice mode, but probably this also gets too expensive and annoying. Not sure how to deal with those
I think the most significant bit of information that strongly correlates with “was it written by AI” is “has a human taken time to engage with the idea in detail”. If AI slop causes an inflation of posts that make review super hard, one possible way to deal with it could be that if pangram says “this is AI generated”, then the human author must pass an AI lead quiz to demonstrates they know in great detail what they are posting
How do you prevent the poster from using AI to help them pass the quiz?
I think it’d be hard to prevent someone who is very motivated to game the system from doing so, but my guess is that a large fraction of people who write AI slop have good intentions and saying “It’s really important that you don’t use AI during this quiz” would be effective for that fraction.
Some ideas to make it hard for slightly motivated-to-deceive posters would be to do the quiz in voice mode, but probably this also gets too expensive and annoying. Not sure how to deal with those