He’s saying that you can compare AI to humans, but to do that to a professional research standard, you need to meet the following criteria:
Explicit about your methodology in advance
Specific about the comparison you are making
Justify your interpretation of your results
OpenAI is currently not attempting to meet this standard. They are hyping their product. That is their perogative, but Tao is under no obligation to participate in the hype and he’s being clear about the conditions under which he would comment.
He’s saying that you can compare AI to humans, but to do that to a professional research standard, you need to meet the following criteria:
Explicit about your methodology in advance
Specific about the comparison you are making
Justify your interpretation of your results
OpenAI is currently not attempting to meet this standard. They are hyping their product. That is their perogative, but Tao is under no obligation to participate in the hype and he’s being clear about the conditions under which he would comment.