I actually doubt there are other general learning techniques out there in math space at all, because I think we’re already just doing “approximation of bayesian updating on circuits”
Interesting perspective! I think I agree with this in practice although not in theory (I imagine there are some other ways to make it work, I just think they’re very impractical compared to deep learning).
I don’t think I can make reliably true claims about anthropic’s effects with the amount of information I have, but their effects seem suspiciously business-success-seeking to me, in a way that seems like it isn’t prepared to overcome the financial incentives I think are what mostly kill us anyway.
Part of my frustration is that I agree there are tons of difficult pressures on people at frontier AI companies, and I think sometimes they bow to these pressures. They hedge about AI risk, they shortchange safety efforts, they unnecessarily encourage race dynamics. I view them as being in a vitally important and very difficult position where some mistakes are inevitable, and I view this as just another type of mistake that should be watched for and fixed.
But instead, these mistakes are used as just another rock to throw—any time they do something wrong, real or imagined, people use this as a black mark against them that proves they’re corrupt or evil. I think that’s both untrue and profoundly unhelpful.
Interesting perspective! I think I agree with this in practice although not in theory (I imagine there are some other ways to make it work, I just think they’re very impractical compared to deep learning).
Part of my frustration is that I agree there are tons of difficult pressures on people at frontier AI companies, and I think sometimes they bow to these pressures. They hedge about AI risk, they shortchange safety efforts, they unnecessarily encourage race dynamics. I view them as being in a vitally important and very difficult position where some mistakes are inevitable, and I view this as just another type of mistake that should be watched for and fixed.
But instead, these mistakes are used as just another rock to throw—any time they do something wrong, real or imagined, people use this as a black mark against them that proves they’re corrupt or evil. I think that’s both untrue and profoundly unhelpful.