This is a helpful analysis and rundown. I’ve seen quite a bit of annoying marketing of open models in different places, which doesn’t take into account any of these problems, some of which are so obvious. I hadn’t thought about Panopticon as being the de facto solution to this. I also like your point, “Bioweapon risk is already here in an early form, but the “army of superintelligences” is nowhere to be found.” While I have plenty of interest in more speculative, forward-looking analyses, those also have to get jerked back down to reality pretty hard when we have evidence that contradicts them.
This is a helpful analysis and rundown. I’ve seen quite a bit of annoying marketing of open models in different places, which doesn’t take into account any of these problems, some of which are so obvious. I hadn’t thought about Panopticon as being the de facto solution to this. I also like your point, “Bioweapon risk is already here in an early form, but the “army of superintelligences” is nowhere to be found.” While I have plenty of interest in more speculative, forward-looking analyses, those also have to get jerked back down to reality pretty hard when we have evidence that contradicts them.