I mean an AI that doesn’t write code is safer than one that does. But if you set an AI to cure cancer, you probably don’t want it thinking about say Volcanology in too much detail. If the AI doesn’t find anything, thinking was a waste of compute. And if the AI does find a means of “curing cancer” that involves the details of volcanoes, I expect it won’t be a solution I like. You want to make the AI focus on just biochemistry and nothing else.
I mean an AI that doesn’t write code is safer than one that does. But if you set an AI to cure cancer, you probably don’t want it thinking about say Volcanology in too much detail. If the AI doesn’t find anything, thinking was a waste of compute. And if the AI does find a means of “curing cancer” that involves the details of volcanoes, I expect it won’t be a solution I like. You want to make the AI focus on just biochemistry and nothing else.