Imagine that you hadn’t figured out FDT, but you did have CDT and EDT. Would building an AI that defers to humans if they are different be an example of minimal but aligned?
If we take artificial addition too seriously, its hard to imagine what a “minimal arithmatician” looks like. If you understand arithmetic, you can make a perfect system, if you don’t, the system will be hopeless. I would not be surprised if there was some simple “algorithm of maximally efficient intelligence” and we built it. No foom, AI starts at the top. All the ideas about rates of intelligence growth are nonsense. We built a linear time AIXI.
Imagine that you hadn’t figured out FDT, but you did have CDT and EDT. Would building an AI that defers to humans if they are different be an example of minimal but aligned?
If we take artificial addition too seriously, its hard to imagine what a “minimal arithmatician” looks like. If you understand arithmetic, you can make a perfect system, if you don’t, the system will be hopeless. I would not be surprised if there was some simple “algorithm of maximally efficient intelligence” and we built it. No foom, AI starts at the top. All the ideas about rates of intelligence growth are nonsense. We built a linear time AIXI.