IS resides in Algorithmic Information Theory OUGHT resides in Sequential Decision Theory
SDT(AIT ) = AIXI
And don’t get confused about AIXI being “just” a theory of AGI. Any system that makes decisions (what OUGHT I to do?) depends on learning (what IS the case?).
Moreover, Hume’s Guillotine has been the foundation of ethics for centuries, whether that is recognized or not.
The fact that the field of AGI ethics introduces the concept of “sharp left turn” without regard to either the founding theory of AGI, or the founding theory of ethics is quite a sight to behold!
See Hume’s Guillotine at github for a further exposition.
IS resides in Algorithmic Information Theory
OUGHT resides in Sequential Decision Theory
SDT(AIT ) = AIXI
And don’t get confused about AIXI being “just” a theory of AGI. Any system that makes decisions (what OUGHT I to do?) depends on learning (what IS the case?).
Moreover, Hume’s Guillotine has been the foundation of ethics for centuries, whether that is recognized or not.
The fact that the field of AGI ethics introduces the concept of “sharp left turn” without regard to either the founding theory of AGI, or the founding theory of ethics is quite a sight to behold!
See Hume’s Guillotine at github for a further exposition.