Orthogonality in design states that we can construct an AGI which optimizes for any goal. Orthogonality at runtime would be an AGI design that would consist of an AGI which can switch between arbitrary goals while operating. Here, we are only really talking about the latter orthogonality
This should not be relegated to a footnote. I’ve always thought that design-time orthogonality is the core of the orthogonality thesis, and I was very confused by this post until I read the footnote.
This should not be relegated to a footnote. I’ve always thought that design-time orthogonality is the core of the orthogonality thesis, and I was very confused by this post until I read the footnote.
Fair point. I need to come up with a better name than ‘orthogonality’ for what I am thinking about here—‘well factoredness?’
Will move the footnote into the main text.