Being halfway through the LOGI paper now, I must retract the grand-parent; it seems that Eliezer does mean “code” in the straightforward sense, i.e. source or compiled code, e.g:
When considering which features to extract, the question I would ask is not “What regularities are found in code?” but rather “What feature structure is needed for the AI to perceive two identical algorithms with slightly different implementations as ‘the same piece of code’?” Or more concretely: “What features does this modality need to extract to perceive the recursive algorithm for the Fibonacci sequence and the iterative algorithm for the Fibonacci sequence as ‘the same piece of code’?” [...] Could a sensory modality for code look at two sets of interpreted bytecodes (or other program listing), completely different on a byte-by-byte basis, and see these two listings as the “same” algorithm in two slightly different “orientations”?
Being halfway through the LOGI paper now, I must retract the grand-parent; it seems that Eliezer does mean “code” in the straightforward sense, i.e. source or compiled code, e.g: