What I meant was morality emerging within an artificial system—that is, arising spontaneously within an AGI without being explicitly programmed or optimised for. That’s what I argue is unlikely without a clear mechanism.
If morality appears because it was deliberately engineered, that’s not emergence—that’s design. My concern is with the assumption that sufficiently advanced intelligence will naturally develop moral behaviour as a kind of emergent byproduct. That’s the claim I’m pushing back on.
Appreciate the clarification—but I believe the core thesis still holds.
That’s not emerging artifically. That’s emerging naturally. “Emerging artificially” makes no sense here, even as a concept being refuted.
That’s fair. To clarify:
What I meant was morality emerging within an artificial system—that is, arising spontaneously within an AGI without being explicitly programmed or optimised for. That’s what I argue is unlikely without a clear mechanism.
If morality appears because it was deliberately engineered, that’s not emergence—that’s design. My concern is with the assumption that sufficiently advanced intelligence will naturally develop moral behaviour as a kind of emergent byproduct. That’s the claim I’m pushing back on.
Appreciate the clarification—but I believe the core thesis still holds.