The utility function is fitness: gene replication count (of the human defining genes) [1]
Seems like humans are soon going to put an end to DNA-based organisms, or at best relegate them to some small fraction of all “life”.
I.e., seems to me that the future is going to score very poorly on the gene-replication-count utility function, relative to what it would score if humanity (or individual humans) were actually aligned to gene-replication-count.
Do you disagree? (Do you expect the post-ASI future to be tiled with human DNA?)
Obviously Evolution doesn’t actually have a utility function, and if it did, gene-replication-count is probably not it, as TekhneMakre points out. But, let’s accept that for now, arguendo.
Seems like humans are soon going to put an end to DNA-based organisms, or at best relegate them to some small fraction of all “life”. I.e., seems to me that the future is going to score very poorly on the gene-replication-count utility function, relative to what it would score if humanity (or individual humans) were actually aligned to gene-replication-count.
Do you disagree? (Do you expect the post-ASI future to be tiled with human DNA?)
Obviously Evolution doesn’t actually have a utility function, and if it did, gene-replication-count is probably not it, as TekhneMakre points out. But, let’s accept that for now, arguendo.