The apprehension of death guides a good deal of human behavior, so the sort of entity that might arise when freed from this fate could be frightening (i.e., undergo substantial value drift in a direction that we would not approve of, like toward something akin to baby-eating). Consider how immortal beings in fiction often have hostile alien values. AI never ends well in fiction, and neither does immortality.
The apprehension of death guides a good deal of human behavior, so the sort of entity that might arise when freed from this fate could be frightening (i.e., undergo substantial value drift in a direction that we would not approve of, like toward something akin to baby-eating). Consider how immortal beings in fiction often have hostile alien values. AI never ends well in fiction, and neither does immortality.