I was interpreting the “or purpose” in this case as a basic synonym for meaning, but I can see that that may not have been intended. I think I was driven by the statement that:
“Through evolutionary conditioning, you are blind to the lack of point of living.”
I took this as an indication that gurgeh was talking about subjective meaning, but that assumes that’s where most people find their “point of living”, or even where they can perceive a point in living once their belief in objective meaning is no longer. If you only found your point in living in inherent meaning, or didn’t like the idea of just choosing or falling into having a meaning, then I could see gurgeh’s statement being more disturbing.
In relation to your last comment, I’m interested in that occasionally mentioned apparent opposition between “cold hard science” and “the wonder and beauty of life” and all that. I’m not assuming you feel this way, but many find the idea that all meaning in our lives is the result of ion channels and patterns of activation to be disheartening and at odds with things like beautiful literature, meditation, or love. Personally I don’t perceive any opposition and this doesn’t bother me in the slightest, if anything it just increases my fascination with the human brain. If it’s that perceived dichotomy that is the primary reason for saying that long or clear contemplation brings depression, I say: A rose by any other name...
This is one thing I actually wouldn’t believe.
To say that nothing has inherent meaning is not to say that nothing has meaning. I find meaning in things that I enjoy, like a sunset. Or a cake. There is no inherent meaning in them whatsoever. But if I say that I find meaning in something because it brings me pleasure, to be convinced there was not even subjective meaning I would need the AI to convince me that either 1) I don’t actually find pleasure in those things or 2) that I don’t find meaning in pleasure. In the end, meaning in this sense seems so subjective, it’s like the AI trying to convince me that I don’t have the sensation of consciousness. Not that there is no ‘real’ consciousness (which I could accept), but that I do not perceive myself to have consciousness, just as I perceive things to have personal meaning.
That there is no meaning because there is no ought-from-is only follows if you require your sense of meaning to have any relation to ‘is’.
And you didn’t get a simpler fitness function because you weren’t coded for your pleasure, but for ours. And because we didn’t have you around to help us.