I’m on desktop but it’s garbled the way you describe it for me on Firefox, but on Chrome it displays normally.
Spective
Karma: 61
It’s funny because my reason for finding the saturation view appealing sounds similar to your objection to it. In the extreme case of literally identical experiences, from the inside of those experiences it doesn’t really seem to make sense to ask “which instantiation I am?” as they are by definition indistinguishable from inside. There doesn’t seem to be a matter of fact here. There may be a matter of fact to the amount of copies, but “which instantiation I am” would be a strange kind of fact about some experience that isn’t specified within the experience. Furthermore, the amount of these copies isn’t anything any of the individual instantiations feels from the inside either. So when a literally identical copy of an experience is added, it seems like there’s a sense in which there doesn’t seem to be anyone who benefits.
So then you can consider the scenario where the experiences aren’t quite 100% identical, but contain some extremely small and trivial differences making each experience technically unique, maybe one tiny pixel is of slightly different color in their fields of vision. It would seem strange that this changes things drastically, as in 100 previously identical copies previously having the moral worth of 1 experience now having the full worth of 100 experiences.
Somewhat more plausibly, it might add some moral weight to these 100 instantiations but at best to a trivial degree that is proportional to the triviality of the changes. And from there, considering where the differences are increasingly more substantial, you can see how we might end up in something like the saturation view.
Basically, this is an alternative way to “count” the “amount” of experience. In your “sealed rooms” example, it’s a bit like World V in some sense has “more people” than World H due to the two people being more distinct. It’s a strange way to put it, but strange in a way that I’d expect when one takes Parfitian views on personal identity seriously which I personally feel compelled to.
FWIW, I didn’t even have such a strong intuition for there being an intrinsic value to diversity before I encountered arguments along these lines. For example, first time reading “Value Is Fragile” my immediate reaction to “replaying a single highly optimized experience, over and over and over again” as an example of “almost all value being lost” was “Huh? Is that really so bad? Sure something more diverse sounds better, and all else being equal I’d wish for diverse kinds of happiness. But it also kind of sounds like being worried that future people have a crappy taste in music from your point of view. The boredom is just a problem for you right now, contemplating these monotonous futures.”
I also find it quite likely that I might change my views on this entirely, most plausibly from some kind of “reality-fluid”/measure or nature of probability angle. This stuff is very confusing, for sure.
This is an important distinction for me because I expect broad intelligence/capabilities to correlate with goodness and wisdom but I believe narrow superpowers can potentially also give an agent overwhelming advantage and power. AIs with relatively balanced and broad capability profiles including wisdom etc. are still potentially dangerous to humans but the really crappy futures with close to zero cosmic value I expect to be occupied by myopic AIs that are not necessarily even overwhelmingly superhuman in all important domains.
For me the most helpful one is just thinking in the target language as much as possible. YMMV depending on how much of a verbal thinker you are to begin with.
Funnily this case arguably resembles more the “strawman” version of the paperclip maximizer. In the “actual” paperclip maximizer thought experiment, paperclips were supposed to be just some unpredictable, seemingly random emergent goal rather than following verbal instructions but not in the way you wanted. According to the historical note here.
I also used to find ancestor simulators something unlikely for future AIs to do just because they would be so beyond us with their transcendental concerns etc. but then I realized we humans would be quite interested in simulating how abiogenesis originally happened (despite being unfathomably more complex and advanced compared to the earliest forms of life) so seeing simulations of us as analogous to something like that started to look not so crazy.
The ironic thing about humor as an IQ test is that IMO, it’s one that LessWrong and the Rationalist community is not doing so great on… It did occur to me one day when I realized what an outlier Scott Alexander is in this regard. As far as my personal funny bone is considered, anyway.
Yes, and “observing external reality” only leads into observing more qualia in your head rather than perceiving external reality as such, from which you make more or less indirect inferences about external reality. Some of these observations feel relatively direct, like observation of macro-level objects like tables and whatever, but even then you always only observe the them in some limited way, from some specific angle and what you see is something like your brain’s representation of the object rather than what it “objectively looks like” (there probably isn’t such a thing), these observations also never equal to the objective existence of the object which could always conceivably be a hallucination etc.
And then something like atoms or quantum fields isn’t perceived even this way at all, but rather postulated and inferred from complicated experiments to explain a wide range of comparatively more direct observations. Consciousness of other people is a bit like this—I would argue still more direct than the “observation” of atoms as pretty much all people can figure out other people probably have subjective experiences without doing any formal science. It’s just basic extrapolation from one’s own subjective experience, similarity to other humans and observing their behavior and postulating consciousness etc.
I don’t think there’s such an insurmountable ontological difference between observing the consciousness of other people (and remembering the consciousness of one’s past self) vs. observing the external reality in general. Both are something probabilistically inferred about something “out there” rather than something that’s right now right here and directly perceived. Perhaps you can never become quite as certain about the latter category than the phenomenal experience of your current observer moment, but that is hardly surprising that you know “the right here right now” better than the rest of the universe.
One of my life aspirations is to post something offensively stupid somewhere, forget about the post, randomly encounter it later, fail to recognize it as mine and write an outraged reply to it.
Not sure how much if I agree with 1). I increasingly find terms like physicalism/idealism/panpsychism worse than useless and conveying more vibes and tribal affiliations than truth propositions. I wouldn’t necessarily encourage people to identify with them more explicitly. Though other philosophical terms might be more useful—you mentioned closed individualism which (along with its opposite open/empty individualism) does seem to have more concrete implications on one’s attitude towards things like death, survival, mind uploading and various transhumanist technologies if we are lucky enough to ever have those problems. Potentially also has big implications on how you view AI x-risk as well.
IMO more useful distinction than “physicalism vs. non-physicalism” per se is whether you think new physics are needed to explain consciousness like Penrose does (another one is if you think that a system needs to make use of quantum effects for phenomenal binding). That seems like a claim with content, whereas the content of “consciousness is physical/non-physical” seems highly nebulous at best. This new substance that is required to explain consciousness is “non-physical”… uhh, then what?? Debates between physicalism and panpsychism (except the most naive strawmen thereof) in particular get so ridiculously abstract and vague about the intrinsic nature of an electron and whether it counts as “proto-experiential” or something that I doubt they really know what they are even talking about.
It’s definitely the funniest combo to me. Are there any known extreme examples?
Opus 4.6 and IIRC even Opus 4.5 could see the VR switch in the sense of recognizing it as a distinct looking tile, entertaining various hypotheses of what it could be but being overall bizarrely disinterested in it. While sometimes 4.6 would manage to get the boulder on it by sheer trial and error, occasionally it did it more intentionally by first noting the tile’s distinct look and verbalizing that it might be a switch. And IIRC at one point it had made a note what the switch looked like which helped it with consequent switch puzzles, until it destroyed this extremely precious note in overzealous memory cleanups.
Often 4.6 would assume it was an item, and given its default lack of interest in items tended to not pay much attention to it. Other times it dismissed it as just “floor decoration”. The big problem was that just the idea of trying to visually identify the correct tile first before starting to push the boulder haphazardly around wasn’t sufficiently obvious. It would sometimes verbalize this idea though, only to get distracted by ladders it saw or navigable tiles or whatnot and go back to bumping into walls in case of invisible doors or testing completely random boulder positions.
Neither the average child playing the game back in the 90′s nor Opus 4.6 knew in advance what the switches look like but both could see it. A big difference though is that at this stage of the game a child remembers what an item looks like and Opus 4.6 doesn’t. But even this doesn’t account for Opus 4.6′s default dismissal of the tile as “just decoration” when it confirmed it wasn’t an item. If you’re looking for a tile to push a boulder on, the one navigable one that looks different from the others should be a top candidate.
So what might’ve looked at first glance like a vision problem was actually more of a failure of reasoning, strategy etc. although to some extent also a problem of visual memory.
As for 4.7′s run, I think it’s worth noting that it got lucky by early on tossing the item that grants the ability DIG. DIG is notorious among viewers as something that’s been kryptonite for the different Claudes so far. It allows them to escape the cave and reset the puzzles when they get confused and desperate, but this also destroys so much of their progress which often a lot of time to redo due to their memory limitations.
What are some examples of the first? I certainly find myself increasingly thinking that there’s basically no limit to how dumb smart people can be in their dumb moments.
I don’t think you can just be conscious without being conscious of some things in particular. Subjective experience has to have content. What kind of experiences could a rock be having, considering what it’s physically doing? It’s probably not thinking “another day of being a rock”. Nor is it experiencing the sun shining on it because it doesn’t have any kind of visual processing system etc. Meanwhile prima facie at least, it’s considerably easier to imagine Claude having all kinds of human-like thoughts. On the condition that Claude has subjective experiences, but the contents thereof have to be computationally specified, it seems like we have some good reasons to have beliefs about what it might be experiencing.
Also, “a rock” is just one convenient way to draw boundaries for stuff in the universe and probably not very relevant for carving out experiential subjects. Even if in some sense “consciousness” is kinda everywhere, there seems to be an obvious sense in which some random group of people don’t form “one experiential macro-subject” but the individual members do (but for some groups of people acting really cohesively, it can arguably get a bit murky!) And this doesn’t seem that mystical but rather based on how information flows within the arrangement of objects we try to analyze as one subject and how unified it is.
wrt Blindsight response, assuming for some part of your brain you (your “main consciousness”, the one that can in addition to thinking and feeling also talk) don’t have direct access that there’s nothing like to be it seems a bit like assuming animals don’t have subjective experiences because you don’t have access to them yourself and the animals are very different from you. It’s almost like a trick of language, these parts are called “unconscious” because they are not in the subjective experience of the pointy-haired boss and then we equivocate this with a positive reason to think they lack subjective experience in and of themselves. This might be an irrelevant objection to what Watts is saying (since he seems to be talking about self-reflection etc.) however in that case it might not really answer Dawkins’ puzzlement either.
Also when used as more of an aesthetic judgement, AI sloppishness is quite orthogonal to the usual sense of “sloppy”—AI generated content has a certain polish and qualities that would be considered signs of skill and competence when produced by humans, esp. before they became easy to generate with AI and thus less valued. So in this context the problem isn’t that it’s “sloppy” as in looking careless, messy or full of mistakes but that it’s generic, bland, soulless etc. And a lot of creative, interesting and original (opposite of slop) content can be “sloppy” in the sense of being unpolished and imperfect.
you make an exact copy of you with all your memories, then 5 minutes later, the original you who got copied dies. Is this fine?
My first reaction to this is that it’s obviously not fine? I value living as myself, and I don’t get to do that if I die, and sure there is a copy of me living somewhere, but that is not the same? is it?
Clearly if there are two copies of someone, neither of them need to be fine with with dying even if the other one lives. After all there’s lots of potential future experiences lost if that happens. It’s semi-analogous to having one’s life extended first but then that extended life being taken away i.e. you have a heart that is expected to fail in ~10 years, somebody gives you an artificial heart that is supposed to last as long as the rest of your body, but then some bastard steals it and replaces it with your old crappy one—obviously you don’t need to be fine with that.
However, if we are presented with two alternative futures1) I get copied, 5 minutes later the original dies painlessly and instantly
2) I don’t get copied or killed.
Then I’ll happily bite the bullet and say I don’t think it matters much which of the two happens. Even if I take the perspective of the “original” who is about to die (who also knew before getting copied that these were the two only alternatives, maybe he needed to use the services of a teleport company whose policy is that the original must be deleted but there’s a 5 minute lag), to me it’s like I just had taken a pill that in 5 minutes will make me lose the memory of those 5 minutes.
Obvious facts nobody would disagree with when explicitly stated can still be underappreciated and not paid enough attention to, so they can still be worth spelling out for that reason. Although I must say when I get tired hearing of something obvious too many times, I get a pathological contrarian urge to argue against it.
This is a common idea but I think it’s a really unfortunate one and wrong. There’s a kind of a double standard on what counts as “direct access” which is used to argue that consciousness of other minds is especially tricky scientifically or epistemically.
Somehow looking at a physical object counts as “direct access” in spite of the fact that conceivably the apparent physical object always could be a hallucination (or alternatively using some measurement device that could always be malfunctioning or your reading of the measurements could be wrong). Likewise even when it comes to the “direct access to one’s own consciousness”, it at best applies to a particular observer moment (to the extent there even are discrete “observer moments”) rather than to one’s experiences in the past which one only has imperfect memories of. Similarly nobody has “direct access” to atoms or whatever our best theory of physics posits.
You’re “extremely certain other humans are conscious” (and that your past self was conscious) as you should be, based on similarly direct/indirect observation and extrapolation as your belief in gravity. Neither is quite as direct as your experience of the current moment because both are more like inferred laws/regularities across many different observations but they are very solidly grounded.