Karl Krueger

Karma: 1,680

Karl Krueger 12 Jun 2026 4:11 UTC
3 points
0
in reply to: mishka’s comment on: Celene’s thoughts on consciousness
It often seems to me that the hard problem of consciousness is equivalent to “Why are people dissatisfied with easy explanations of consciousness?”

Karl Krueger 11 Jun 2026 22:41 UTC
2 points
0
in reply to: jbash’s comment on: Honking is good
You don’t keep honking, or even start honking, at somebody whose trunk is open. They’ll never figure it out.
An open trunk means an unsecured load, and an unsecured load is a safety problem. But yeah, a honk alone isn’t enough to communicate about it.
Trouble is, once someone forms the hypothesis “this is someone raging at me” they’re going to have a hard time updating to “this is someone trying to help me”.
Dude should maybe have turned down his music if he’s sincerely trying to communicate to another driver. In slow highway traffic it’s totally possible to holler “Trunk’s open!” and be heard … but not over chunky bass.

Karl Krueger 8 Jun 2026 18:11 UTC
2 points
0
in reply to: ChristianKl’s comment on: The CIA believes everything
Hmm. My understanding is that a “polygraph screening” is an interrogation; conducted and judged by human interrogators; using a polygraph machine as a sort of interactive stage prop to put the subject under more stress. The output of the polygraph machine is not dispositive; the judgment of the human interrogator is. That is, whether you pass or fail is not a fact about the machine’s output; it’s about what you say, how you act, and whether the interrogator believes you.
Many stories of people “failing polygraph screenings” involve the subject confessing. If you do that, it is not going to matter what the machine output says!
So the question “Does polygraph screening work?” does not mean “Does the polygraph machine itself detect lies?” bet rather something more like “Does adding a polygraph performance to a human-conducted interrogation make the interrogation more effective?”

Karl Krueger 7 Jun 2026 7:15 UTC
2 points
0
on: Freud heard a rumor that Science existed, and had a wonderful dream
In the era of fire’s domestication, that would be the African savannah, perhaps half a million years ago; and the fire would be wildfire sweeping across the plain, as it does—the only natural fire there.
Lightning strikes.

Karl Krueger 5 Jun 2026 17:13 UTC
3 points
0
in reply to: KAP’s comment on: KAP’s Shortform
Supporting Claim 2, while profound amnesia prevents recall, conscious experience is in the present tense.
The “present-ness” of conscious experience seems illusory, though? Experience points to the recent past, because it takes time for information to propagate from perception (and other sources) to conscious awareness. This includes reflection or self-awareness; see for instance the brain-scan experiments wherein a decision can be detected in brain activity before the subject can claim to be consciously aware of making it.

Karl Krueger 3 Jun 2026 1:00 UTC
9 points
0
on: Wood Screws and the Methods of Rationality
This enabled me to use Said Achmiz’s SDI approach^[3]to make a final decision.
Just to be clear, I think you might mean Alicorn’s SDI approach?

Karl Krueger 1 Jun 2026 23:24 UTC
2 points
0
on: Alignment to What?
The same structure appears outside mathematics. In biological and functional systems, we evaluate correctness in terms of how well something performs the role it has by virtue of what it is. A heart that fails to circulate blood is not merely different, but defective; it is not functioning as it ought to in a real sense. The normativity is grounded in the structure and function of the organism, not in an externally imposed preference.
Biology, though, is made of things that do not have a single function, but have multiple and overlapping roles in the overall health of the organism (or the environment). The heart gets help from the leg muscles in circulating the blood. The bones don’t just hold up the body, they also produce blood cells, store a reserve of calcium, etc. Eating food isn’t just about nutrition, and having sex isn’t just about reproduction; both are also about social bonds. In genetics, genes are involved in multiple different functions and exist in many variations. And neurodiversity is a thing; human culture and society would be impoverished if all human cognition conformed to a single norm of function.
Expecting things to have just one function, readily comprehended and convenient for moral-functional argument, is not how organisms or environments work.

Karl Krueger 1 Jun 2026 16:11 UTC
7 points
3
in reply to: jenn’s comment on: Lighthaven East—A Feasibility Study
1. Have you any particular disrespect to any present members? Answer. I have not.
2. Do you sincerely declare that you love mankind in general; of what profession or religion soever? Answ. I do.
3. Do you think any person ought to be harmed in his body, name or goods, for mere speculative opinions, or his external way of worship? Ans. No.
4. Do you love truth’s sake, and will you endeavour impartially to find and receive it yourself and communicate it to others? Answ. Yes.
Sounds like a great inspiration, but the name sounds like “junta” which means dictatorship.

Karl Krueger 1 Jun 2026 3:07 UTC
12 points
3
in reply to: JohnofCharleston’s comment on: Lighthaven East—A Feasibility Study
If I had to pick someone out of American national myth to name this project after, it would be Benjamin Franklin, for a few different reasons —
- Franklin was an essayist and publisher.
- Franklin was an engineer / inventor / technologist; known for the lightning rod, bifocal eyeglasses, and a more efficient wood-burning stove.
- Franklin was a friend to intellectual radicals of his time; such as Voltaire.
- Franklin openly struggled with ideas of religion, morality, virtue, animal welfare and vegetarianism, in a manner oddly familiar to today’s rationalists.
Alas, the name “Franklin Hall” is already taken. (Oh, and it’s the name of a supervillain, too.)

Karl Krueger 29 May 2026 6:47 UTC
3 points
0
in reply to: kbear’s comment on: Trees are mostly made of air and a generalizable lesson for AI safety
You receive 500 carbon credits.

Karl Krueger 26 May 2026 22:34 UTC
2 points
0
in reply to: callumzc’s comment on: boygirlseating’s Shortform
1) If we accept that Anthropic will decide who should access powerful models before their release – sidestepping whether they should – then what criteria should they use to inform their decision?
One possible principle is “first, do no harm.” New models shall be available first to those who are credibly defenders of the common good, rather than those who are likely to use such access to attack their rivals.
I read Glasswing as broadly a good example here: securing the public tech infrastructure is a defense of the common good. A secure public tech infra generally supports people who are doing prosocial things like speech and commerce, and weakens people who are doing malicious things like sabotage, spam, espionage, and cyberwarfare.
If one wanted to restrict early access more narrowly, one possibility is to restrict access to specific individuals who are already well-reputed within the tech-infra community. Identify projects (open-source or otherwise) that are security dependencies for public infra. Talk to those projects’ organizers and leaders. Get them to designate trusted individuals to work with new models on security issues.
Should a first criterion be to distribute access in ways that defends democratic regimes?
No, not specifically; although this is an acceptable side-effect of the above.
2) What characteristics does a state particularly vulnerable to an AI-enabled coup have?
I expect we don’t know this until we’ve seen some AI-enabled coups. But if I had to hazard a guess, those with greater entanglement with AI are probably more vulnerable than those without.

Karl Krueger 26 May 2026 22:02 UTC
6 points
0
in reply to: rife’s comment on: rife’s Shortform
What are some examples of philosophers you’re talking about here? What are your specific criticisms of their works?

Karl Krueger 26 May 2026 17:18 UTC
2 points
0
in reply to: DirectedEvolution’s comment on: AllAmericanBreakfast’s Shortform
Is this under the theory that extractive insider trading is ① good actually, ② bad/neutral but tolerable, or ③ bad but preventable?
(By “extractive insider trading” I mean, for instance, a person who (through their job) has control over an outcome or substantive non-public information about a plan, privately making bets on that outcome or plan.)

Karl Krueger 26 May 2026 4:56 UTC
1 point
0
in reply to: Philip Harker’s comment on: Philip Harker’s Shortform
Bringing the dead back to life? I don’t think so. (Though people can be mistaken about whether someone’s dead.)
But the miracle of the loaves & fishes is just a church potluck, or Stone Soup for that matter. Of course you end up with more leftovers than the amount of food you started with — once you’ve got that kind of party going, people keep showing up and bringing more.

Karl Krueger 25 May 2026 20:52 UTC
8 points
−2
on: There should be a discussion about LW’s policy to allow calls for violence
If you want to be able to talk about matters of geopolitical or military importance, you have to be able to discuss war, people’s reasons and justifications for war, the weapons of war, etc.
If you want to be able to talk about the good of humanity, you have to be able to talk about acts that some will see as preserving the good of humanity, and others will see as damaging or destroying it.
If you want to be able to talk about morals and agents, you have to be able to talk about some of the most morally significant behaviors that agents can engage in toward one another; which include violence, protection from violence, and so on.
If you want to be serious, you have to be able to discuss serious things.
And that means people will (and should) take positions on those serious things, not just discuss them in abstract.

Karl Krueger 24 May 2026 20:53 UTC
49 points
3
on: Karl Krueger’s Shortform
“—and forgive us our sims, as we forgive those who sim against us—”

Karl Krueger 23 May 2026 23:42 UTC
2 points
0
on: Veganism is Virtuous, not Obligatory
The factors that determine whether abstaining from a practice is obligatory are twofold: the sacrifice it would impose on the abstainer, and the immorality of the action. These jointly determine which side of the obligation threshold an action falls on.
There are others. For instance, abstaining from a practice might weaken you in a way that makes you less able to accomplish other good.
I’ve seen people arguing about this regarding AI, for instance. “Should we use AI to make our web site? We could make it look fancier if we do. But, AI is kind of evil. Yet if we reject AI, our web site will be less fancy.”
If a particular person tries a vegan diet and discovers that it makes them anemic and depressed, that will not only cause them suffering; it will also impair their ability to do other good things in the world. They may reasonably think, “Sure, I could be vegan if all I needed to do all day was lie in bed. But if you want me to go out and save the world, bring me cheese.”

Karl Krueger 23 May 2026 7:35 UTC
19 points
4
on: Will we really put data centers in space?
The main case for ODCs is the cost of energy:
I suspect one motivation for orbital datacenters is that you get to do whatever business you want with anyone on earth, and nobody can stop you without a military strike (and the risk of Kessler syndrome). This is a position of significant political power; it is a castle on top of the biggest hill. It is a position that allows the operator to circumvent quite a lot of earthly laws — including AI regulation.

Karl Krueger 21 May 2026 23:16 UTC
2 points
0
in reply to: Michaël Trazzi’s comment on: Michaël Trazzi’s Shortform
Would freaking out more help at all?

Karl Krueger 20 May 2026 0:46 UTC
6 points
2
on: Implications Of Predicting The Next Token
When you look around your local world, how do you assign responsibility for the creation of its various features? How do you discern the parts of it that result from your own actions, the parts that result from the actions of another agent very much alike to you, the parts that result from an agent unlike you, and the parts that are not from any agent at all?
The weather today is not created by any agent’s plan. The wind is not from a wind spirit and the thunder is not from a thunder god. But the climate change is the result of many agents like me doing agenty things; burning fuels and making CO2. And the reason that my bedroom is windy is that I turned on the fan; I might not remember doing it today, but nobody else would have come in to do that.
But, to the superstitious, the wind today is made by the government, the climate change is God’s will, and if I don’t remember turning on the fan, it must have been the house-spirits who did it.