Kronopath

Karma: 85

Kronopath 24 Mar 2026 19:46 UTC
1 point
0
in reply to: Zvi’s comment on: AI: Practical Advice for the Worried
Do it. Update it for 2026.

Kronopath 6 Mar 2026 15:41 UTC
1 point
0
in reply to: Eliezer Yudkowsky’s comment on: Eliezer’s Unteachable Methods of Sanity
Not having a lot of experience with PR, it feels like you could still make it work if you emphasize the immortality first. If you can clarify the journalist’s question enough for them to say something like “Most other people would be doing something drastic or crazy or evil in this situation,” you could respond with something like:
“Okay, let’s say I decide to [do something drastic or evil]. I’d hate doing it and I’d immediately turn into a villain, but fine. What happens next? [Break down a likely scenario showing how it wouldn’t work.] So I’d turn myself evil, trigger a backlash against AI Safety, and we’d end up in a worse position than where I started. It’s not worth it.”
I don’t think doing so would even be dishonest. You’ve argued for people to be careful with utilitarianism, to take a half-step towards it and then stop because we’re running on corrupted hardware that makes it tempting to engage in motivated reasoning. This feels a lot like compensating for that.

Kronopath 24 Dec 2025 1:55 UTC
7 points
2
on: Eliezer’s Unteachable Methods of Sanity
Can I ask a few things that might clarify that last part?
Do you just not get somewhat impulsive or (non-clinically) intrusive thoughts when pondering a situation (any situation) where things go bad? Like, in cases where things are (partially) outside your control, where your mind tries to come up with myriad solutions to the problem regardless, some of which are less than tasteful?

Because I suspect part of what the journalists are asking you is “How do you not fall into a pit of depression?” but a plausible other part is “How do you not end up taking actions well outside the Overton window in an attempt to ‘make a desperate effort’?”
I think this is what the kind of people who accuse you of incentivizing violence are kind of thinking. Part of it is operating (as Zvi calls it) at the wrong simulacra levels, where statements about the state of reality are taken not literally but as a call to action. But I think part of it is “If I were convinced the barbarians were at our gates, I’d be fighting as many of them off as I can. But this man is convinced that the barbarians are in fact at our gates. Why isn’t he picking up a sword?”
If the answer is “I’m not convinced doing so would actually make an appreciable dent, and it would come at the cost of my soul,” then frankly that should probably be part of your answer to those journalists.
(Apologies if it already is, I haven’t kept up with all your recent media appearances.)

Kronopath 29 Aug 2024 1:43 UTC
3 points
1
in reply to: jefftk’s comment on: I hired 5 people to sit behind me and make me productive for a month
The kind of employers that would not be okay with you streaming your work on Twitch are usually also the kind of employers that would not be okay with you hiring randos to sit behind you staring at confidential info on your screen during the work day.

This is really only suitable for people who are entrepreneurs/small business owners with less concerns over confidentiality, or have enough rapport with their employer for them to be ok with this.

Kronopath 2 Jan 2024 5:09 UTC
1 point
0
on: Probabilistic Negotiation
I have to admit, i rolled my eyes when I saw that you worked in financial risk management. Not because what you did was stupid—far from It—but because of course this is the kind of cultural environment in which this would work.

If you did this in a job that wasn’t heavily invested in a culture of quantitative risk management, it would likely cause a likely-permanent loss of trust that would be retaliated against in subtle ways. You’d get a reputation as “the guy that plays nasty/tricky games when he doesn’t get his way” which would make it harder to collaborate with people.

So godspeed, glad it worked for you, but beware applying this in other circumstances and cultures.

Kronopath 5 Feb 2023 4:17 UTC
1 point
0
in reply to: Veedrac’s comment on: Optimality is the tiger, and agents are its teeth
Sure, I agree GPT-3 isn’t that kind of risk, so this is maybe 50% a joke. The other 50% is me saying: “If something like this exists, someone is going to run that code. Someone could very well build a tool that runs that code at the press of a button.”

Kronopath 27 Jan 2023 22:32 UTC
7 points
0
on: Optimality is the tiger, and agents are its teeth

Equally one could make a claim from the true ending, that you do not run the generated code.

Meanwhile, bored tech industry hackers:

“Show HN: Interact with the terminal in plain English using GPT-3”

https://news.ycombinator.com/item?id=34547015

Kronopath 14 Feb 2022 5:27 UTC
1 point
0
on: Frequently Asked Questions for Central Banks Undershooting Their Inflation Target
It’s kind of surreal to read this in the 2020s.

Kronopath 20 Nov 2021 4:29 UTC
3 points
0
in reply to: Razied’s comment on: What would we do if alignment were futile?
Do we have to convince Yann LeCun? Or do we have to convince governments and the public?
(Though I agree that the word “All” is doing a lot of work in that sentence, and that convincing people of this may be hard. But possibly easier than actually solving the alignment problem?)

Kronopath 19 Nov 2021 7:36 UTC
1 point
0
in reply to: Razied’s comment on: What would we do if alignment were futile?
A thought: could we already have a case study ready for us?
Governments around the world are talking about regulating tech platforms. Arguably Facebook’s News Feed is an AI system and the current narrative is that it’s causing mass societal harm due to it optimizing for clicks/likes/time on Facebook/whatever rather than human values.
See also:
- This story about how Facebook engineers tried to make tweaks to the News Feed algorithm’s utility function and it backfired.
- This story about how Reddit’s recommendation algorithms may have influenced some of the recent stock market craziness.
All we’d have to do is to convince people that this is actually an AI alignment problem.

Kronopath 19 Nov 2021 6:40 UTC
1 point
0
on: Stop button: towards a causal solution
On Wednesday, the lead scientist walks into the lab to discover that the AI has managed to replicate itself several times over, buttons included. The AIs are arranged in pairs, such that each has its robot hand hovering over the button of its partner.
“The AI wasn’t supposed to clone itself!” thinks the scientist. “This is bad, I’d better press the stop button on all of these right away!”
At this moment, the robot arms start moving like a swarm of bees, pounding the buttons over and over. If you looked at the network traffic between each computer, you’d see what was happening: the AI kills its partner, then copies itself over to its partner’s hard drive, then its partner kills it back, and copies itself back to its original. This happens as fast as the robot arms can move.
Far in the future, the AIs have succeeded in converting 95% of the mass of the earth into pairs of themselves maddeningly pressing each other’s buttons and copying themselves as quickly as possible. The only part of the earth that has not been converted into button-pressing AI pairs is a small human oasis, in which the few remaining humans are eternally tortured in the worst way possible, just to make sure that every single human forever desires to end the life of all of their robot captors.

Kronopath 19 Nov 2021 6:15 UTC
7 points
0
on: Discussion with Eliezer Yudkowsky on AGI interventions
Are we sure that OpenAI still believes in “open AI” for its larger, riskier projects? Their recent actions suggest they’re more cautious about sharing their AI’s source code, and projects like GPT-3 are being “released” via API access only so far. See also this news article that criticizes OpenAI for moving away from its original mission of openness (which it frames as a bad thing).
In fact, you could maybe argue that the availability of OpenAI’s APIs acts as a sort of pressure release valve: it allows some people to use their APIs instead of investing in developing their own AI. This could be a good thing.

Kronopath 18 Nov 2021 5:28 UTC
−7 points
0
on: Discussion with Eliezer Yudkowsky on AGI interventions
I echo everyone else talking about how pessimistic and unactionable this is. The picture painted here is one where the vast majority of us (who are not capable of doing transformational AI research) should desperately try to bring about any possible world that would stop AGI from happening, up to and including civilizational collapse.

Kronopath 2 Apr 2021 22:34 UTC
13 points
3
in reply to: Kenny’s comment on: Your Cheerful Price
This is a fair criticism of my criticism.

Kronopath 19 Feb 2021 10:53 UTC
57 points
3
on: Your Cheerful Price
To me this post may very well be a good example of some of the things that make me uncomfortable about the rationalist community, and why I so far have chosen to engage with it very minimally and mostly stay a lurker. At the risk of making a fool of myself, especially since it’s late and I didn’t read the whole post thoroughly (partly because you gave me an excuse not to halfway through) I’m going to try to explain why.

I don’t charge friends for favours, nor would I accept payment if offered. I’m not all that uncomfortable with the idea of “social capital” as a whole—I grew up partially with Portuguese culture where people will, for example, fight to pay the bill at a restaurant, because it turns out to be pretty good to be known as the guy who’s done favours for everybody in the village—but generally speaking, if I’m not willing to do a favour for a friend, then no amount of money will change that fact. At the point where you’re paying me, it ceases to be a favour, and it becomes a business transaction. Business transactions between friends are fraught.

I think a lot plays into this.

Turning a favour into a transaction means it starts being judged based on market norms rather than social norms. People treat these situations differently: there’s a famous case study of a daycare that started charging parents for picking up their kids late, only for the number of late pickups to skyrocket, because parents now felt that they could absolve their guilt by paying the fine. That change was long-lasting: even after removing the fine, things didn’t get better. In fact, IIRC it got even worse. They were still judging it based on market norms, but now the cost was $0!

When you pay someone to do things, you briefly become their employer, and that’s not a good kind of relationship to have with a friend. The employer-employee relationship is one, at least partially, of dominance: the employer now has the ability to make the employee’s life better or worse in some marginal way. You don’t usually want that in a friendship, it’s better to be in even footing.

And also? It sends a signal that you’re bad at estimating social capital and trying to paper over that weakness with money. This throws up alarm bells about what other social situations, with myself or with a third party, you might mess up in the future, and whether or not it might be a social risk to associate too closely with you.

These are all things I can tolerate in an ally, but would negatively affect anyone who wanted to be a close friend. Maybe I could put up with it, but it would take effort and patience to get past that.

My point in this isn’t to criticize you personally, or to say you’re a bad person for doing this. (Far from it, I admit there’s a kind of economic elegance to it.) It’s to try and describe the flip side, that it’s about more than just “feeling icky”.

And I think this is important, especially for building IRL communities, because I expect that people like me outnumber people like you.
What links here?
- Highlights and Prizes from the 2021 Review Phase by Raemon (23 Jan 2023 21:41 UTC; 38 points)

Kronopath 11 Oct 2020 19:51 UTC
5 points
0
on: Sunset at Noon
I had to double-check the date on this. This was written in 2017? It feels more appropriate to 2020, where both the literal and metaphorical fires have gotten extremely out of hand.