Erlja Jkdf.

Karma: −25

Erlja Jkdf. 24 Sep 2022 0:28 UTC
−1 points
0
in reply to: janus’s comment on: If we have Human-level chatbots, won’t we end up being ruled by possible people?
Sidles closer
Have you heard of… philosophy of universal norms?
Perhaps the human experience thus far is more representative then the present?
Perhaps… we can expect to go a little closer to it when we push further out?
Perhaps… things might get a little more universal in this here cluttered with reality world.
So for a start...
Maybe people are right to expect things will get cool...

Erlja Jkdf. 23 Sep 2022 18:34 UTC
1 point
0
in reply to: janus’s comment on: If we have Human-level chatbots, won’t we end up being ruled by possible people?
I think that’s a bad beaver to rely on, any way you slice it. If you’re imagining, say, GPT-X giving us some extremely capable AI, then it’s hands-on enough you’ve just given humans too much power. If we’re talking AGI, I agree with Yudkowsky; we’re far more likely to get it wrong then get it right.
If you have a different take I’m curious, but I don’t see any way that it’s reassuring.
IMO we honestly need a technological twist of some kind to avoid AI. Even if we get it right; life with a God just takes a lot of the fun out of it.

Erlja Jkdf. 23 Sep 2022 15:21 UTC
2 points
0
in reply to: janus’s comment on: If we have Human-level chatbots, won’t we end up being ruled by possible people?
There’s a problem I bet you haven’t considered.
Language and storytelling are hand-me-downs from times full of bastards. The linguistic bulk, and the more basic and traditional mass of stories, are going to be following more brutal patterns.
The deeper you dig, the more likely you end up with a genius in the shape of an ancient asshole.
And the other problem; all these smarter intelligences running around, simply by fact of their intelligence, has the potential to make life a real headache. Everything could end up so complicated.
One more bullet we have to dodge really.

Erlja Jkdf. 23 Sep 2022 14:59 UTC
1 point
0
in reply to: Dagon’s comment on: If we have Human-level chatbots, won’t we end up being ruled by possible people?
Is this perhaps because the top end is simply not high enough yet?

Erlja Jkdf. 20 Sep 2022 23:37 UTC
1 point
0
in reply to: avturchin’s comment on: If we have Human-level chatbots, won’t we end up being ruled by possible people?
The point is it’s a near-term risk and only building on what they can already simulate.

Erlja Jkdf. 16 Sep 2022 17:52 UTC
0 points
0
in reply to: Viliam’s comment on: In a world without AI, we need gene-editing to protect Nature. (Not how you think)
They would be smarter at birth. Either you gene-edit your kids or you pass that up. Yes, some people would do it; and yes, you’d get genius proliferation. But so long as you’ve got enough hide-bound naturists, fully committed, you would always have some eco-warriors around.
There’s no such thing as a million fully committed naturists, and that’s why the planet is cooking and the endangered list keeps growing.

Erlja Jkdf. 30 Aug 2022 12:20 UTC
1 point
0
in reply to: JBlack’s comment on: How can I reconcile the two most likely requirements for humanities near-term survival.
We’re very good at generating existential risks. Given indefinite technological progression at our current pace, we are likely to get ourselves killed.

Erlja Jkdf. 30 Aug 2022 2:29 UTC
1 point
−2
in reply to: JBlack’s comment on: How can I reconcile the two most likely requirements for humanities near-term survival.
A technological plateau is strictly necessary. To give the simplest example; we lucked out on nukes. The next decade alone contains potential for several existential threats—readily made bioweapons, miniaturized drones, AI abuse—that I question our ability to consistently adapt too, particularly one after another.
We might get it, if our tech jumps thanks to exponential progress.