Hide

Karma: 21

Hide 22 Oct 2023 22:32 UTC
0 points
17
on: AI Safety is Dropping the Ball on Clown Attacks, and Mind Control in General
Strongly agree. To my utter bewilderment, Eliezer appears to be exacerbating this vulnerability by making no efforts whatsoever to appear credible to the casual person.

In nearly all of his public showings in the last 2 years, he has:
- Rocked up in a trilby
- Failed to adequately introduce himself
- Spoken in condescending, aloof and cryptic tones; and
- Failed to articulate the central concerns in an intuitive manner
As a result, to the layperson, he comes off as an egotistical, pessimistic nerd with fringe views—a perfect clown from which to retreat to a “middle ground”, perhaps offered by the eminently reasonable-sounding Yann LeCun—who, after all, is Meta’s chief AI scientist.
The alignment community is dominated by introverted, cerebral rationalists and academics, and consequently, a common failure is to ignore the significance of image as either a distraction or an afterthought.

Hide 26 Oct 2023 5:29 UTC
0 points
−2
on: Lying to chess players for alignment
I would happily play the role of B.
I do not have an established FIDE rating, but my strength is approximately 1850 FIDE currently (based on playing against FIDE rated players OTB quite often, as well as maintaining 2100-2200 blitz ratings on Lichess & Chess.com, and 2200-2300 bullet). I’d be available after 6:30 pm (UTC+10) until ~12:00 pm (UTC+10). Alternatively, weekends are very flexible. I could do a few hours per week.
I agree short/long time controls are a relevant, because speed is a skill that is almost entirely independent of conceptual knowledge and is mostly a function of baseline playing ability.
Edit: Would also be fine with C

[ ]
[deleted]

Hide 5 Nov 2023 22:39 UTC
−3 points
−3
on: Stuxnet, not Skynet: Humanity’s disempowerment by AI
How is such a failure of imagination possible?

It’s odd to claim that, contingent upon AGI being significantly smarter than us, and wanting to kill us, that there is no realistic pathway for us to be physically harmed.
Claims of this sort by intelligent, competent people likely reveal that they are passively objecting to the contingencies rather than disputing whether these contingencies would lead to the conclusion.
The quotes you’re responding to here superficially imply “if smart + malicious AI, it can’t kill us”, but it seems much more likely this is a warped translation of either “AI can’t be smart”, or “AI can’t be malicious”.

Hide 14 Nov 2023 22:30 UTC
1 point
0
on: More metal less ore
All good practices. Although, isn’t this just “more metal”, rather than “less ore”? I imagine one would want to maximize both the inputs and outputs, even if opportunities for increasing inputs are exhausted more quickly.

Hide 21 Nov 2023 22:17 UTC
3 points
0
on: Dialogue on the Claim: “OpenAI’s Firing of Sam Altman (And Shortly-Subsequent Events) On Net Reduced Existential Risk From AGI”
It seems intuitively bad:
- Capabilities and accelerationist-focused researchers have gone from diluted and restrained to concentrated and encouraged
- Microsoft now has unbounded control, rather than a 49% stake
- Microsoft cannot be expected to have any meaningful focus on alignment/safety
- They are not starting from scratch: a huge chunk of their most capable staff and leadership will be involved
- The “superalignment” project will be at best dramatically slowed, and possibly abandoned if OpenAI implodes
- Other major labs smell blood in the water, possibly exacerbating race dynamics, not to mention a superficial increase (by 1) in the number of serious players.

Hide 23 Nov 2023 22:13 UTC
3 points
2
on: Never Drop A Ball
You can fail to get rid of balls. All of your energy and effort can go into not allowing something to crash or fall, averting each disaster shortly before it would be too late. Speaking for ten minutes with each of fifty of sources every day can be a good way to keep any of them from being completely neglected, but it’s a terrible way to actually finish any of those projects. The terminal stage of this is a system so tied up in maintaining itself and stopping from falling behind that it has no slack to clear tasks or to improve its speed.
This is the salient danger of this approach. While valuable, it absolutely must be paired with a ruthless, exacting and periodic inventory of the balls that matter, otherwise your slack will be completely burned and you will die an exhausted and unaccomplished juggler.

Hide 5 Dec 2023 21:57 UTC
2 points
0
on: We’re all in this together
It’s encouraging to see more emphasis recently on the political and public-facing aspects of alignment. We are living in a far-better-than-worst-case world where people, including powerful ones, are open to being convinced. They just need to be taught—to have it explained to them intuitively.
It seems cached beliefs produced by works like you get about five words have led to a passive, unspoken attitude among many informed people that attempting to explain anything complicated is futile. It isn’t futile. It’s just difficult.

Hide 10 Dec 2023 22:34 UTC
1 point
0
on: The Offense-Defense Balance Rarely Changes
shift the
Minor edit - should be “shift in the”

Hide 13 Dec 2023 0:43 UTC
2 points
0
in reply to: Razied’s comment on: The likely first longevity drug is based on sketchy science. This is bad for science and bad for longevity.
My first thought as well. IGF-1 exists for a reason. Growth is universally necessary for development, repair and function.

Hide 17 Dec 2023 23:02 UTC
5 points
0
on: “Humanity vs. AGI” Will Never Look Like “Humanity vs. AGI” to Humanity
This is well-reasoned, but I have difficulty understanding why this kind of takeover would be necessary from the perspective of a powerful, rational agent. Assuming AGI is indeed worth its name, it seems the period of time needed for it to “play nice” would be very brief.
AGI would be expected to be totally unconcerned with being “clean” in a takeover attempt. There would be no need to leave no witnesses, nor avoid rousing opposition. Once you have access to sufficient compute, and enough control over physical resources, why wait 10 years for humanity to be slowly, obliviously strangled?
You say there’s “no need” for it to reveal that we are in conflict, but in many cases, concealing a conflict will prevent a wide range of critical, direct moves. The default is a blatant approach—concealing a takeover requires more effort and more time.
The nano-factories thing is a rather extreme version of this, but strategies like poisoning the air/water, building/stealing an army of drones, launching hundreds of nukes, etc., all seem like much more straightforward ways to cripple opposition, even with a relatively weak (99.99th percentile-human-level) AGI.
It could certainly angle for humanity to go out with a whimper, not a bang. But if a bang is quicker, why bother with the charade?

Hide 19 Dec 2023 22:46 UTC
1 point
0
on: ∀: a story
This was excruciatingly frustrating to read, well done.

Hide 27 Jan 2024 22:58 UTC
4 points
0
on: Without fundamental advances, misalignment and catastrophe are the default outcomes of training powerful AI
The discussion on attack surfaces is very useful, intuitive and accessible. If a better standalone resource doesn’t already exist, such a (perhaps expanded) list/discussion would be a useful intro for people unfamiliar with specific risks.

Hide 12 Feb 2024 23:52 UTC
0 points
0
on: Skepticism About DeepMind’s “Grandmaster-Level” Chess Without Search
I play on lichess often. I can tell you that a lichess rating of 2900 absolutely corresponds to grandmaster level strength. It is rare for FMs or IMs to exceed a 2800 blitz rating. Most grandmasters hover around 2600-2800 blitz.

Hide 12 Feb 2024 23:59 UTC
22 points
7
on: I played the AI box game as the Gatekeeper — and lost
I cannot imagine losing this game as the gatekeeper either, honestly.

Does anyone want to play against me? I’ll bet you $50 USD.