AI Misuse

TagLast edit: May 1, 2023, 5:42 PM by Raemon

AI misuse. Humans using AI in a way that harms humanity.

Adversarial Robustness Could Help Prevent Catastrophic Misuse

aogDec 11, 2023, 7:12 PM

30 points

9 votes

Overall karma indicates overall quality.

18 comments9 min readLW link

Managing catastrophic misuse without robust AIs

ryan_greenblatt and Buck

Jan 16, 2024, 5:27 PM

63 points

23 votes

Overall karma indicates overall quality.

17 comments11 min readLW link

Distinguishing misuse is difficult and uncomfortable

lemonhopeMay 1, 2023, 4:23 PM

17 points

10 votes

Overall karma indicates overall quality.

3 comments1 min readLW link

Proposal: Align Systems Earlier In Training

OneManyNoneMay 16, 2023, 4:24 PM

18 points

8 votes

Overall karma indicates overall quality.

0 comments11 min readLW link

Misalignment or misuse? The AGI alignment tradeoff

Max_He-HoJun 20, 2025, 10:43 AM

3 points

2 votes

Overall karma indicates overall quality.

0 comments1 min readLW link

(forum.effectivealtruism.org)

Human study on AI spear phishing campaigns

Simon Lermen, Fred Heiding and Andrew Kao

Jan 3, 2025, 3:11 PM

81 points

35 votes

Overall karma indicates overall quality.

8 comments5 min readLW link

Proposal: we should start referring to the risk from unaligned AI as a type of accident risk

Christopher KingMay 16, 2023, 3:18 PM

22 points

15 votes

Overall karma indicates overall quality.

6 comments2 min readLW link

On excluding dangerous information from training

ShayBenMosheNov 17, 2023, 11:14 AM

23 points

11 votes

Overall karma indicates overall quality.

5 comments3 min readLW link

Visual Prompt Injections: Results on testing AI spam-defense and AI vulnerability to deceptive web ads.

Seon GunnessJun 3, 2025, 8:10 PM

4 points

4 votes

Overall karma indicates overall quality.

0 comments12 min readLW link

Scalable And Transferable Black-Box Jailbreaks For Language Models Via Persona Modulation

Soroush Pour, rusheb, Quentin FEUILLADE--MONTIXI, Arush and scasper

Nov 7, 2023, 5:59 PM

38 points

22 votes

Overall karma indicates overall quality.

2 comments2 min readLW link

(arxiv.org)

Technical Risks of (Lethal) Autonomous Weapons Systems

HerambOct 23, 2024, 8:41 PM

2 points

1 vote

Overall karma indicates overall quality.

0 comments1 min readLW link

(encodejustice.org)

How to solve the misuse problem assuming that in 10 years the default scenario is that AGI agents are capable of synthetizing pathogens

jeremttiNov 27, 2024, 9:17 PM

6 points

4 votes

Overall karma indicates overall quality.

0 comments9 min readLW link

Covert Malicious Finetuning

Tony Wang and dannyhalawi

Jul 2, 2024, 2:41 AM

94 points

41 votes

Overall karma indicates overall quality.

4 comments3 min readLW link

No comments.

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer