That one doesn’t route through ”… then people respond with bad thing Y” quite so heavily. Capabilities research just directly involves building a dangerous thing, independent of whether other people make bad decisions in response.
What about more indirect or abstract capabilities work, like coming up with some theoretical advance that would be very useful for capabilities work, but not directly building a more capable AI (thus not “directly involves building a dangerous thing”)?
And even directly building a more capable AI still requires other people to respond with bad thing Y = “deploy it before safety problems are sufficiently solved” or “fail to secure it properly”, doesn’t it? It seems like “good things are good” is exactly the kind of argument that capabilities researchers/proponents give, i.e., that we all (eventually) want a safe and highly capable AGI/ASI, so the “good things are good” heuristic says we should work on capabilities as part of achieving that, without worrying about secondary or strategic considerations, or just trusting everyone else to do their part like ensuring safety.
That one doesn’t route through ”… then people respond with bad thing Y” quite so heavily. Capabilities research just directly involves building a dangerous thing, independent of whether other people make bad decisions in response.
What about more indirect or abstract capabilities work, like coming up with some theoretical advance that would be very useful for capabilities work, but not directly building a more capable AI (thus not “directly involves building a dangerous thing”)?
And even directly building a more capable AI still requires other people to respond with bad thing Y = “deploy it before safety problems are sufficiently solved” or “fail to secure it properly”, doesn’t it? It seems like “good things are good” is exactly the kind of argument that capabilities researchers/proponents give, i.e., that we all (eventually) want a safe and highly capable AGI/ASI, so the “good things are good” heuristic says we should work on capabilities as part of achieving that, without worrying about secondary or strategic considerations, or just trusting everyone else to do their part like ensuring safety.