Executive Director at AI Safety Poland
Data Science Consultant with experience in Finance, Insurance, Retail, and AdTech
volunteer at EA Poland
based in PoznaĹ, Poland
trains BJJ & bouldering
Jakub K. Nowakđ¸
Karma: 10
This is another reply in this vein, Iâm quite new to this so donât feel obliged to read through. I just told myself I will publish this.
I agree (90-99% agreement) with almost all of the points Eliezer made. And the rest is where I probably didnât understand enough or where thereâs no need for a comment, e.g.:
1. â 8. agree
9. Not sure if I understand it rightâif the AGI has been successfully designed not to kill everyone then why need oversight? If it is capable to do so and the design fails then on the other hand what would our oversight do? I donât think this is like the nuclear cores. Feels like itâs a bomb you are pretty sure wonât go off at random but if it does your oversight wonât stop it.
10. â 14. - agree
15. - I feel like I need to think about it more to honestly agree.
16. â 18. - agree
19. - to my knowledge, yes
20. â 23. - agree
24. - initially I put â80% agreeâ to the first part of the argument here (thatThe complexity of what needs to be aligned or meta-aligned for our Real Actual Values is far out of reach for our FIRST TRY at AGI
but then discussing it with my reading group I reiterated this few times and begun to agree even more grasping the complexity of something like CEV.
25. â 29. - agree
30. - agree, although wasnât sure aboutan AI whose action sequence you can fully understand all the effects of, before it executes, is much weaker than humans in that domain
I think that the key part of this claim is âall the effects ofâ and I wasnât sure whether we have to understand all, but of course we have to be sure one of the effects is not human extintion then yes, so for âsolving alignmentâ also yes.
31. â 34. - agree
35. - no comment, I have to come back to this once I graps LDT better
36. - agree
37. - no comment, seems like a rant đ
38. - agree
39. - ok, I guess
40. - agree, Iâm glad some people want to experiment with the financing of research re 40.
41. - agree , although I agree with some of the top comments on this, e.g. evhubâs
42. - agree
43. - agree, at least this is what it feels like
is there any society where people are ostracised for not possessing difficult skills?
Depending on what you call âdifficultâ. I think you will try to fit in if 80%+ of your peers know the skill, but OTOH if 80%+ people know have the skill then is it âdifficultâ?
In gen pop I feel this way about driving carsâsome people hate it and have to deal with a lot of stress/âanxiety to learn this skills and although they could live without it. But living without it means they canât do some of the thingsâthey have less power.
Iâd say then the power motivation (increase the space of your action) could be lumped together with the economic one or form a separate one.
Similar skill like thisâlearning a language. In gen pop itâs seldom the case unless you live in a country where 3â4 people know a second language (sadly not the case in my country). But it afaik it worked in the past with some elite societes where people learned french (lingua franca) or greek or latin or something to fit in. Languages also increase the space of your actions (you can understand more by yourself, talk to more people etc.) so this again could be âpowerâ motivated.
I came here for this tip specifically to read Kajâs sequence as well! Used this plugin for now but I hope it becomes a feature.
Is the Slack still active? The link to join is not.