This site is a cognitohazard. Use at your own risk.
PhilosophicalSoul
In my opinion, a class action filed by all employees allegedly prejudiced (I say allegedly here, reserving the right to change ‘prejudiced’ in the event that new information arises) by the NDAs and gag orders would be very effective.
Were they to seek termination of these agreements on the basis of public interest in an arbitral tribunal, rather than a court or internal bargaining, the ex-employees are far more likely to get compensation. The litigation costs of legal practitioners there also tend to be far less.
Again, this assumes that the agreements they signed didn’t also waive the right to class action arbitration. If OpenAI does have agreements this cumbersome, I am worried about the ethics of everything else they are pursuing.
For further context, see:- 29 May 2024 14:11 UTC; 5 points) 's comment on OpenAI: Fallout by (
I think these points are common sense to an outsider. I don’t mean to be condescending, I consider myself an outsider.
I’ve been told that ideas on this website are sometimes footnoted by people like Sam Altman in the real world, but they don’t seem to ever be applied correctly.
It’s been obvious from the start that not enough effort was put into getting buy-in from the government. Now, their strides have become oppressive and naive (the AI Act is terribly written and unbelievably complicated, it’ll be three-five years before it’s ever implemented).
Many of my peers who I’ve introduced to some arguments on this website who do not know what alignment research is identified many of these ‘mistakes’ at face value. LessWrong got into a terrible habit of fortifying an echo chamber of ideas that only worked on LessWrong. No matter how good an idea, if it cannot be simply explained to the average layperson, it will be discarded as obfuscatory.
Hero worship & bandwagons seems to be a problem with the LessWrong community inherently, rather than something unique to the Alignment movement (again, I haven’t been here long, I’m simply referring to posts by long-time members critiquing the cult-like mentalities that tend to appear).
Advocating for pause—well duh. The genie is out of the bottle, there’s no putting it back. We literally cannot go back because the gravy train of money in the throats of those with the power to change things aren’t going to give that up.
I don’t see these things as mistakes but rather common-sense byproducts of the whole: “We were so concerned with whether we could, we didn’t ask whether we should,” idea. The LessWrong community literally couldn’t help itself, it just had to talk about these things as rationalists of the 21st century.
I think… well, I think there may be a 10-15% chance these mistakes are rectified in time. But the public already has a warped perception of AI, divided on political lines. LessWrong could change if there was a concerted effort—would the counterparts who read LessWrong also follow? I don’t know.
I want to emphasise here, since I’ve just noticed how many times I mentioned LW, I’m not demonising the community. I’m simply saying that, from an outsider’s perspective, this community held promise as the vanguards of a better future. Whatever ideas it planted in the heads of those at the top a few years ago, in the beginning stages of alignment, could’ve been seeded better. LW is only a small cog of blame in the massive machine that is currently outputting a thousand mistakes a day.
This is probably one of the most important articles in the modern era. Unbelievable how little engagement it’s gotten.
I would be very interested to see a broader version of this post that incorporates what I think to be the solution to this sort of hivemind thinking (Modern Heresies by @rogersbacon) and the way in which this is engineered generally (covered by AI Safety is dropping the ball on clown attacks by @trevor). Let me know if that’s not your interest; I’d be happy to write it.
This was so meta and new to me I almost thought this was a legitimately real competition. I had to do some research before I realised ‘qualia splintering’ is a made up term.
Would love to collaborate with you on a post, check out my posts and let me know.
I have reviewed his post. Two (2) things to note:
(1) Invalidity of the NDA does not guarantee William will be compensated after the trial. Even if he is, his job prospects may be hurt long-term.
(2) State’s have different laws on whether the NLRA trumps internal company memorandums. More importantly, labour disputes are traditionally solved through internal bargaining. Presumably, the collective bargaining ‘hand-off’ involving NDA’s and gag-orders at this level will waive subsequent litigation in district courts. The precedent Habryka offered refers to hostile severance agreements only, not the waiving of the dispute mechanism itself.
I honestly wish I could use this dialogue as a discrete communication to William on a way out, assuming he needs help, but I re-affirm my previous worries on the costs.
I also add here, rather cautiously, that there are solutions. However, it would depend on whether William was an independent contractor, how long he worked there, whether it actually involved a trade secret (as others have mentioned) and so on. The whole reason NDA’s tend to be so effective is because they obfuscate the material needed to even know or be aware of what remedies are available.
- 17 May 2024 8:18 UTC; 16 points) 's comment on Ilya Sutskever and Jan Leike resign from OpenAI [updated] by (
It seems increasingly plausible that it would be in the public interest to ban non-disparagement clauses more generally going forward, or at least set limits on scope and length (although I think nullifying existing contracts is bad and the government should not do that and shouldn’t have done it for non-competes either.)
I concur.
It should be noted though; we can spend all day taking apart these contracts and applying pressure publicly but real change will have to come from the courts. I await an official judgment to see the direction of this issue. Arguably, the outcome there is more important for any alignment initiative run by a company than technical goals (at the moment).
How do you reconcile keeping genuine cognito hazards away from the public, while also maintaining accountability & employee health? Is there a middle ground that justifies the existence of NDAs & NDCs?
MMASoul this competition is real. You’ve already undergone several instances of qualia splintering. I guess we’ll have to start over sigh.
This is test #42, new sample of MMAvocado. Alrighty, this is it.
MMASoul: has a unique form of schizosyn; a 2044 phenomenon in which synaesthesia and schizophrenia have combined in the subject due to intense exposure to gamma rays and an unhealthy amount of looped F.R.I.E.N.D.S episodes. In this particular iteration, MMASoul believes it is “reacting” to a made-up competition instead of a real one. Noticeably, MMASoul had their eyes closed the entire time, instead reading braille from the typed keys.
Some members of our STEM Club here at the University think this can generate entirely unique samples of MMAvocado, which will be shared freely among other contestants. Further, we shall put MMASoul to work in making submissions of what MMAvocado would have created if he had actually entered this competition.
PS: MMASoul #40 clicked on the ‘Lena’ link and had to be reset and restrained due to mild psychosis.
I’ve been using nootropics for a very long time. A couple things I’ve noticed:
1) There’s little to no patient-focused research that is insightful. As in, the research papers written on nootropics are written from an outside perspective by a disinterested grad student. In my experience, the descriptions used, symptoms described, and periods allocated are completely incorrect;
2) If you don’t actually have ADHD, the side-effects are far worse. Especially long-term usage. In my personal experience, those who use it without the diagnosis are more prone to (a) addiction, (b) unexpected/unforeseen side-effects, and (c) a higher chance of psychosis, or comparable symptoms;
3) There seems to be an upward curve of over-rationalising ordinary symptoms the longer you use nootropics. Of course, with nootropics you’re inclined to read more, and do things that will naturally increase your IQ and neuroplasticity. As a consequence, you’ll begin to overthink whether the drugs you’re taking are good for you or not. You’ll doubt your abilities more and be sceptical as to where your ‘natural aptitude’ ends, and your ‘drug-heightened aptitude’ begins.
Bottomline is: if you’re going to start doing them, be very, very meticulous in writing down each day in a journal. Everything you thought, experienced and did. Avoid nootropics if you don’t have ADHD.
The quote’s from Plato, Phaedrus, page 275, for anyone wondering.
Great quote.
I found this post meaningful, thank you for posting.
I don’t think it’s productive to comment on whether the game is rational, or whether it’s a good mechanism for AI safety until I myself have tried it with an equally intelligent counterpart.
Thank you.
Edit: I suspect that the reason why the AI Box experiment tends to have many of the AI players winning is exactly because of the ego of the Gatekeeper in always thinking that there’s no way I could be convinced.
Got it, will do. Thanks.
And yes, I am building up to it haha. The Solakios technique is my own contribution to the discourse and will come about in [Part V]. I’m trying to explain how I got there before just giving the answer away. I think if people see my thought process, and the research behind it, they’ll be more convinced by the conclusion.
I think when dealing with something like ‘photographic memory’ which is a highly sought after skill, but has not actually been taught (those ‘self-help guru’s’ have poisoned the idea of it) you have to be systematic. People are more than justified in being critical of these posts until I’ve justified how I got there.
Could we say then that the Second Foundation in Isaac Asimov’s Foundation series is a good example of Level 4? And an example of Level 5 might be Paul Atreides and the ability of precognition?
It was always going to come down to the strong arm of the law to beat AI companies into submission. I was always under the impression that attempts at alignment or internal company restraints were hypothetical thought experiments (no offence). This has been the reality of the world with all inventions, not just AI.
Unfortunately, both sides (lawyers & researchers) seem unwilling to find a middle-ground which accommodates the strengths of each and mitigates the misunderstandings in both camps.
Feeling pessimistic after reading this.
I’m so happy you made this post.
I only have two (2) gripes. I say this as someone who 1) practices/believes in determinism, and 2) has interacted with journalists on numerous occasions with a pretty strict policy on honesty.1. “Deep honesty is not a property of a person that you need to adopt wholesale. It’s something you can do more or less of, at different times, in different domains.”
I would disagree. In my view, ‘deep honesty’ excludes dishonesty by omission. You’re either truthful all of the time or you’re manipulative some of the time. There can’t be both.
2. “Fortunately, although deep honesty has been described here as some kind of intuitive act of faith, it is still just an action you can take with consequences you can observe.
Not always. If everyone else around you goes the mountain of deceit approach, your options are limited. The ‘rewards’ available for omissions are far less, and if you want to have a reasonably productive work environment, at least someone has to tell the truth unequivocally. Further, the ‘consequences’ are not always immediately observable when you’re dealing with practiced liars. The consequences can come in the form of revenge months, or, even years later.
Do you think there’s something to be said about an LLM feedback vortex? As in, teacher’s using ai’s to check student’s work who also submitted work created by AI. Or, judges in law using AI’s to filter through counsel’s arguments which were also written by AI?
I feel like your recommendations could be paired nicely with some in-house training videos, and external regulations that limit the degree / percentage involvement of AI’s. Some kind of threshold or ‘person limit’ like elevators have. How could we measure the ‘presence’ of LLM’s across the board in any given scenario?
I didn’t get that impression at all from ‘...for every point of IQ gained upon retaking the tests...’ but each to their own interpretation, I guess.
I just don’t see the feasibility in accounting for a practice effect when retaking the IQ test is also directly linked to the increased score you’re bound to get.
Alignment researchers are the youngest child, and programmers/Open AI computer scientists are the eldest child. Law students/lawyers are the middle child, pretty simple.
It doesn’t matter whether you use 10,000 students, or 100, the percentage being embarrassingly small remains the same. I’ve simply used the categorisation to illustrate quickly to non-lawyers what the general environment looks like currently.
“golden children” is a parody of the Golden Circle, a running joke that you need to be perfect, God’s gift to earth sort of perfect, to get into a Big 5 law firm in the UK.
I am a lawyer.
I think one key point that is missing is this: regardless of whether the NDA and the subsequent gag order is legitimate or not; William would still have to spend thousands of dollars on a court case to rescue his rights. This sort of strong-arm litigation has become very common in the modern era. It’s also just… very stressful. If you’ve just resigned from a company you probably used to love, you likely don’t want to fish all of your old friends, bosses and colleagues into a court case.
Edit: also, if William left for reasons involving AGI safety—maybe entering into (what would likely be a very public) court case would be counteractive to their reason for leaving? You probably don’t want to alarm the public by flavouring existential threats in legal jargon. American judges have the annoying tendency to valorise themselves as celebrities when confronting AI (see Musk v Open AI).