You could do a contaminated pretrain by making different fractions of the train set artificially bad math papers and see if it breaks math ability?
Hastings
Karma: 2,649
If its policy related and worth posting on lesswrong, it’s worth emailing to your senator or representative
Note that when computing averages, I am considering founding deepmind, founding open ai and founding anthropic to be ai safety contributor actions, as they were considered to be so at the time and we don’t get to use hindsight to go back and not do things.
Inventing RLHF also goes in the pot, as well as everyone who pushed naked capability research on LLMs on the theory that they were oracles and not agents and therefore safer.
The median ai safety contributor is good, the average ai safety contributor is very, very, bad. So please for the love of god consider optimizing for the sign of your impact instead of its magnitude.
If OpenAI wasn’t running all conversations with their models through a classifier to find the research mathematicians and adding them to the pre-train, they definitely are now, if nothing else just to see if the resulting performance lives up to the controversy.
the cat and mouse game is unwinnable if we are vastly dumber than the models. if pure alignment is impossible we need to shut down progress instead of whining that geopolitics is hard to our graves.
Actually idk if I’m even conspiracy posting as opposed to just reading the press releases. OpenAI very explicitly says they didn’t read the euler blowup transcripts, is clear as day that they didn’t mean to scoop the millenium prize, and no comment on whether they trained on the drafts.
At this point it seems like OOM half of all mathematicians are accelerating their work with AI. An AI pretrained on these transcripts (by accident?) wouldn’t just crack navier stokes, it would execute an omniscoop, breaking every open problem for which someone had the right idea but hadn’t published yet. the result would be a crazy step up in performance on open problems resulting from a tiny configuration change
(conspiracy posting, am very likely wrong)
Just buy three dryers, rotate which one is drying and which ones are storage. Intermittently tumble low to avoid wrinkles.
Keep clothes in laundry baskets, never fold. Garage-style sheet metal shelving holds laundry baskets well.
Keep matching outfits together in rubber banded rolls. Rubber band them back together out of the dryer instead of folding them, and when you take an outfit off, always take the whole outfit off and put it into one dirty bin. wash a dirty bin as a unit.
Use a laundry service explicitly so that someone else puts the clothes on hangars.
Use a trunk. RP as Harry Potter when accessing (mandatory)
Its worth looking at a big, H bomb or anti-matter orion drive from this thermal perspective. The reason it works despite needing to dissipate such vast amounts of waste heat is that the inefficiency-generated heat mostly goes into warming the non-fuel components of the reactor (specifically, blasting those components into multi million degree plasma). More goes into heating the pusher plate surface or sail to extreme temps, where it is removed by ablation (plate) or radiation (sail) without having to be moved to a radiator by pumps. Brb with actual math.
The radiators still need to dissipate heat from the shock absorbers, but at 1g this power is of scale (ship mass * relative velocity of ship and plate squared) not (ship mass * relative velocity of ship and exhause squared)
You’re not currently at risk of standing on your fire escape on Judgement Day and watching swarms of AI killer drones descend on my city and thinking “fuck, I shouldn’t have done that”. It’s a low bar, but if we can get everyone who came in with dreams of saving humanity from AI over that bar and into your high company, we’ll be a lot closer to the “see the suicide button and not press it” good ending.
This is a general argument that proves it’s bad when leftists do good things, based on the claim-about-the-world that for any action they take, America as a collective will take action to not only cancel their action but go past zero in the opposite direction.
One might suspect that if this is the case, the problem isn’t the leftists.
6 months, 500 brick making schools and 30 bricks later...
Well, the state isn’t planning to kill me personally, and anthropic is planning to at least give the ol russian roulette wheel a spin in that regard. They expect that if they don’t someone else will. Or maybe the state is, depending on how stable we think the current MAD standoffs with Russia and China are. The analogy to the soviet nuclear program is pretty good, in that they were also explicitly gambling with everyone’s lives for complicated game theory reasons.
More on the subject of your footnotes 1 and 2 than your post, I was shocked at how instantly, when I turned thirty, my gut reactions flipped from “I love how the younger generations are experimenting with the boundaries of music” (100 gecs, mumble rap, tiktok 30 second songs) to “This isn’t music and you’re morally flawed for liking it” (suno basically)
Outside view, this is probably what every generation has felt as they aged.
Inside view, I’m objectively right that this development is bad, while previous generations were closed minded and lame.
Around 10% of the bibles Gutenberg printed survived 500 years, extrapolating gives 1% at 1000 years. I suspect there would be a shit ton of forkmaker literature floating about.
Wait we cover all our plastic in writing, by 1000 different processes. Our 1000 year ancestors can read a shampoo bottle while pooping same as we pre-smartphone-kids did
Eating breakfast, I’ve been looking around with 1000 year eyes. Almost everything has prose printed on it and text embossed, but the embossed text is low information- which states have which bottle deposit, the brand of whiskey I like. The novelty coffee mugs are the treasure trove, as they are glazed which will last millions of years, not thousands. If nothing else, the oaklanders are going to know damned well what pi is.
I see 1744.
Perhaps you have a browser extension blocking it?
Anthropic has an awesome opportunity to join openai’s pause. This is a glimmer of hope I haven’t seen in a while.
They might be saying “you don’t sell tokens to the highest bidder” but idk that could be far outside the overton window.
The book is hopelessly confused about the titular three body problem in ways that would be cleared up by spending ten minutes playing with an orbit simulator in Ti BASIC. I’m normally pretty patient about that kind of mistake in works like star wars but naming after a problem without ever looking at the problem paints a portrait of the author.
Like, it’s bad bad. The important instance of the three body problem in the book has four bodies, and this is the simplest issue to point out but not nearly the most severe