Trying to become stronger.
hath
Karma: 1,224
Speaking to Congressional staffers about AI risk
I’d be interested in doing something resembling an interview/podcast, where my main role is to facilitate someone else talking about their models (and maybe asking questions that get them to look closer at blurry parts of their own models). If you have something you want to talk/write about, but don’t feel like making a whole post about it, consider asking me to do a dialogue with you as a relatively low-effort way to publish your takes.
Some potential topics:
What’s your organization trying to do? What are some details about the world that are informing your current path to doing that?
What are you spending your time on, and why do you think it’s useful?
What’s a common mistake (or class of mistake) you see people making, and how might one avoid it?
So, if you have something you want to talk about, and want to recruit me as an interlocutor/facilitator, let me know.
Took APCS (Java 101-102) in high school (culminating with coding Tetris in Java), read through Diveintopython3.net, done a bunch of miscellaneous programs in Python, lots of experience in Linux.
[APPRENTICE]:
For a bunch of these, the minimum viable product for mentoring me is a combination of pointing me to books/textbooks and checking in on me to make sure I actually do it.
Some things I’d like mentorship on:
People willing to review my writing, and accountability on spewing out a bunch of blog posts. (and maybe on starting an actual novel!)
Operations. I’ve run a couple large projects in the past, including a group house, and there’s a lot I can do better. Would love to hear from people who have run group houses or organizations in the past.
Economics: I have most of the 101-level stuff, but could use some more specific knowledge on labor econ. Especially curious about (banking) regulation.
Math: Besides teaching myself calculus and linear algebra, I haven’t really gotten into much complicated math; someone able to point me at more advanced stuff, ideally alignment-relevant, would be much appreciated.
Programming. Ideally, I’d go through a bunch of projects you suggest in Python, with you available for occasional debugging/querying, with the goal of eventually being able to do more technical alignment work.
The Apprentice Thread 2
Some notes on the Dialogue format:
Seems like a less effortful/more social way of writing—like glowfic, but for nonfiction!
Probably better at conveying more implicit knowledge, like interviews do (maybe?)
Just because it’s public doesn’t mean we won’t stop adding pieces to the dialogue; Elizabeth and I still have a lot to say.
Day 1, adding ~500 words of nuance.
A lot of these models are “this was my lived experience, it seems to generalize a fair bit”. I sent out an interest form to see how much demand there was for something like this, as a way to test whether it did in fact generalize a bunch to other people, and it got a lot of responses.
Default BATNA to high school is “live by yourself, maybe on a grant, while you self-teach or work on a project”. I did this! It sucked!
Solo productivity is hard. Creating systems that help you get work/studying done every day, without external deadlines and check-ins, is really difficult. Also, I have pretty bad ADHD, which means that my default for extended periods of working alone involves forgetting to eat, take my ADHD medication, or do anything productive whatsoever during the day.
I care a lot about seeing friends, and don’t really have a lot of ways to do that, especially because most of my really good friends are scattered across the US and Europe.
Being stuck at home is corrosive for a bunch of reasons that aren’t always immediately apparent. Some of this is due to the loss of the counterfactual environment, and some of this is due to specific details about people’s home lives.
Agency is a pretty important thing. By default, it gets crushed. Giving people power over their own lives, and encouraging them when they do weird things, helps turn them into the kind-of-person who comes up with weird new things to do that would help their lives, and overall makes the world a better place.
A lot of people who have the potential to do a lot of great things have their creativity and agency crushed by The System and their parents. The K-12 education system isn’t centrally designed to do any one thing, but the result of the system is that your creativity and independence is crushed. The parents of really smart kids can be slightly obtuse and limiting at best and controlling and manipulative at worst. I know people who were forced to do double-digit hours of test prep every week.
Living on your own, and not being forced to adhere to (arbitrary) external goals and standards, does a lot to help people acquire the generalized skills of actually making their own decisions and guiding their own paths and stuff. I have a lot of other thoughts on agency, some of which can be seen here, but “internal vs. external locus of control” is pretty central to the thing here. The key is getting people to see themselves as agents in the world taking actions according to their own desires/ambitions, as opposed to executing strategies that other people/their broader culture has set out for them. Again, I need to write more about this, but this is a good first pass.
Things like coworking are pretty good for long-term productivity.
The key is social accountability. I’d estimate that, for me, having all of my work hours be coworking of some form as opposed to [puttering around and occasionally doing productive things] results in doubling my actual output. Being in a work/living environment where coworking is a readily available default would then be a huge improvement on its own.
Super rough expansion of the first couple bullet points, Day 0:
Intro:
Why write this?
I’m writing this post because I have a bunch of models about group houses, minors, and the combination of the two that I think other people might be interested in. I also want to have some publicly available thing I can point to that says what this whole thing is about.
Short version of what this was.
Ascension Beta was a month-long experimental group house I ran in October 2022, with participants aged 16-22. It was intended primarily as a test of the below models (to see if a larger, longer-running version was worthwhile) and a chance to practice running a group house of this type, working out the major kinks before running a longer version.
The major goals of Ascension were to give residents social accountability, agency over their environment, and community.
Why run Ascension (short version)
Because I wanted it to exist (so I could live there), other people wanted it to exist for the same reason, and nobody else was going to step up and make it happen. I had a lot of models about agency, environment, and productivity, and in particular a specific kind of environment I wanted to live in. However, it didn’t exist, especially not for minors. I also hypothesized that the people I had met who were similar to me would also want this to exist, and that was borne out by the evidence. There are a bunch of reasons for why Ascension provides value to these people, and that’s what most of this post is about.
Models:
Most important model here: it worked. Everything below is mostly informed by that, and the beta was a really good way to develop those models.
Before I ran the beta, I was pretty uncertain about some of these models. My models on high school and agency were fairly strong, but everything about how something like Ascension would actually function in practice was fairly blurry. However, the beta, while janky, proved that something like Ascension could work, and that it was likely for some longer/larger version to be more effective.
High school, as an institution, is really bad.
It’s a waste of time that destroys your agency and love for learning. I could go in-depth on the specific reasons why it’s so bad, but for now, just keep in mind that the default societal path here is four years in hell that takes up as much of your Slack as possible. This means that really smart/ambitious people, the kind that you meet at programs like Atlas or SPARC, often have to find their own ways out of high school to actually do the things they care about. There mostly does not exist infrastructure to support alternate pathways for these people. There are small bits of it, notably Emergent Ventures for funding your endeavors during this time, but the majority of the things that you would have on the default pathway of high school + college (housing, peers, “learning”) have to be found for yourself; most of the time, the hand-rolled solutions that you find will fail you.
Default BATNA to high school is “live by yourself, maybe on a grant, while you self-teach or work on a project”. I did this! It sucked!
Solo productivity is hard.
Going insane due to loneliness.
Being stuck at home is really really bad for a bunch of reasons that aren’t always immediately apparent.
I’m writing up my models on why my pet project, Ascension, is a good idea. This is the outline. As I expand the post, I’ll add the incremental bits as comments.
Intro:Why write this?
Short version of what this was.
Why run Ascension (short version)
Models:
Most important model here: it worked. Everything below is mostly informed by that, and the beta was a really good way to develop those models.
High school, as an institution, is absolutely dog shit.
Signaling race to the bottom that sucks up all of your time.
Default BATNA to high school is “live by yourself, maybe on a grant, while you self-teach or work on a project”
I did this! It fucking sucked!
Agency is a pretty important thing. By default, it gets crushed. Giving people power over their own lives, and encouraging them when they do weird things, helps turn them into the kind-of-person who comes up with weird new things to do that would help their lives, and overall makes the world a better place.
A lot of people who have the potential to do a lot of great things have their creativity and agency crushed by The System and their parents.
Things like coworking are pretty good for long-term productivity.
There are a bunch of other systems that can be implemented individually and on the scale of groups to make people more productive. Think to-do lists, or morning standup meetings.
Dealing with minors, in general, fucking sucks.
You have to be accountable to parents
They don’t have rights under the law to do a bunch of things
You’re exposed to a lot more liability in general
Also, a lot of people just, like, don’t really want to deal with most teenagers that much?
As a result of this, the housing situation for minors in the bay is close to nonexistent.
Arcadia, the closest thing to Ascension that exists, is pretty good, but not aimed at the exact kind of things I care about here, and also they don’t exactly have a no-minor policy, but they do have strict scrutiny around allowing minors.
There exist these weird niche communities around really smart, young, promising people, like Atlas/ESPR/SPARC and EV.
It’s fucking incredible for people in those communities to spend time with other people in those communities. Yet, because when you’re selecting on the scale of 1⁄1,000 or 1⁄10,000, you end up pretty far on average from other people like you.
Also, it’s useful for people to have some way of getting into these groups.
The Bay community in general is fucking amazing, and being in a house that is part of that larger community is amazing.
Having people well into their career who can serve as mentorship-ish figures is also really good.
Weird rituals and group activities are awesome! People don’t get enough of those by default.
Having weird rationalist customs of betting and such, as group norms, is pretty cool.
Also, having a tight-knit group of people you live with, who you very much respect and know well, is great for social stuff.
Dath ilani coordination, where people choose Stag as a group.
Dragon Army was cool and all, but MAN do I not have the leadership knowledge/ability to run something with that much centralization of power.
As it happens, neither did Duncan, according to him.
You’ll also note that the Dragon Army Theory post was mostly Duncan explaining different group dynamics problems, and trying to fix it with his group house, whereas this is more me explaining a bunch of societal problems that lead to people misjudging minors for this sort of thing.
For the demographic of teenagers who are likely to be at Ascension, the risks involved aren’t necessarily what you’d think of. They don’t drink, they don’t take (depressant) drugs. The actual risks that I’d be worried about are people getting depressed and romantic drama.
Though, a large part of this is due to me being pretty selective with who I invite.
Running stuff like “everyone in the house gets together to work on blog posts” results in many more blog posts being written than there would be otherwise.
So, like, what does all of this look like?
Why am I writing this? Because I have a bunch of models about group houses, minors, and the combination of the two that I think other people might be interested in. I also want to have some publicly available thing that I can point to that says what this whole thing is about.
I’m reminded of Falsehoods Programmers Believe About Names, an essay on the problems with handling “weird” data inputs that are normal for the people involved.
Not sure if this would help, but I’m also a 16 year old[1]who’s been reading LW for a bit over two years, and who doesn’t think that taking most drugs is a great idea (and have chosen not to e.g. drink alcohol when I’ve had the opportunity to). I don’t think all drugs are bad (I have an Adderall prescription for my ADHD) but the things your son mentioned seem likely to harm him. If he wanted to talk to me about it, he can PM me on LW or message me on Discord @ sammy!#0521.
As someone who often has… disagreements with their parents, sometimes it’s easier to rationally think about something if a peer brings it up. Also, I remember a long period of my life when I didn’t really have friends of my own intelligence, and that sucked. Possibly that has something to do with this.
- ^
LessWrong admins (like Ruby) can verify this, they’ve met me IRL.
- ^
[Linkpost] The Story Of VaccinateCA
Meritxell has made the serious error of mentioning that she didn’t fully grasp some of what Keltham said earlier about stock companies.
Keltham is currently explaining how a Lawful corporation has an internal prediction market, which forecasts the observable results on running various possible projects that company could be trying, which in turn is used to generate an estimate of marginal returns on marginal internal investment; this prevents a corporation from engaging in obvious madness like accepting an internal project with 6% returns while turning down another internal project with expected 10% returns.
The wider market, obviously, would also like to invest all its money where it’ll get the highest returns; but it’s usually not efficient to offer the broader market a specialized sub-ownership of particular corporate subprojects, since the ultimate usefulness of corporate subprojects is usually dependent on many other internal outputs of the company. It doesn’t do any good to have a ‘website’ without something to sell from it. Sure, if everyone was an ideal agent, they’d be able to break things down in such a fine-grained way. But the friction costs and imperfect knowledge are such that it’s not worth breaking companies into even smaller ownable pieces. So the wider stock market can only own shares of whole corporations, which combine the outputs and costs of all that company’s projects.
Thus any corporation continuously buys or sells its own stock, or rather, has standing limit orders into the stock market to buy various quantities if the price goes low or sell various quantities if the price goes high, at prices that company sets depending on its internal belief about the returns from investing or not investing in the marginal subprojects being considered. If the company isn’t considered credible by the wider market, its stock will go lower and the company will automatically buy that stock, which leaves them less money to invest in new projects internally, and means that they only invest in projects with relatively higher returns—doing less total investment, but getting higher returns on the internal investments that they do start. Conversely if the wider market thinks a company’s promises to do a lot with money are credible, the stock price will go up and money will flow into that company until they no longer have internal investment prospects that credibly beat the broader market.
This may sound complicated, and it is probably a relatively more complicated part of the machinery that is necessarily implied by the existence of distinct stock corporations in the first place. But the alternative, if you zoom out and look at the whole planet of dath ilan, is that a corporation in one place would be investing in a project with internally expected returns of 6%, and somebody on the other side of the planet would be turning down a project with market-credible returns of 10%, which means you could reorganize the whole planet and do better in a predictable way. So whatever does happen as a consequence of the existence of stock corporations, it has to be not that.
Some quotes from Planecrash that I might collect into a full post:
Upcoming Posts
Now that I’m back from [Atlas Fellowship+SPARC+EAG+Future Forum], I have some post ideas to write up. A brief summary:
Agency and Authority, an actual in-depth, gears-level explanation of agency, parenting, the two kinds of respect, moral conflation with that respect, the fact that those in power are incentivized to make their underlings more legible and predictable to them, arbitrarily high punishments and outcome matrices, absolute control and concessions, incentives for those not in power and how those incentives turn you into less of an agent, and how the best solution is to create a “good person who follows orders” mask that hopefully never breaks or bleeds into the rest of your character, and then use that mask while you plot to get out of the situation.
I’ve gotten the same questions a couple times from different people, and want to just write up the responses as a post, so I don’t have to go back and rewrite them.
How did you get into rationality/EA/alignment?
Why did you hate high school so much?
What was [Atlas/SPARC/EAG/FF] like?
What’s it like being a minor in those communities?
So, what exactly do you do? Well, okay, what are you planning to do?
There was a lightning talk I gave at SPARC and Future Forum, which I ended up teaching as a full-on class at SPARC, called Memento, Memory, and Note-Taking. I want to develop that as a full post.
I also want to migrate all of my notes from Obsidian to Notion, and have some plans for what I want to include in my Notion; this will probably make it onto LW at some point.
I’ve also made some progress on what I call “putting myself back together” and this is, in retrospect, what I have spent the past month doing. I might publicly reflect on some of the personal growth and introspection I’ve done during that time.
I’d like to write “An Intro to Rationalist Culture” at some point, because it’s incredible to see the different social norms that rationalists have developed, the most important prerequisite being the ability to see and talk about social norms on the meta-level, and changing said norms as a result.
There’s also some other ideas that seem important to me:
Fleshing out what “hath culture” looks like
I need to figure out how to live in a world on fire; writing down how I cope with that now might help.
This isn’t even a definitive list of all the post ideas I have (the actual list is like 5x the size) but these are the ones I plan on writing soon.
I’ll be at Capla-Con this weekend, if anyone else here is going.
I’m really sorry to hear that, man. It’s honestly a horrible thing that this is what happens to so many people; it’s another sign of a generally inadequate civilization.
For what it’s worth, the first chapter of Smarter Faster Better is explicitly on motivation, and how to build it from nothing. It mentions multiple patients with brain injuries who were able to take back control over their own lives because someone else wanted to help them become agentic. I think reading that might help.
On another note, thank you for being open about this. I appreciate all comments on my posts, especially the ones actively related to the subject; your comment wasn’t complaining, and it was appreciated. Best of luck to you in the future.
Cultivating And Destroying Agency
Not only is this post great, but it led me to read more James Mickens. Thank you for that! (His writings can be found here).
I might start a newsletter on the economics of individual small businesses. Does anyone know anyone who owns or manages e.g. a restaurant, or a cafe, or a law firm, or a bookstore, or literally any kind of small business? Would love intros to such people so that I can ask them a bunch of questions about e.g. their main sources of revenue and costs or how they make pricing decisions.