I was born in July 1989, which means I am of the last generation who will remember the time before the internet. The cables and data centers and hyperlinks grew up around me; they grew with me. I find it hard to disentangle the evolution of my psyche from that of the internet.
Explaining it to my daughter, who was born in 2017, a year when the world’s largest economy had begun tearing itself apart from the tension of this ever-evolving network, I tell her that the internet is like an alien intelligence. We don’t know exactly what it is; it has just landed, and only the first ship. We are trying to figure out how to talk to it. The first generation of explorers have noted that by making certain finger motions you can make the aliens show you images of cats and clothes, or tell you all the ways the world is falling apart.
For a long time, I thought this was all there was to it. I could tap the keyboard in a particular way and the screen would show me the weather, or tell me which translation of the Iliad to read and then make someone jump in a truck and drive it to our house. I preferred the Iliad to the screen.
But then, late 2021, after I had been making intricate finger movements again, I woke up in our guesthouse before sunrise and noticed that something had changed.
During the night, the internet had been set in motion. Tossing hither and thither in silence—as the fields lay frozen and waiting and the hedgehog slept in its pile of leaves—the internet had rearranged itself around me.
I had written an essay about Ivan Illich and systems thinking, a topic I had never found anyone else intrigued by, and which magazines thought below a rejection letter—and the internet had suddenly reshaped itself so that my keyboard hooked up to the screens of a bunch of people who wanted to talk about these topics, and a little later, their keyboards hooked up to mine.
I had written for 15 years, but never before had this happened. I had conjured a minor conference! And I hadn’t even known that you could do that.
This gave me a first glimpse of the social mechanics of the internet. Looking at the traffic data, and talking to readers, I could retrace how my words had traveled through the network, and I got a sense of why. I didn’t fully understand it; I don’t think anyone does. But like a scientist who’s got hold of an alien artifact, I proceeded by gleefully and semi-randomly pushing every button I could find to see what happened. I would think of a series of funny finger movements and then I’d say to myself, LOL I wonder what this combination does? And then I’d try.
The way the machine seemed to work was:
The more precise and niche the words I input, the better the internet would match me with people I could forge meaningful relationships with. This precision was hard for me, partly because my sense for how communication is supposed to work is shaped by reading mass media. Writing for a general public, you need to be broad and a bit bland. I didn’t want a general public. I wanted a specific set of people, the people who could help me along as a human being obsessed with certain intellectual problems. I didn’t know who these people were. I only knew that they existed. Hence my writing was a search query. It needed to be phrased in such a way that it found these people and, if necessary, filtered others.
The pleasant parts of the internet seemed to be curated by human beings, not algorithms. For my writing to find its way in this netherworld, I needed to have a rough sense of how information flowed down there. The pattern was this: words flowed from the periphery to the centers. This was a surprisingly rapid stream. Then the words cascaded from the center down again in a broader but slower stream to the periphery again.
I will spend the rest of this essay unpacking those two statements.
It will seem like I am mainly talking about how to use writing to forge meaningful relationships. I think doing that is beautiful and important. But lurking behind it is a larger idea. Namely, that you can shape yourself by reshaping your relationships. By changing who you are addressing, and the responses you garner, you steer your development. You become more agentic.
The syntax of social search queries
Human brains are wired such that we get rewarded for attending to surprisal. If we turn our attention toward things that surprise us we get excited—and our model of the world changes. It grows more complex.
This is easy at first. My one-year-old was in complete rapture today on seeing a hen. But after a while, hens do not surprise us anymore, even if they are scratching dirt. We need a bigger hit to get the same high. To make hens interesting again, you could perhaps read about how they originally lived in the jungle, or you might get into the biology of egg production, or, more likely, you’ll pursue something more interesting than hens. Any which way, by pursuing your interest, you will move toward complexity. The simple things do not surprise you anymore. So you turn your attention to more complicated things. This is an amazing algorithm: do interesting things and magically arrive at a complex understanding of the world.
Sadly, it also leads you down a path that will likely end in existential loneliness and sobbing. What leads you there is the fact that the particular complexity that catches your interest is highly idiosyncratic. People get interested in all sorts of things. I have heard, from credible sources, that there even exist people who are interested in the names of Brazilian soccer players! Having idiosyncratic interests that grow in complexity means that if you pursue them too far you will end up obsessed with things that no one else around you cares about.
(There is a counteracting force in that humans tend to mimic the interests of those around them. But this is of little help for those of us for whom ”those around them” mostly means niche bloggers, contributors at Wikipedia, and Erasmus of Rotterdam.)
People feeling alone in their interests has always been true to a certain extent, but the internet has made it much worse. The excess of information allows you to travel down your path of interest with mad velocity. On the internet, Wonderland is recursive, with rabbit holes opening up to yet more rabbit holes; you never stop falling. And the further you fall, the less likely it is that anyone you’ve ever met is falling where you are. This will make you immensely sad. You will visit your parents, and when they ask you about your life you will have two choices. You can either be incomprehensible and see them grow concerned about things you are excited about, or you can talk about surface-level things and cry a little when you are alone at night.
The reason I’m spelling out this dynamic is twofold. First, you can get out of this mess if you want to. You do that by writing online (or publishing cool pieces of software, or videos, or whatever makes you tickle—as long as you work in public). Second, if you want to get out of the mess the key lies exactly in understanding that you are not the only person who has no one to talk to about the things you get obsessed by.
When writing in public, there is a common idea that you should make it accessible. This is a left over from mass media. Words addressed to a large and diverse set of people need to be simple and clear and free of jargon. It is valuable to write clearly of course, to a degree. Clear writing is clear thinking. But to make the content accessible? To cut digressions and obscure references to reduce the number of things people need to understand to make sense of your argument? Really?
That is against our purposes here. A blog post is a search query. You write to find your tribe; you write so they will know what kind of fascinating things they should route to your inbox. If you follow common wisdom, you will cut exactly the things that will help you find these people. It is like the time someone told the composer Morton Feldman he should write for “the man in the street”. Feldman went over and looked out the window, and who did he see? Jackson Pollock.
Write for Jackson Pollock.
The people you will be able to have deep conversations with have, like you, already been surprised by the simple, clear things. They need more to get high. And this “more” will be wildly idiosyncratic. It cannot be summarized in a list of writing rules.
So what do you do?
You ask yourself: What would have made me jump off my chair if I had read it six months ago (or a week ago, or however fast you write)? If you have figured out something that made you ecstatic, this is what you should write. And you do not dumb it down, because you were not stupid six months ago, you just knew less. You write with as much useful detail and beauty as you can muster, because that is what you would have wanted.
Six months ago, I was thinking about how large language models will affect how we learn. The essay Using GPT-3 to augment human learning would have made me jump off my chair and run out to Johanna talking excitedly and incomprehensibly; that’s why I wrote it.
To make it interesting for myself, I made it longish and detailed. I like it when people don’t just talk in the abstract but show you with examples, preferably many examples, and preferably taken from the real world so they are messy. Some people find this excess annoying. I don’t. Rich data lets me develop a tacit understanding of the domain. So I wrote 3000 words about how to prompt GPT-3 in ways that make it more truthful, and I included a long dialogue where the AI diagnoses Johanna’s itching hands; and another one about how cities affect innovation; and a third about digitally mediated apprenticeships. I also made the essay a bit literary and flamboyant, which you are not “supposed” to do when writing about AI, at least not if you want the average LessWrong reader to upvote it. I’m not the average Less Wrong reader; I much prefer Thomas Bernhard’s rants to Eliezer Yudkowsky’s. Hence, I made it flamboyant.
I’m not saying it was a great essay; I’m saying I would have loved it. The essay would have answered most of the questions I had, and it would have given me a new more complex understanding of language models that I could have used to get excited by even more obscure things. And because the internet is big, there were a few thousand people who felt the same way—and I felt really deeply for these people.
It is crazy-beautiful to have a stranger arrive in your inbox, and they are excited by exactly the same things as you! You start dropping the most obscure references, and they’re like, yeah, read that, love it. The first handful of times it happened, Johanna asked me what was wrong. I was crying in the kitchen.
Those were tears of homecoming.
And—as if that wasn’t good enough—now these people are routing me interesting things about language models, cow breeding, Quintilian, 19th-century dictionaries, graph-based operating systems . . . and on and on . . . I get more and better input than I could ever have found on my own, a lot of it from sources outside the clear web, tinkerers writing to me about tools they are building, or new observations they have made.
In other words, I have, to a degree, automated my obsessions now. I have summoned a milieu that pulls me where I want to go!
A search query doesn’t have to be a 5000-word effort post to work (though the internet does reward that amply). Anything that would have been useful to you sometime in the past will do. Alexey Guzey makes lists, half of which are made up of quotes, and they are incredibly useful and have been instrumental in reshaping his network so that he could start New Science. Most good Twitter accounts can be viewed in the same way.
Distribution
If you follow the advice above, you will write essays that almost no one likes.
Luckily, almost no one multiplied by the entire population of the internet is plenty if you can only find them.
How do you do that?
Well, you can probably spot a few of them already, even if you are a fairly naive internet user. The people you can spot will be those that have large followings. This might depress you. The famous people will seem out of reach, and the rest of the internet will seem to be pure madness.
When starting out, my model of how it would work was this: I wouldn’t find any readers. And if I did, they would be plebeians like myself, and then, maybe? hopefully? as I found more of them, I would level up? so that I could connect to people with increasingly large followings? like climbing a corporate hierarchy? This is not how it works.
The social structure of the internet is shaped like a river.
People with big followings, say someone like Sam Harris, is the mouth of the Mississippi emptying into the Mexican Gulf. Sam has millions of tributaries. There are perhaps a few hundred people Sam pays close attention to, and these in turn have a few hundred they listen to—tributaries flowing into headwaters flowing into rivers. The way messages spread on the internet is by flowing up this order of streams, from people with smaller networks to those with larger, and then it spreads back down through the larger networks. Going over land, from one tributary to another, is harder than going up the stream order and then down again.
This dynamic is easier to spot on Twitter, where you get notified every time someone likes or retweets what you have written (compared to a blog where the traffic data is more murky). When I tried out the title of this piece as a tweet—a primitive way to A/B-test—I could map that dynamic.
It was not a viral tweet. I am a minor tributary in the Twitter river system (my follower count was ~100 at the time). But a few of my followers were slightly larger. They had found me, I assume, because I made replies to their tweets that they sort of liked. Two of these, Stian Håklev and Tom Critchlow, resonated with the tweet, so they retweeted it. A few others gave it a heart, which is also a way to route tweets (though it is a weaker form of routing than a retweet).
Then a few accounts that were an order of magnitude larger still retweeted it, because they followed Stian and Tom and now saw it. And from there it rushed up the stream order. It only took an hour or two for the tweet to reach the largest accounts it would reach (Tiago Forte with 84k followers, who retweeted it, and Balaji Srinavasan with 681K, who routed it on through a like). But the smaller accounts took much longer. Information rushes up and then trickles down. The larger accounts are not larger without a reason, but, at least in part, because they spend more time routing information in the network!
(This, by the way, is how you sent letters before the post service was established. In the 1600s, if you were an intellectual who wanted to send a letter to another intellectual, you’d send it to someone who could forward it to Marin Mersenne—because he knew everyone who knew anyone and would surely know someone who could find the person you wanted to reach. This I learned from a tweet by Visa, who is the modern day version of Mersenne.)
The trick, then, is this. You take the person you think is closest to the person (or type of person) you want to talk to and send what you write to this person. A subreddit is a good place to start. I usually do this by collecting interesting people on Twitter through good reply game. Then I can simply post my essays there and know they will have a chance of seeing it. Occasionally—and this makes more sense in the start—I send essays to people directly, in their direct messages or to their email. I sent Apprenticeship Online to José Rincón, mostly as a way to give context to a few comments I had on one of his essays. He didn’t answer, but he did tweet out the essay, which brought in a handful of interesting people in my orbit. It turns out that if you’ve written something that you find interesting, it is not unlikely that people you like will find it interesting too, and pass it on if you give them the chance.
As you start routing information and putting out blog posts, you will begin to accumulate connections. Useful information will start to stream toward you, turning you into a small hub yourself. This will allow you to collect and curate information and route it back out, which will allow even more people to connect to you, in a flywheel that lets you do increasingly useful and good work. I especially enjoy it when intelligent people attack me; I then invite them to comment on upcoming drafts.
You can also post to subreddits and forums, like LessWrong or the SlateStarCodex subreddit, that act like intellectual cafés on the internet. Pasting your posts there, it is easy to find community when you are starting out; you don’t have to scream into the void. And, more importantly, a lot of people pass through these cafés, and if they are your kind they can help spread your work in the netherworld of personal connections and open weird doors on the internet for you. I relied heavily on forums in the beginning, gaining my first hundred or so subscribers this way, but they are growing less important now that I have collected a set of connections of my own. I can get a more precise spread of my essays by just emailing them to my subscribers and putting out a few tweets. But I feel deep gratitude, especially to LessWrong, which provides me with an editor who helps me with grammar and fact-checking.
By the way, the reason you will eventually grow out of forums is that they are search queries written by other people. LessWrong was summoned into existence by Eliezer Yudkowsky and Robin Hanson writing a sequence of exceptionally powerful search queries (on Overcoming bias), blog posts so strong that the networks they created survived the exodus of the original nodes.
This is what online writing is at its limit—the summoning of a new culture.
If we squint a little, we could even say that this is how the internet itself came into existence. In 1963, J. C. R. Licklider wrote a memo about an “intergalactic computer network”, and that search query was so powerful it summoned the aliens.
We’re all living inside his search query now.
These ideas here remind me of Niklas Luhmann’s theory of communication. Usually communication theories assume there to be a sender and a receiver, and the sender tries to transmit information to the receiver. Then that’s called communication. But in Luhmann’s theory there is no assumption of anything being transmitted. Instead, as far as I understand, he only assumes that people involved in communication react to “irritations” created by other people, and those reactions consist in creating further “irritations”. A feedback loop.
So a blog post may be seen as a search query, but it may also be viewed as an irritation, optimized for irritating a specific sort of other people enough such that they hopefully react with creating their own irritations. (I’m probably oversimplifying Luhmann’s theory here.)
“irritation” in the sense of “state-of-the-world which I can improve by contributing and which my feelings desire to be improved”, yeah? not necessarily that the desire to contribute has to have negative valence. if so, I wish Luhmann had chosen a different word, but I can see how my comment fits into the framework.
Yeah. The German term has less of a negative connotation I guess. “Surprisal” goes in a similar direction.
hmm, perhaps compare programmer’s “building projects to scratch an itch”, or fiction writers’ “plot bunnies”.
I’m not deeply familiar with Luhmann’s work, though that was interesting. It does remind me somewhat of Bakhtin (and Buber) on dialogue.
Unless there’s an expectation that interests cannot be more complex then a certain threshold, it doesn’t seem like something to feel sad over?
Past a certain threshold in complexity, due to exponential scaling, there are simply too many possible combinations for more than 1 of 8 billion humans to likely share. As there’s an upper limit to how many discrete thoughts one can have.
Assuming there’s roughly 100 000 nouns in common documented usage, you could probably randomly combine any four in the English language and not find a single human who cares about whatever that refers to, now or ever.
100 000^4 is a very large number after all.
Wow, your post was what stimulated me, to finally create an account. Because I thought you deserve to receive more compliment for that piece of writing. At first I thought it was gonna be about, how everything is just some signaling to find some partners. but your idea is something I’ve never came accros before, and for that, thank you. When you said, “you’re not growing much anymore despite putting up content”. Have you had ideas on why is it that ? Is it that you’re too “specialised” and can’t by default be “mainstream” ? Also, I’d be curious if when you published that piece you thought it was “an orignal thought” or not ? Because I know, it’s something that can hold me back, thinking “ohhh it’s so obvious what I’m going to say, it would be pretentious to think I’m provinding any value by saying it”.
Katja Grace explains how she got over that: Typology of blog posts that don’t always add anything clear and insightful
Practical and clear, what a combo.
On the topic of GPT-3 as a writing assistant: do you use Loom? It sounds like it would suit your workflow pretty well. It lets you generate a bunch of completions at once and displays them as child nodes from a prompt, automates the process of finding branching points where the model might explore a different thought and lets you collapse the view of your writing from a tree to an openai-playground style interface.
But I think someone could probably make something better, like “codex but for writing”. Though it seems unlikely it would have the same features as codex, as that is built for coding. Writing does have a different workflow, and automating away as much of that workflow as can be managed without sacrificing quality would result in some rather diffrent features. As GPT-3 would be used to replicate these processes, and it is by design a simulator of human text which is largely writing, I suspect GPT-3 for writing would automate more parts of a writer’s workflow than a programmer’s.
Since you use, GPT-3 to write, I’m curious if you have any thoughts on the topic. What features would enhance your interactions with GPT-3? Greater context length? The ability to see how your readership would summarise or critique your text? Inserting your off the cuff thoughts into the most relevant area of your essay/notes?
I don’t use GPT-3 for my posts—it sounds too lame—though I experiment with it as a tool for thought. There are cool new projects coming up that will improve the workflow.
Context length is of course a big thing that needs to improve. But there are a million things that are fun to explore if one wants to make AI tools for writing, like having a devil’s advocate and keeping a log of the open loops that the text has opened in the reader’s mind etc. Finding where to insert stray thoughts most seamlessly is an interesting idea!
The only thing more difficult than getting readers for your blog is getting readers for your fiction (maybe not on here).
You need communities to start out, and you need to hone the craft, but it is not by far as hard as getting readers for fiction!