Book Review: The Elephant in the Brain

Link post

We don’t only constantly deceive others. In order to better deceive others, we also deceive ourselves. You’d pay to know what you really think.

Robin Hanson has worked tirelessly to fill this unmet need. Together with Kevin Simler, he now brings us The Elephant in the Brain.

I highly recommend the book, especially to those not familiar with Overcoming Bias and claims of the type “X is not about Y.” The book feels like a great way to create common knowledge around the claims in question, a sort of Hansonian sequence. For those already familiar with such concepts, it will be fun and quick read, and still likely to contain some new insights for you.

Two meta notes. In some places, I refer to Robin, in others to ‘the book’. This is somewhat random but also somewhat about which claims I have previously seen on Overcoming Bias. I nowhere mean any disrespect to Kevin Simler. Also, this is a long review, so my apologies for not having the time to write a shorter one, lest this linger too long past the book’s publication.

The book divides into two halves. In the first half, it is revealed (I’m shocked, shocked to find gambling in this establishment) that we are political animals and constant schemers that are constantly looking out for number one, but we have the decency to pretend otherwise lest others discover we are constantly scheming political animals. The easiest way to pretend otherwise is often to fool yourself first. That’s exactly what we do.

What are our real motives? Exactly what you’d think they would be. We want the loyal and strong political allies, true friends, the best sex with the most fit mates, food on the table, enforcement of our preferred norms, high status, respect and other neat stuff like that. The whole reproductive fitness package. To get these things, we must send the right signals to others, and detect the right ones in others, and so forth.

This insight is then used to shine a light on some of our most important institutions:

This book attempts to shine light on just those dark, unexamined facets of public life: venerated social institutions in which almost all participants are strategically self-deceived, markets in which both buyers and sellers pretend to transact one thing while covertly transacting another. The art scene, for example, isn’t just about “appreciating beauty”; it also functions as an excuse to affiliate with impressive people and as a sexual display (a way to hobnob and get laid). Education isn’t just about learning; it’s largely about getting graded, ranked, and credentialed, stamped for the approval of employers. Religion isn’t just about private belief in God or the afterlife, but about conspicuous public professions of belief that help bind groups together. In each of these areas, our hidden agendas explain a surprising amount of our behavior—often a majority. When push comes to shove, we often make choices that prioritize our hidden agendas over the official ones.

I know it is as a shock to you, but Robin doesn’t think X is about the Y it claims to be about. Instead it’s about signaling and status. I know, it’s a lot to take in. Stop. Catch your breath.

Robin and Kevin realize this is good news:

This may sound like pessimism, but it’s actually great news. However flawed our institutions may be, we’re already living with them—and life, for most of us, is pretty good.

So if we can accurately diagnose what’s holding back our institutions, we may finally succeed in reforming them, thereby making our lives even better.

There are many examples throughout the book where particular things are held up as about status and signaling. In some cases, it is explained why these actions are valuable or socially beneficial, but in most cases the clear implication is that it is all pointless zero-sum games and a terrible waste.

The perfect encapsulation of this attitude is something I remember from Overcoming Bias, rather than from the book, in a post called Harnessing Polarization:

Human status competition can be wasteful. For example, often many athletes all work hard to win a contest, yet if they had all worked only half as hard, the best one could still have won.

As a sports fan and a former professional game player, I respond that yes, the same athlete wins. But it wouldn’t count. The win would be tainted, the spectacle ruined. We live to compete with all we have, and to watch others compete with all they have. We shake each others’ hands, say ‘good game’ and mean it. After we’re done, we analyze what happened to gain understanding. We celebrate striving, excellence and achievement.

Competition is not about winning.

What looks like the definition of a zero-sum game is quite the opposite.

Thus the battles between our elephants to gain advantage, in their inevitably increasing complexity, create the arms race of bigger and better brains, more and more complex behaviors, cultures and tools, and all the nice things. Each of us has an incentive to adjust the incentives of those around us back to that which is hard, that which is useful, that which makes us stronger, up and down the chains of meta levels.

Everything is Bayesian evidence of others’ true motives and loyalties and capabilities. We need elephant-sized brains to have any hope of processing all of it.

Bask in the wondrous deeds of unconscious Bayesian analysis and leaky self-deception. The Elephant in the Brain is a wonderful defense of hypocrisy.

I, for one, take great joy in the merely real, the greatest show on Earth.

The next few sections will be a quote that stood out, and my associated thoughts.

Who would you rather team up with: someone who stands by while rules are flouted, or someone who stands up for what’s right?

Good question!

The book assumes the answer is the one who stands up for what’s right. But are you sure about that?

Are you sure you don’t want a winner? Who will be smarter than to waste resources reinforcing norms?

A central concept in the book is that norms are enforced because the meta-norm of enforcing norms is also enforced by the meta-meta-norm of enforcing the enforcing of rules, and so on. The meta-norm automatically acts on itself, so the cycle never ends.

For that to work, the answer to the team up question must be the one who stands up for what is right. For the elephant that is what being right means. In turn, for that to work, everyone must have a common knowledge expectation that the meta-norm will be enforced.

The Darwin Game illustrates (among other things, also spoiler alert) what happens when there can be no enforcement of the enforcement of norms.

In a world… of venture capital talks about what happens when being a winner becomes the norm. When the meta-norm enforces ‘be a winner’ it also punishes all other considerations. You destroy all pro-social norms.

One could also point to certain political campaigns and attitudes. Normally one must pretend to be in favor of allies being in favor of norm enforcement, and tearing that mask off is really, really bad.

That generalizes. Any actions not reinforced by norms are seen by the meta-norm as rival actions to norm enforcement, and are punished.

Neutrality is not a thing. What is a thing is a war of norm against norm, reward against reward, enforcement against enforcement, level upon level of complexity.

III

What’s not acceptable is sycophancy: brown-nosing, bootlicking, groveling, toadying, and sucking up. Nor is it acceptable to “buy” high-status associates via cash, flattery, or sexual favors. These tactics are frowned on or otherwise considered illegitimate, in part because they ruin the association signal for everyone else. We prefer celebrities to endorse products because they actually like those products, not because they just want cash. We think bosses should promote workers who do a good job, not workers who just sleep with the boss.

The first rule of signaling is cheat.

The second rule of signaling is catch cheaters.

The third rule, therefore, is don’t get caught.

When too easy a strategy earns too big an associative payoff, that’s a great deal for you. But it ruins the signal for others. They must bring the signal back in line with the difficulty of the action, by making the strategy more difficult and/or assessing a penalty against the signal.

So the game moves up a level, to signaling of difficulty, where the rules still apply. The game gets more complex and the brains get bigger.

Like the best games, the signaling game is self balancing, because the players change the rules to make it so.

How fun!

This line stood out as quite odd:

You botched a big presentation at work. Feel the pang of shame? That’s your brain telling you not to dwell on that particular information.

Things that make me feel shame bother me for years. Decades, even. We punish and discipline and shape behavior by associating it with shame. These days most of us consider shame toxic.

If shame is the brain’s way of telling you not to dwell on that particular information, it’s doing quite the epic fail of a job.

It seems more like the opposite. Shame is a tool for making damn sure you do dwell on that information, and everyone else knows it. It restores balance. It is explicitly a tax.

Shame royally sucks. That’s the whole point. That’s how you pay the tax. Much better to do without, but we must then restore balance another way.

Of course, we realize that a few expert opinions don’t necessarily reflect a consensus among all experts—nor, it should be noted, is consensus opinion necessarily the truth.

Well said. Consider this your periodic reminder.

In part two, the book breaks down some of the motives behind major areas of life: Body language, laughter, conversation, consumption, art, charity, education, medicine, religion and politics.

The second half did an excellent job of pointing out the signaling, status and strategic motives behind these areas of life. In this regard, I bought most of the book’s claims. Such motives are all around us and central to almost everything involving multiple people. We see over and over the structures from the first half of the book. As the chapter titles put it: Norms, cheating, self-deception, counterfeit reasons.

The pattern is to present the standard explanations for what happens in such areas of life, and then point out that this explanation doesn’t make sense – much of our behavior remains unexplained. So instead, such areas must be about other reasons, and such other reasons are found and explored.

Thus Robin’s claim that, contrary to popular belief, X is not about Y:

Food isn’t about Nutrition
Clothes aren’t about Comfort
Bedrooms aren’t about Sleep
Marriage isn’t about Romance
Talk isn’t about Info
Laughter isn’t about Jokes
Charity isn’t about Helping
Church isn’t about God
Art isn’t about Insight
Medicine isn’t about Health
Consulting isn’t about Advice
School isn’t about Learning
Research isn’t about Progress
Politics isn’t about Policy

For most people, such statements provide a useful nudge in the correct direction. In an important sense, all the above statements are true. In another important sense, they’re all false.

Everything is, in an important sense, about these games of signaling and status and alliances and norms and cheating. If you don’t have that perspective, you need it.

But let’s not take that too far. That’s not all such things are about. Y still matters: you need a McGuffin. From that McGuffin can arise all these complex behaviors. If the McGuffin wasn’t important, the fighters would leave the arena and play their games somewhere else. To play these games, one must make a plausible case one cares about the McGuffin, and is helping with the McGuffin.

Otherwise, the other players of the broad game notice that you’re not doing that. Which means you’ve been caught cheating.

Robin’s standard reasoning is to say, suppose X was about Y. But if all we cared about was Y, we’d simply do Z, which is way better at Y. Since we don’t do Z, we must care about something else instead. But in there’s no instead; there’s only in addition to.

A fine move in the broad game is to actually move towards accomplishing the McGuffin, or point out others not doing so. It’s far from the only fine move, but it’s usually enough to get some amount of McGuffin produced.

There’s also the question of what we do when we realize people don’t care much about the McGuffin (hereafter simply Y). There are three paths one can take.

Path one is to say we could accomplish Y better by doing Z, so let’s do Z. Here’s how to make medicine about health and politics about policy! That can be a very good result, but it would also kill the signaling component of the enterprise. That likely means paying for it in other ways, so Z doing Y better is not a sufficient case that it’s a better system.

Path two is to disparage and discard the McGuffin, and play the broad game more openly. Medicine isn’t about health, so here’s the treatment that shows you care. Politics isn’t about policy, so I’m not even going to pretend to care about that. This is very bad. This is a huge violation of the broader game’s rules. It’s cheating. It’s too easy, it doesn’t show you’re clever or have spare resources, and the norms it implies are disastrous.

The broader game is very clear that when you realize that X is mostly not about Y, you’re supposed to keep saying that X is about Y, because that’s both how we keep the game’s difficulty high enough to send worthwhile signals, and how we get a little bit of Y out of the whole thing. A little is often all you need; thanks to the civilization this game has built, there really is room for most of us to waste most of our time. The whole system is built on this hypocrisy.

I’ll now go through the chapters in part II, and give my take on the particular claims.

VI – Body Language

I think this chapter is mostly spot on. Body language is about sending leaky and instantaneous, and therefore more honest, communication, often about status, while also having rich bandwidth and being deniable if reported to others. We prefer natural body language because it is a signal we can trust, whereas unnatural body language is basically lying. By using such communication methods, we test each other on many levels, including our skill in interpreting and giving such communication, and get to see in a deniable fashion what others are thinking is going on. Every move we make is based on everything it implies; just saying what you mean is impossible.

Making more things more explicit, on the margin, is often a good idea. As are further explanations of unclear signals, especially to those who struggle with them. Ask Culture gives people the valuable tool of direct communication without the need to violate norms, but trying to screen off rich implicit communication channels, or treat them as something we aren’t responsible for parsing, is a mistake. Life is full of Bayesian evidence and we have a brilliant processor for rich data sets. We’d be fools not to use it.

Body language is about communication, especially communication about status, but then there isn’t really another thing for body language to not be about.

VII – Laughter

This chapter also seems mostly spot on, and seems much better than my previous models of humor. Alternate explanations of laughter don’t explain observed behavior, whereas laughter as a play signal fits the data quite well. Laughing at something means it is playful, which has far reaching implications. It explains why good-natured teasing and laughter strengthens relationships, while mean-spirited teasing and laughter weakens them: the statement that something is playful changes its implications. Calling the right thing play shines a positive light on your motives, whereas overreaching does the opposite. It means you don’t care. And of course, laughter lets you communicate things you can’t otherwise say, as in the chapter’s closing quote from Oscar Wilde: “If you want to tell people the truth, make them laugh; otherwise they’ll kill you.”

The book doesn’t pay much attention to the simple fact that laughing is fun, and thus incentivized. Laughter becomes a tool that identifies and positively reinforces play in the exploratory, clever and experimental senses, which is great because such play is highly useful. The better and more clever and unpredictable and original the play, the better the laugh, encouraging more useful tasks and bigger brains. And of course, the better one’s sense of humor – e.g. knowing which things are clever and unpredictable and original – the better one looks, and thus the virtuous arms race continues.

Laughter isn’t about jokes, but that was always clear. Jokes are an attempt to hack the humor function and get laughter. Useful, but not the point.

VI – Consumption

Clearly this is intended to be a positive association for many viewers, but in Kevin’s case, the ad actually backfired. There’s nothing wrong with the product itself; it smells great and masks body odor effectively. But the cultural associations were enough to dissuade Kevin from using the product. This shows how arbitrary images can turn customers away, but by similar principles, other lifestyle ads must be having an opposite, positive effect.

Kevin (correctly) not wanting to consume [product] due to its associations is not a bug. It’s a feature. The point of advertising [product] in this way is to associate it with people who are very much Not Kevin. If Kevin were to use the product, it would be doing quite a bad job associating with and signaling Not Kevin! You wouldn’t want people smelling way too much [product] on people, and thinking it was Kevin.

I’m sure [product] likes extra sales, but there is a bigger plan in motion here.

You could also look at it as good Bayesian information for Kevin. If [product] is paying to create these associations, that is evidence [product] is a relatively better fit for people who would respond positively. By responding negatively, Kevin gets the information that the product is a poor fit for him. Since [product] exists in a competitive market, that probably means it’s a bad choice. Even if Kevin reacted neutrally to the message, that is a worse than expected reaction to advertising, so Kevin should update negatively on the product. Smart elephant.

At a minimum, he’d be paying for the signal, so it’s likely overpriced.

This is also quite healthy from an incentive perspective. If creating an association with your product helped with some customers without hurting with other customers, it would be an overly effective, free action. It would be too easy, unearned status. In other words, it would be cheating. We catch such cheaters who are so low quality as to be caught, and punish their actions with equal and opposite reactions.

In another example of good advertising:

The U.S. Marine Corps, for example, advertises itself as a place to build strength and character. In doing so, it’s not advertising only to potential recruits; it’s also reminding civilians that the people who serve in the Marines have strength and character. This helps to ensure that when soldiers come home, they’ll be respected.

And what would we do without advertising?

To get a better sense for just how much of our consumption is driven by signaling motives (i.e., conspicuous consumption), let’s try to imagine a world where consumption is entirely inconspicuous.

The book presents the thought experiment of the Obliviated world, where we are no longer able to form meaningful impressions of other people’s things. What happens then? How much of our consumption would then be pointless?

The book’s answer is quite a lot:

Today it’s considered inappropriate to wear sweatpants to a dinner party or around the office. But in an Obliviated world, where no one is even capable of noticing, why not?

…

Living rooms—which are often decorated lavishly with guests in mind, then used only sparingly—will eventually disappear or get repurposed.

Who would care?

I would. I would care.

I spend a large portion of my life in my living room. Even with no guests. I want it to be a nice place. For me. The idea that they’d disappear is downright bizarre to me. They’re for living! It’s a thing!

I buy most of my luxury goods where they are not easy to notice.

In the medicine chapter it is noted:

When people buy chocolates for their sweethearts on Valentine’s Day, for example, they usually buy special fancy chocolates in elaborate packaging, not the standard grocery-store Hershey’s bar.

Yes, part of that is because you want to signal that Valentine’s Day is special. But part of that is that you presumably like your sweetheart, and wouldn’t want him or her eating a Hershey’s bar.

I do not think, as I believe Robin does, that most product variety and customization is worthless aside from signaling. Instead, I thank the signaling market for encouraging such great variety, and curse it for often making the good stuff so much more expensive.

Robin has always dismissed the value of inconspicuous consumption. I think it is vastly underrated. I often end up buying the package of conspicuous and inconspicuous consumption together, but there’s no other way to get the half I want. Perhaps that also means I am the exception that proves the rule. I can believe most people instead throw away the other half.

If your restaurant consumption is, as the book claims, ‘more for showing off’ than for personal use, you are doing it wrong. Same with (from the same chart) mobile phones and living room furniture.

In the long run, if consumption were somehow totally inconspicuous, would I slowly lose the associations I have and devalue my inconspicuous consumption as well? Would the next generation get no joy from nice things? Perhaps the next generation. I think I’d stick to my guns. But the good stuff often is actually good. Consumption often really is about consuming, even if much of it (and much of the more expensive versions of it) mostly aren’t. The system works.

The system also works in the sense that getting capitalists to create more and better conspicuous consumption is both an engine of innovation and technological progress, and also an efficient method of conspicuous signaling. It’s certainly not a perfect signal of conspicuous signaling, we’d prefer we were all competing to donate to efficient charities (hold that thought for four sections), but moving the competition into innovation and design and production, and the bidding up of scarce resources, is quite the economic engine.

Consider the alternative. In an Obliviated world, where would all that signaling go? We’d have to turn to other sources. They would likely have to be behaviors, which seems quite nasty and negative sum without the beneficial economic side effects. The beauty of conspicuous consumption is it eats your money but that money ends up elsewhere. Mostly harmless. If it ate your time that time is gone. The alternative of using measurement and having a meritocracy is great up to a point and then turns into a dystopia, especially when it starts involving machine learning on more and more data. Then it eats your time and your money and your relationships and everything else.

There is speculation that this is happening in many jobs. It used to be that one could “suit up” and otherwise consume rote formality, and use that as a signal of seriousness and professionalism. That has increasingly stopped working, so we rely on other signals, which turns over even worse areas of our behavior to the signaling market, forcing people to turn to cultural and class signals, and other Bayesian evidence, eating up much more of people’s resources and making it that much harder to move up in the world. Every little piece of body language and every tone of voice gets obsessed over, even more than by default.

Which is terrible, but then again, I really hate suits.

VII – Conversation

Conversation isn’t about information is a strange claim. Of course conversation is about information. That doesn’t mean there isn’t anything else going on; the same ‘anything else’ is always going on when people interact. In this case, I think ‘conversation is about info’ is more importantly true than ‘conversation is not (entirely) about info.’ Info is quite the important McGuffin.

We can assume that everyone is calculating when it is to their benefit to share information, versus when it is better to hoard it. When they should talk versus when they should listen. So when I see statements like:

A full accounting will include two other, much larger costs:

The opportunity cost of monopolizing information.
The costs of acquiring the information in the first place.

In light of these costs, it seems a winning strategy would be to relax and play it safe, letting others do all the work to gather new information. If they’re just going to share it with you anyway, as an act of altruism, why bother?

But that’s not the instinct we find in the human animal. We aren’t lazy, greedy listeners. Instead we’re both intensely curious and happy to share the fruits of our curiosity with others. … If speakers are giving away little informational “gifts” in every conversation, what are they getting in return?

Hello, entire thesis of the book? Once again, we see the naive view of ‘I thought this was a narrow, isolated action, I’d be shocked, shocked to see humans trying to use it to maximize their reproductive fitness in this establishment.’ Then when a simple one-active-pathway model is suggested, in this case a quid pro quo arrangement of “I’ll share something with you if you return the favor,” we are ‘puzzled’ to find that it doesn’t fully explain the richness of human behavior.

Having read Robin for many years, it feels like he’s almost playing dumb. Or perhaps he’s continuously expecting readers to forget or dismiss the central thesis of both blog and book, and think humans do things in isolated ways that don’t interact with the wider world and wider hidden (and open) motives.

What excites me most about The Elephant in the Brain is that, having put the central point in book form, we can hope to take it as a given so we can get on with working out the implications and extensions, rather than constantly being shocked at what we find in this establishment.

So we have the following puzzles:

Puzzle 1: People Don’t Keep Track of Conversational Debts

Puzzle 2: People Are More Eager to Talk Than Listen

Puzzle 3: The Criterion of Relevance (in general, whatever we say needs to relate to the topic or task at hand)

Puzzle 4: Suboptimal Exchanges (when two people meet for the first time, they rarely talk about the most important topics they know).

The book’s resolution to this, which it draws from Geoffrey Miller’s The Mating Mind and Jean-Louis Dessalles’ Why We Talk is titled “Sex and Politics” where it is suggested we should “stop looking at conversation as an exchange of information, and instead try to see the benefits of speaking as something other than receiving more information later down the road.”

There’s that word again. Instead. I would suggest ‘in addition to’. If I share information with you it might benefit me in ways other than you giving me back information of value in this conversation. Well, sure. Like any other time I do anything that benefits someone else, I’m going to accumulate goodwill and a sort of debt, and it’s likely that benefiting you benefits me, or that how you will act given this information will benefit me, and also there’s all the signaling and other secondary implications.

Miller and Dessalles focus on the signaling aspect, in particular showing off. Miller speaks of impressing potential mates, Dessalles of potential allies. The book suggests the metaphor that we each carry around a backpack full of tools, and when we pull one out others get a duplicate for free if they don’t have one already. By pulling out tools that are valuable and relevant, I provide evidence of an extensive and valuable tool set:

You want to know whether the applicant is sharp or dull, plugged-in or out of the loop. You want to know the size and utility of the applicant’s backpack.

…

Every conversation is like a (mutual) job interview, where each of us is “applying” for the role of friend, lover or leader.

One of the most important tools is the respect and support of others, and our prestige.

Our obsession with news, it is noted, makes little sense based on news’ direct usefulness, but makes perfect sense if it is about maintaining the ability to converse impressively about hot topics that will count as relevant. We are interested because we expect everyone else to be interested, and need to be seen as being in the loop.

Motives that seem important to conversation, and that help explain the puzzles, but that don’t get much mention, include: Persuasion, Deception, Negotiation, Framing, Credit (first person to pull out the tool gets the credit for it), Value (relevant things are more likely to be valuable, especially in context, and seeking them is likely why we’re having the conversation), Understanding (wanting to be understood), Steering (where the conversation goes, including asking for what would be valuable to you), Attention, People plain old enjoy talking and sharing information, Reaction (how you react to information is valuable to me), Play and Practice, and generally all the motivations of the elephant even when they aren’t being explicitly named.

Also, are the puzzles even accurate?

People can and do keep track of conversational debt. If you tell me something valuable, I owe you, and vice versa. That debt is like any other debt. Little gifts that cost us nothing we don’t track carefully, big gifts that do cost us, especially ones that were requested, we track more carefully. And sometimes being allowed to talk is the gift. A given conversation need not balance, but the debts do accumulate, and they do matter. That there isn’t an exact ledger is only a puzzle for absurdly economic man.

In turn, if debt is being tracked, being eager to talk rather than listen makes sense. If you have a chance to gain credits, you’d be excited to do that, so you can spend those virtual approximate credits later, or pay back debt you’ve incurred.

The criterion of relevance is necessary for conversation to be a conversation rather than an exchange of facts. Relevant things build upon previously said things in valuable ways, and are likely to be of higher value. If I talk about what we should have for dinner and you tell me the capital of Brazil, chances are that’s both not something I especially care about right now and also not helping.

Similarly suboptimal exchange, since info has relative value based on context and what different people care about at different times. I don’t have a ‘most valuable piece of knowledge’ to go repeating to everyone. But yes, people would benefit greatly if we paid more attention to talking about more valuable topics, and exchanging more valuable information. I am reminded of the idea of going around asking everyone “what are the most important problems in your field?” and then “why aren’t you working on them?”

The chapter ends with some claims about research preferences often being about impressiveness and prestigious association, which few reading either this or the book would argue against, other than as a matter of degree.

VIII – Art

Art isn’t about insight. Art is about sacrificing resources to show that you can afford to, and a general-purpose fitness display (and courtship display). Thus we care deeply about who made the art, in what context, and how difficult and expensive it was to create. Artists intentionally choose difficult mediums and subject matter. For example, exact reproduction was prized as art when it was hard, then discarded when reproduction became easy. We like improv over theater, and theater over movies, holding quality constant, because of difficulty and also association with prestigious folk. Lobster was peasant food when plentiful, a luxury now that it is rare.

In turn, we care deeply about our ability to discern good art from bad, lest we be misled, and others see us as therefore unfit.

I buy all that. I wonder how deeply it is linked to the fact that Choices are Bad. Raising difficulty through restriction while holding results constant equals greater satisfaction. Plus restrictions breed creativity.

It also explains why so much of what we call ‘art’ is so terrible. When insiders compete to do things other insiders recognize as difficult, you get museums full of things I would pay to not possess. You get respect paid to ‘prestige’ pictures no one enjoys. There is lots of great art and fine work that requires taste to enjoy, but there’s also lots of ‘art’ where the enjoying is about how abstractly difficult it is, and I cannot stand the stuff. Or lobster. We were right the first time on that one.

I can appreciate when context makes things difficult, but there’s also difficulty in figuring out the right easy thing to do, and the difficult thing that’s ugly and terrible is still ugly and terrible in my eyes.

And yet, I like improv and appreciate theater and live music and live sports (even if I don’t consider it usually worth the time, money and trouble enough to actually go too often, although I think I’m making a mistake not going more). Part of that is the lack of distraction, and that real life is super high resolution, and the chance to interact with others, and even the sense of being there with the high status folk. A lot of it is the ability to see skilled people tackle restrictions and added difficulty, but that’s still far from all.

The important missing element is unpredictability and non-optimization. I love watching performers think on their feet, and strategizing with them. When things are edited and configured for the best performances and exactly what sells best, they become predictable and bland. When you know something is going to be exciting, that’s not exciting; part of what makes a great game great is not knowing if it’s going to turn into a rout. Watching great improv is about it sometimes falling on its face.

IX – Charity

Anyone reading this is almost certainly familiar with Effective Altruism, and the idea that people are charitable more for the warm glow of feeling helpful and showing off that they’re helping, rather than actually doing good. At this point all of that is uncontroversial around these parts.

As careful readers of mine have no doubt noted, I have concerns about Effective Altruism. One of those concerns is the tendency of such folk to become smug and act superior, treating those who give otherwise as ‘not really caring.’ This chapter comes off as quite smug in a way I worry is off-putting. Yes, our giving cares about visibility, and peer pressure, and proximity, and relatability and mating motives. We are not simply trying to do the greatest good for the greatest number slash score all the utilons. As opposed to the Effective Altruists, who are building a culture that attempts to better line up what serves those other motives with what actually helps people.

Which is great! But that does not mean others do not care. Nor does failure to optimize X mean one does not care about X; humans are not automatically strategic. They don’t go around optimizing things. If you’re going to accuse them of not caring, don’t accuse them of not caring about people, accuse them of not caring about optimization! Cause on that, they’re guilty guilty guilty.

Definitely don’t act like caring about proximity or relatability makes you a bad person, let alone effectively guilty of negligent homicide. You don’t get or keep civilization if you don’t care about proximity or relatability, or listen too carefully to Peter Singer, and even if that wasn’t a concern, humans flat out do care about those things. At this point I consider the drowning child argument a Basilisk, and wish it was treated accordingly: as something memetically hazardous that everyone needs to overcome and defeat as part of their coming-of-age rituals. It doesn’t even point out hypocrisy because people readily admit that life does not work like that.

X – Education

Individual students can expect their incomes to rise roughly 8 to 12 percent for each additional year of school they complete. Nations, however, can expect their incomes to rise by only 1 to 3 percent for each additional year of school completed by their citizens on average.

School is about signaling, and learning to submit. We knew that already. Film at eleven.

For the full version, see Bryan Caplan’s upcoming book, The Case Against Education.

One note I would make is about the sheepskin effect, where the last year of a college degree is much more valuable than previous years. There’s been some debate about this online lately between Bryan Caplan and Noah Smith. I agree that this is largely a signaling effect, with ‘completed all eight terms’ much more impressive than ‘completed seven of eight terms’ since you don’t know how many more terms the first student could have finished if necessary.

What the discussion misses, it seems to me, is that only after graduation do you know that the first three years were real. It is easy to become ‘a senior’ through completion of a number of credits, saving the stuff they find hardest for last or even being in terrible shape to match up with graduation requirements. I strongly suspect that a lot of people who drop out in year four are much farther from finished than they would have you believe.

XI – Medicine

Medicine is about conspicuous caring. The point is to show your care by doing all the things, on a personal and a societal level. We want to symbolically apply care, and know that such symbolic care has been applied. We actively prefer treatments with painful side effects, because they show how much we care. We want to construct a narrative where we did all that we could, and no one could blame us. There are lots of ways to improve patient outcomes that the medical system shrugs off and ignores for decades.

In this model, the fact that much of our medical care actually works is mostly a coincidence. When older medical systems used care that was actively harmful, the same behaviors were mostly observed. On the margin, our medical care does not work, and likely does harm, which is why health insurance doesn’t lead to more physical health (although not worrying about health care bills improves financial and mental health). We would do well to spend far less on health care, especially end of life care, while keeping core services that actually work like trauma care and vaccination.

Having run a medical start-up, I can report that medicine is even less about health than Robin makes it out to be. Even for themselves, with no one in their lives present to signal, people would rather consume the symbolic version of the thing. They care about how your research report looks, not about what it contains. They want to feel helped, not be helped. We foolishly had the hypothesis that people cared about their health enough to think for themselves. We rejected that hypothesis.

XII – Religion

Religion is a strange case where “X is not about Y” is often considered actively good news. God is not often considered a worthy cause (or even to exist) around these parts. Community and social systems, on the other hand, are recognized as vital by all right thinking folk. Community provides a commitment mechanism for community members and a way to create common knowledge of pro-social norms that make those communities work as places to live, support fellow members and raise families. It also serves as a badge, allowing others both in and out of your community to trust you will abide by your communities’ standards.

Instead of mocking religion as an especially false belief, the book suggests, we should recognize its strategic value in building and reinforcing social systems, norms and communities. The absurdity of religious belief is even an advantage, ensuring that the signals sent are genuine signs of commitment. Religious folk have more children, stay married longer, have more social connections, get and stay married more, tend to be happier, and have many things atheist communities struggle at great cost to recreate. Is there really that big a difference other than degree, the book asks, between the Muslim Hajj and the pledge of allegiance, or even traveling to watch your favorite sports team?

I see the appeal. I have looked at and adopted many Jewish practices and rituals for their mundane utility, with great success. The book points out this is common, and many Jews continue to follow the community norms despite being Atheists.

This attitude is summed up in this direct appeal:

Finally, we’d like to make a plea for some charity and humility, especially from our atheist readers. It’s easy for nonbelievers to deride supernatural beliefs as “delusions” or “harmful superstitions”

…

Nevertheless, we think people can generally intuit what’s good for them, even if they don’t have an analytical understanding of why it’s good for them. In particular, they have a keen sense for their concrete self-interest, for when things are working out in their favor versus when they’re getting a raw deal. So whenever adherents feel trapped or oppressed by their religion, as many do, they’re probably right. But in most times and places, people feel powerfully attracted to religion. They continue to participate, week after week and year after year-not with reluctance but with tremendous zeal. And we’d like to give them the benefit of the doubt that they know what’s good for them.

If we are mostly run by our elephants, and our elephants are expert Bayesian analysts with a keen understanding of what will help our reproductive fitness, that is a strong argument in favor of people knowing what is good for them. Certainly people are taking much into account when thinking about such matters, in ways they can’t articulate and that people often aren’t given credit for. In the other chapters of the book, we see people doing things that don’t seem to make sense, but turn out to be rather strategic. People are really good at this in some contexts.

It’s even true that much of the time, if we ask people what is ‘good for them,’ they will inuit remarkably accurate answers, even identifying when their own behaviors are bad for them, or other behaviors they are not doing would be good. If you think people go around having no idea what is good for them, and that people do things for no good reason, this is an important message for you.

The counterargument is that we’ve all met humans, so we know that they often have no idea what is good for them, in any context. It is not a coincidence that religion is singled out as the place the book explicitly asks us to trust others to make such decisions. Religion is a place we’ve constructed a norm that we should mostly trust people to make their own choices, unless the religion is young or too weird, and we call it a cult. Then we recognize that people can be very wrong about what is good for them.

That’s not to say that religion (setting aside the truth value of its beliefs) is usually bad for people. It seems especially not bad for people in the context of its existing communities. Given everyone around you is doing this thing, not doing the thing might be quite the bad idea.

What I am pushing back against is the more general claim that people can intuit what is good for them, to the extent that people know accurately sense when their religion is or isn’t working out. Religion is mostly an adaptation, and religious beliefs are often real whatever the original motivation for selecting those beliefs. People are Adaptation-Executers, not Fitness-Maximizers.

Usually people aren’t trying to intuit anything at all, they’re just doing what they are in the habit of doing, and what they see others in the habit of doing, following the ancient principles of fitting into a tribe, because that’s typically a recipe for local success. Often these strategies are much smarter than they look. But when what is good for people doesn’t match those instincts and habits, people don’t see it. Trying to out-think others, or intentionally coordinate with them, is a rough road.

XIII – Politics

Once again, we have puzzles: People vote without (much) regard for vote decisiveness, they vote when they know they are uninformed, they have entrenched opinions and strong emotions on political issues. If we are political ‘do-rights’ trying to enact the best policies, these actions do not make sense. Even more puzzling, we don’t seem to vote according to our narrow self-interests either.

But as we all know, choosing the best policies is not what most politics is mostly about. Politics is mostly about being in coalitions and showing loyalty to that coalition. In many times and places, members of the political outgroup are not taken kindly to, so one needs to show loyalty to the ingroup and its political viewpoints.

That doesn’t mean politics isn’t ultimately largely about policy. These coalitions involve many actors who do care deeply about certain policies, often out of narrow self-interest but also often as genuine do-rights. The policy wonks and idealists are real, and views on issues often do shift for the right reasons, not only the wrong ones. We all understand that a politics completely about alliances would result in the rapid collapse of the republic, with devastating consequences for almost everyone. Many fear that is well underway.

So we really do reward those who work for the common good and punish those who do not, in addition to worrying about alliances. Others reward those who reward the common good, and so forth. The relative power working towards policy ebbs and flows with the times, the culture, the norms. Occasionally this even results in good policy. It hasn’t been an especially good time for that, recently. But I am old enough to remember a time when this was far more of a thing.

XIV – Scorecard

Chapter % Claims Accepted Y= Z= X about Y more than Z?

Body Language 100% N/A Info N/A

Laughter 100% Jokes Playfulness No

Conversation 50% Info Showing Off Yes

Consumption 50% You Conspicuousness Yes

Art 100% Insight Fitness Display No

Charity 90% Helping Fuzzies/Signaling No

Education 100% Learning Signaling No

Medicine 110% Health Conspicuous Caring No

Religion 90% God Community No

Politics 100% Policy Alliances No

On average, this adds up to buying about 90% of claims. For a book making so many bold claims, that’s very good.

Ranked from most about Y to least about Y:

Food isn’t about Nutrition

Bedrooms aren’t about Sleep

Talk isn’t about Info

Consumption isn’t about You / Clothes aren’t about Comfort

Research isn’t about Progress

Politics isn’t about Policy

Consulting isn’t about Advice

Marriage isn’t about Romance

School isn’t about Learning

Medicine isn’t about Health

Art isn’t about Insight

Church isn’t about God

XV – Conclusion

X is about a lot more than Y. Often X is about Z far more. Even if X is mostly about Y on some levels, it is mostly about Z on others. But we fear punishment and social collapse if we claim or even believe this.

This is a sort of argument for modesty in the ‘believe and act like if you know what’s good for you’ sense – you should profess the same beliefs you see around you because they are chosen strategically, even if they’re false. You should do the same actions you see, because they have hidden social motives and purposes, and people will punish you for acting differently even if they don’t know why acting differently might be bad here – holding out for that explanation is not a chance they are willing to take. Nice human you have there. It would be a shame if someone were to ostracize it or lower its status.

It’s also an argument thateveryone is lying to you, all the time, and you know it. Disinformation is everywhere, requiring local modeling. Trusting the ‘expert consensus’ means trusting people who are lying their asses off. All the time. Being more accurate than people who are lying their asses off all the time sounds doable. Everyone is already doing it! Our elephants instinctively adjust for this lying. It also means everyone’s effort is mostly going to other things, so again you should have a relatively easy time doing better. The question is how.

All this hypocrisy and self-deception is how we got here and have all the big brains and nice things. Without it we’d be able to accomplish things more efficiently, but we’d also lose our pro-social norms and things would fall apart. So how do we explicitly explore these concepts and get the benefits, without bringing the whole tower down on our heads?

Everyone punishes those who are not hypocrites in such ways. They also punish anyone who is caught being a hypocrite. When people figure out that no one does the thing they are supposedly doing, and everyone who knows this is lying about it, they almost always conclude there’s a norm to keep lying about it, and start lying themselves lest they be torn apart by unknown enforcement mechanisms. How do we communicate about such things explicitly without bringing this wrath down on us?

You just do it. A little. Then you realize nothing happened. No one is coming for you.

So you do it some more. Nothing happens. No one comes.

Until you shout it from the rooftops, for years. And still nothing happens.

Our instincts say such talk is dangerous, but it isn’t. What is dangerous are to speak against key norms, or the in-vogue symbols of group loyalty. There are certain things you absolutely cannot say without risk of disaster. They vary from place to place and time to time. Some are true, some are false. All of them are on the list because enough people actually say them, or they are evidence of things people actually believe.

So… don’t say them in the wrong company. That simple. You don’t need to. When they’re true, they’ll be implied. When they’re false, they won’t be.

No one expects you to go meta on the situation. Hansonian claims are fine. Vassarian claims are fine. Yudkowskian claims are fine.

You just can’t be a hypocrite about it.

Or rather, you absolutely must be a hypocrite about it, but be careful to not be caught.

There’s no need to be a hypocrite about being a hypocrite. People are watching you to see what will happen if they press a button and see what stock response you send. Will you pull out the slip of paper containing the appropriate answer? That’s what they are checking. They don’t care what your underlying logical algorithm is; that’s not very correlated with the slips of paper that come out when you press buttons, whereas your loyalty is highly correlated with those paper slips. If your logic says that what you write on those slips is about loyalty, but you pull out the right slips of paper, does that make you less loyal? Or more loyal? I’m not even sure.

The CliqueBots roam the land to strike down those who do not say the Shibboleth. They’re not looking for your logic, unless it bumps into one of the forbidden moves.

So now that you can talk about it, now what? How do we make things better?

On a personal level, we have a better world-model. We now know that medicine isn’t about health and politics usually isn’t about policy, and so on. So we can better understand what others will do, and how to motivate them – we need to give them motivations about conspicuous caring and alliances, without saying explicitly that we are doing that. We in turn can notice when our actions are conspicuous caring or alliance formation, and decide whether that’s a wise thing to do in context.

On a societal level, we now understand why we can’t ‘just’ do the medicine that improves health, or the politics that improves policy. We know more about why people are doing what they are doing, how the system ticks, what keeps it working, what might break it down. We can more usefully ask where to push on it, or how to compete against it. If we want to sell people on prediction markets, we can ask how we might frame them such that they might get buy-in. If we want to cut health care spending, we can ask how to frame such cuts as caring rather than not caring. Perhaps, for example, we should more share horror stories about over-treatment at end of life, and pressure to use it, and ask how we could care so little as to allow that. Use the system against itself.

We can also recognize that the Zs in question are not bad things. There’s nothing wrong with signaling, conspicuous caring, forming alliances, building communities and displaying one’s fitness. These are human needs. If we squeeze them out of one place, they’ll show up in another. So is searching for hypocrites. It gives us motivation to stay consistent; rationalists might not need such motivation, but most others do. Fear of looking hypocritical keeps them on their toes. We shouldn’t be the hypocrites who condemn such motives, any more than we should be the explicit hypocrites who say we’re doing medical care to show caring and playing politics to build alliances, except instrumentally or additionally. Let us not disrespect the Y that X is not about, for it is about that too!

And this allows us to listen to the elephant, and cooperate with it. It knows more than you do, and faster. It brings wisdom. We can and must be aware of it, guide it, train it, but also trust it, and play the game with everyone else. After enlightenment, chop wood, carry water. But the good wood, and the right water.