Gentzel

Sur­viv­ing and Shap­ing Long-Term Com­pe­ti­tions: Les­sons from Net Assessment

• Gentzel 18 Apr 2023 11:33 UTC

  13 points

  4

  on: Moder­a­tion notes re: re­cent Said/​Dun­can threads

  My model of the problem boils down to a few basic factors:

  1. Attention competition prompts speed and rewards some degree of imprecision and controversy with more engagement.

  2. It is difficult to comply with many costly norms and to have significant output/​win attention competitions.

  3. There is debate over which norms should be enforced, and while getting the norms combination right is positive-sum overall, different norms favor different personalities in competition.

  4. Just purging the norm breakers can create substantial groupthink if the norm breakers disproportionately express neglected ideas or comply with other neglected and costly but valuable norms.

  5. It is costly for 3rd parties to adjudicate and intervene precisely in conflicts involving attention competition, since they are inherently costly to sort out.

  General recommendations/​thoughts:

  1. Slow the pace of conversation, perhaps through mod rate limits on comment length and frequency or temporary bans. This seems like a proportional response to argument spam and attention competition, and would seem to push toward better engagement incentives without inducing groupthink from overzealous censorship.

  2. If entangled in comment conflict yourself, aim to write more carefully, clearly, and in a condensed manner that is more inherently robust against adversarial misinterpretation. If the other side doesn’t reciprocate, make your effort explicit to reduce the social cost of unilaterally not responding quickly (e.g. leaving a friendly temporary comment about responding later when you get time to convey your thoughts clearly).

  3. To the degree possible, reset and focus on conversations going forward, not publicly adjudicating who screwed-up what in prior convos. While it is valuable to set norms, those who are intertwined in conflict and stand to competitively benefit from the selective enforcement of the norms they favor are inherently not credible as sources of good norm sets.

  In general we should be aiming for positive-sum and honest incentives, while economizing in how we patch exploits in the norms that are promoted and enforced. Attention competition makes this inherently hard, thus it makes sense to attack the dynamic itself.

• Gentzel 6 Jun 2021 18:09 UTC

  1 point

  in reply to: Vanilla_cabs’s comment on: Rules for Epistemic War­fare?

  I am not sure that is actually true. There are many escalatory situations, border clashes, and mini-conflicts that could easily lead to far larger scale war, but don’t due to the rules and norms that military forces impose on themselves and that lead to de-escalation. Once there is broader conflict though between large organizations, then yes you often do often need a treaty to end it.

  Treaties don’t work on decentralized insurgencies though and hence forever wars: agreements can’t be credibly enforced when each fighter has their own incentives and veto power. This is an area where norm spread can be helpful, and I do think online discourse is currently far more like waring groups of insurgents than waring armies.

• Gentzel 6 Jun 2021 17:56 UTC

  1 point

  in reply to: ChristianKl’s comment on: Rules for Epistemic War­fare?

  Why would multi-party conflict change the utility of the rules? It does change the ease of enforcement, but that’s the reason to start small and scale until the advantages of cooperating exceed the advantages of defecting. That how lots of good things develop where cooperation is hard.

  The dominance of in-group competition seems like the sort of thing that is true until it isn’t. Group selection is sometimes slow, but that doesn’t mean it doesn’t exist. Monopolies have internal competition problems, while companies on a competitive market do get forced to develop better internal norms for cooperation, or they risk going out of business against competitors that have achieve higher internal alignment via suppressing internal zero-sum competition (or re-aligned it in a positive-sum manner for the company).

• Gentzel 6 Jun 2021 17:44 UTC

  1 point

  in reply to: Dagon’s comment on: Rules for Epistemic War­fare?

  I don’t think you are fully getting what I am saying, though that’s understandable because I haven’t added any info on what makes a valid enemy.

  I agree there are rarely absolute enemies and allies. There are however allies and enemies with respect to particular mutually contradictory objectives.

  Not all war is absolute, wars have at times been deliberately bounded in space, and having rules of war in the first place is evidence of partial cooperation between enemies. You may have adversarial conflict of interest with close friends on some issues: if you can’t align those interests it isn’t the end of the world. The big problem is lies and sloppy reasoning that go beyond defending one’s own interests into causing unnecessary collateral damage for large groups. The entire framework here is premised on the same distinction you seem to think I don’t have in mind… which is fair because it was unstated. XD

  The big focus is a form of cooperation between enemies to reduce large scale indiscriminate collateral damage of dishonesty. It is easier to start this cooperation between actors that are relatively more aligned, before scaling to actors that are relatively less aligned with each other. Do you sense any floating disagreements remaining?

• Gentzel 6 Jun 2021 17:27 UTC

  3 points

  in reply to: Dagon’s comment on: Rules for Epistemic War­fare?

  That’s totally fair for LessWrong, haha. I should probably try to reset things so my blog doesn’t automatically post here except when I want it to.

Rules for Epistemic War­fare?

• Gentzel 17 Mar 2021 19:37 UTC

  2 points

  in reply to: MichaelA’s comment on: Mod­ern­iza­tion and arms con­trol don’t have to be en­e­mies.

  I agree with this line of analysis. Some points I would add:

  -Authoritarian closed societies probably have an advantage at covert racing, at devoting a larger proportion of their economic pie to racing suddenly, and at artificially lowering prices to do so. Open societies have probably a greater advantage at discovery/​the cutting edge and have a bigger pie in the first place (though better private sector opportunities compete up the cost of defense engineering talent). Given this structure, I think you want the open societies to keep their tech advantage, and make deployment/​scaling military tech a punishment for racing by closed societies. -Your first bullet seems similar to the situation the U.S. is in now, Russia and China just went through a modernization wave, and Russia has been doing far more nuclear experimentation while the U.S. talent for this is mostly old or already retired + a lot of the relevant buildings are falling apart. Once you are in the equilibrium of knowing a competitor is doing something and your decision is to match or not, you don’t have leverage to stop the competitor unless you get started. Because of how old a lot of U.S. systems are/​how old the talent is, Russia likely perceived a huge advantage to getting the U.S. to delay. A better structure for de-escalation is neutral with respect to relative power differences: if you de-escalate by forfeiting relative power you keep increasing the incentive for the other side to race.

  There are some other caveats I’m not getting into here, but I think we are mostly on the same page.

• Gentzel 17 Mar 2021 19:16 UTC

  1 point

  in reply to: MichaelA’s comment on: The Fu­ture of Nu­clear Arms Con­trol?

  Some of the original papers on nuclear winter reference this effect, e.g. in the abstract here about high yield surface burst weapons (e.g. I think this would include the sort that would have been targeted at silos by the USSR). https://​​science.sciencemag.org/​​content/​​222/​​4630/​​1283

  A common problem with some modern papers is that they just take soot/​dust amounts from these prior papers without adjusting for arsenal changes or changes in fire modeling.

• Gentzel 3 Mar 2021 13:10 UTC

  1 point

  in reply to: cistran’s comment on: The Fu­ture of Nu­clear Arms Con­trol?

  This is what the non-proliferation treaty is for. Smaller countries could already do this if they want, as they aren’t treaty limited in terms of the number of weapons they make, but getting themselves down the cost curve wouldn’t make export profitable or desirable because they have to eat the cost of going down the cost curve in the first place and no one that would only buy cheap nukes is going to compensate them for this. Depending on how much data North Korea got from prior tests, they might still require a lot more testing, and they certainly require a lot more nuclear material which they can’t get cheaply. Burning more of their economy to get down the cost curve isn’t going to enable them to export profitably, and if they even started it could be the end of the regime (due to overmatch by U.S. + Korea + Japan). The “profit” they get from nukes is in terms of regime security and negotiating power… they aren’t going to throw those in the trash. They might send scientists, but they aren’t going to give away free nukes, or no one is going to let planes or ships leave their country without inspection for years. The Cuban missile crisis was scary for the U.S. and USSR, but a small state making this sort of move against the interest of superpowers is far more likely to invite an extreme response (IMO).

• Gentzel 24 Feb 2021 20:46 UTC

  2 points

  in reply to: Jacopo Baima’s comment on: The Fu­ture of Nu­clear Arms Con­trol?

  I generally agree with this thought train of concern. That said, if the end state equilibrium is large states have counterforce arsenals and only small states have multi-megaton weapons, then I think that equilibrium is safer in terms of expected death because the odds of nuclear winter are so much lower.

  There will be risk adaptation either way. The risk of nuclear war may go up contingent on their being a war, but the risk of war may go down because there are lower odds of being able to keep war purely conventional. I think that makes assessing the net risk pretty hard, but I doubt you’d argue for turning every nuke into a civilization ender to improve everyone’s incentives: at some point it just isn’t credible that you will use the weapons and this reduces their detergent effect. There is an equilibrium that minimizes total risk across sources of escalation, accidents, etc. and I’m trying to spark convo toward figuring out what that equilibrium is. I think as tech changes, the best equilibrium is likely to change, and it is unlikely to be the same arms control as decades ago, but I may be wrong about the best direction of change.

• Gentzel 24 Feb 2021 20:36 UTC

  1 point

  in reply to: cistran’s comment on: The Fu­ture of Nu­clear Arms Con­trol?

  Precision isn’t cheap. Low yield accurate weapons will often be harder to make than large yield inaccurate weapons. A rich country might descend the cost curve in production, but as long the U.S. stays in an umbrella deterrence paradigm that doesn’t decrease costs for anyone else, because we don’t export nukes.

  This also increases the cost for rogue states to defend their arsenals (because they are small, don’t have a lot of area to hide stuff, etc.), which may discourage them from gaining them in the first place.

• Gentzel 24 Feb 2021 20:30 UTC

  3 points

  in reply to: ESRogs’s comment on: The Fu­ture of Nu­clear Arms Con­trol?

  I meant A. The Beirut explosion was about the yield of a mini-nuke.

• Gentzel 15 Feb 2021 10:22 UTC

  1 point

  in reply to: lsusr’s comment on: The Fu­ture of Nu­clear Arms Con­trol?

  I could imagine unilateral action to reduce risk here being good, but not in violation of current arms control agreements. To do that without breaking any current agreements, that means replacing lots of warheads with lower yields or dial yields, and probably getting more conventional long-range precision weapons. Trying to replace some sub-launhed missiles with low yield warheads was a step in that direction.

  There’s a trade-off between holding leverage to negotiate, and just directly moving to a better equilibrium, but if you are the U.S., the strategy shift may just increase your negotiating power since the weapons are more useable.

  The main thing I want to advocate is for people to debate these ideas to see if there is a potentially better equilibrium to aim for, and to chart a path to it. I don’t want people to blindly assume I am right.

The Fu­ture of Nu­clear Arms Con­trol?

• Gentzel 19 Dec 2020 23:20 UTC

  2 points

  in reply to: supposedlyfun’s comment on: Epistemic Warfare

  I think you need legible rules for norms to scale in an adversarial game, so it can’t be direct utility threshold based rules.

  Proportionality is harder to make legible, but when lies are directed at political allies that’s clear friendly fire or betrayl. Lying to the general public also shouldn’t fly, that’s indiscriminate.

  I really don’t think lying and censorship is going to help with climate change. We already have publication bias and hype on one side, and corporate lobbying + other lies on the other. You probably have to take another approach to get trust/​credibility when joining the fray so late. If there were greater honesty and accuracy we’d have invested more in nuclear power a long time ago, but now that other renewable tech has descended the learning curve faster different options make sense going forward. In the Cold War, anti-nuclear movements generally got a bit hijacked by communists trying to make the U.S. weaker and to shift focus from mutual to unilateral action… there’s a lot of bad stuff influenced by lies in distant past that constrain options in the future. I guess it would be interesting to see what deception campaigns in history are the most widely considered good and successful after the fact. I assume most are ones with respect to war, such as ally deception about the D-Day landings.

• Gentzel 19 Dec 2020 22:52 UTC

  1 point

  in reply to: cousin_it’s comment on: Epistemic Warfare

  It’s not an antidote, just like a blockade isn’t an antidote to war. Blockades might happen to prevent a war or be engineered for good effects, but by default they are distortionary in a negative direction, have collateral damage, and can only be pulled off by the powerful.

• Gentzel 19 Dec 2020 22:46 UTC

  1 point

  in reply to: ChristianKl’s comment on: Epistemic Warfare

  While it can depend on the specifics, in general censorship is coercive and one sided. Just asking someone to not share something isn’t censorship, things are more censorial if there is a threat attached.

  I don’t think it is bad to only agree to share a secret with someone if they agree to keep the secret. The info wouldn’t have been shared in the first place otherwise. If a friend gives you something in confidence, and you go public with the info, you are treating that friend as an adversary at least to some degree, so being more demanding in response to a threat is proportional.

Epistemic Warfare

• Gentzel 11 Nov 2020 22:54 UTC

  1 point

  in reply to: crl826’s comment on: Com­pet­i­tive Univer­sal Ba­sic Ser­vices?

  Vouchers could be in the range of competition, but if people prefer basic income to the value they can get via voucher at the same cost-level then there has to best substantial value that the individual doesn’t capture to justify it. School vouchers may be a case of this, since education has broader societal value.