Corporations as Paperclip/Profit Maximizers
Preface: This Essay explores the analogy between corporations, biological systems and misaligned artificial intelligence (AI), not to argue that they are equivalent, but to suggest that the comparison may yield valuable insights for alignment research.
Whether or not one finds the analogy compelling, the lessons it suggests—particularly in regard to goal alignment and control—are worthy of deeper consideration.
This will improve both regulatory oversight for corporations as well as give new perspectives to AI safety researchers.
I am assuming the reader is aware of the parable of the paperclip maximizer. (<-please click the link if you don’t)
”Paperclip” will be used as a signal word, signifying a moment when a system, in the process of optimization, has left the desired path of human flourishing.
I would deeply appreciate your thoughts, critiques, and suggestions to help make this piece more useful and insightful—for alignment thinkers, system designers, and anyone interested in the intersection of ethics and optimization. Comments are warmly welcomed.
And lastly—a small apology. This essay grew larger than intended. I hope that within its branching paths, readers find at least a few fruitful ideas worth pursuing.
Context: Some other texts have been written on this topic:
Both of these articles do not state that Corporational AI has a systemic requirement of profit generation that go beyond the openly declared goal of the company.
E.Yudkowskis Corporations vs. Superintelligence is comparing corporations with ASI
Daniel Kokotajlos Analysis of Analogies between different forms of Intelligence
These two have a bit more critical views of corporations but are not very analytic in their writing:
Charlie Stross CCC talk about Corporations as Paperclip Maximizers
Ted Chiangs Essay about Silicon Valley Corporations painting the AI-Threat in their image
TL;DR
This essay draws an analogy between corporations, biological organisms, and misaligned AI, arguing that their shared reliance on core imperatives—profit, food, and electricity—drives optimization behaviors that can conflict with human values. By viewing corporations as systems with embedded goals, we uncover insights for aligning them with societal well-being, much like AI alignment research. The essay explores historical automation trends, corporate misalignment, and alternative organizational models like cooperatives and NGOs, proposing strategies to rewire corporate incentives for broader impact.
Estimated Reading Time: ~25 minutes for the full essay.
See Automation and the Paperclip Moment (~5 min) and Lessons from AI Alignment (~4 min) for parallels between corporate optimization and AI goal misalignment.
See Rewiring the Corporate Operating System (~6 min) for practical strategies to align corporate behavior with societal goals.
See Alternative Organizational Blueprints (~7 min) for a systems theory analysis of cooperatives, NGOs, and mission-driven hybrids.
Profit as the Food of Business
To begin, one needs to understand that just as living organisms cannot survive without the constant influx of food , or an AI system cannot function without a steady supply of electricity, a corporation’s survival hinges on one non-negotiable rule: generating enough revenue to cover its bills.
This isn’t a matter of human choice or occasional prioritization—it’s a fundamental aspect of corporate existence, as intrinsic to its “biology” as breathing is to a human or power is to a machine.
Consider the human body: it is a marvel of coordinated processes that all depend on one thing—Food. Without matter to burn for energy, even the most well-adapted (heterotrophic[1]) organism would cease functioning. We can fast for some time, and only run on reserves, but eventually we need a way to supply energy to our body.
Corporations as Organisms
Corporations can be understood as state organisms—complex entities formed by many individuals (cells) working together under specialized roles to sustain and grow the whole. Just like in biological state organisms, each part of a corporation—departments, teams, and even individual employees—plays a specific function, from digesting data to defending against threats. Over time, as corporations grow, they become more specialized and interdependent, to the point where a single part rarely survives independently.
Like an ant colony or a human body, the health of the whole depends on communication (akin to a nervous system), resource flow (finances), and cooperation across all parts. In this view, corporations are not just organizations, but living systems—evolving, adapting, and competing within a larger ecosystem of markets and societies.
In the corporate world, revenue is not discretionary. Just as muscles need energy to contract and the brain requires glucose to keep neurons firing, every department, every project, and every innovation in a corporation is ultimately accountable to the bottom line.
Food consumption is an required action that sustains (heterotrophic[1]) life. No matter how sophisticated or creative an organism is, its survival depends on the regular intake of carbon sources. In parallel, a corporation’s operations—whether it’s developing products, engaging with customers, or innovating new solutions—are driven by the need to continually generate profit. This isn’t to suggest that corporations are “alive” in a biological sense, but rather to underscore the structural dependency: without adequate revenue, the corporate body ceases to function, just as a human body without food slips into first degeneration and finally collapse.
Electricity as the Food of AI
For an AI system, electricity is the lifeblood that powers computation and decision-making. An interruption in power can render an AI inert or lead to catastrophic errors if it suddenly shuts down mid-process. Corporations, too, depend on a steady “current” of financial resources. Just as a faltering power supply can hinder an AI’s performance, inconsistent revenue streams can jeopardize a company’s operations—forcing cutbacks, stalling innovation, or even pushing the business into obsolescence.
When we consider any AGI, whether its aligned or not, it will need massive amounts electricity and processing hardware. It will always make sure it has a stable resilient energy supply, the alignment might only change what kind power plant it will build.
Eating is an embedded Imperative
The first takeaway then is that for both living creatures and engineered systems, certain processes are not optional but embedded imperatives. For corporations, generating profits is not an added goal; it’s their built-in operating system—a core directive, almost hardcoded into their governance structures. This “genetic makeup” explains why attempts at corporate alignment (or realignment) can seem so Sisyphean.
Corporations do not operate in a vacuum; they are embedded in a broader political and economic system that often exerts powerful pressure to prioritize profit above all else. Shareholder activism[2] frequently pushes executives to focus on short-term returns, lest they face replacement or hostile takeovers. This short-termism is reinforced by quarterly earnings expectations and the logic of financial markets, which reward immediate gains over long-term resilience or ethical foresight. Layered over this is the pervasive influence of economic ideologies, particularly neoliberalism, which praise market efficiency, competition, and shareholder value as ultimate goods. Within such a framework, even well-meaning corporate leaders are structurally nudged toward decisions that maximize profit, often at the expense of social or environmental outcomes. The result is a systemic bias that makes alternative values—like sustainability, equity, or dignity—harder to defend unless they can be reframed as profitability-enhancing.
The Corporate Drive for Automation
We have established that Corporations can be seen as intelligent autonomous systems, they are not biological but follow an artificial embedded goal to maximize revenue.
To grow, and ultimately pay out profits to shareholders.
This serves as a motivation for the market hivemind, that according to Friedman is ruled by Greed and Fear. The reason it is the best current system for raising nations out of poverty is, that the entity has to feed its cells (its employees). As there are many competing entities, the best paying one will draw the best cells and thus succeed in generating more revenue than needed to sustain itself. This will make each employee able to raise their living standards.
– Steam (pink), water (blue)
– Valves open (green), valves closed (red) (source Wikipedia)
However Corporations have always been driven by the quest for efficiency and profit, and automation is one of their most powerful tools. Historically, the desire to automate emerged from very practical economic pressures. In 18th-century Britain, for example, physical labor—in the form of slaves or horses—was expensive. When it came to the grueling task of pumping water out of mines, the high cost of animal and human labor spurred inventors to develop mechanical solutions. Early steam engines, such as those pioneered by Newcomen, were not just marvels of engineering; they were also the first steps in a long journey toward automation. In one case a colliery paid the Proprietors £200 per year and half their net profits “in return for their services in keeping the engine going”.[wiki] Steam engines did not complain, did not need food and shelter, did not need to sleep and could theoretically run indefinitely—if supplied with continuous energy in the form of coal.
As technology evolved, so did the scope of automation. Once focused on the brute force of moving water or turning heavy machinery, automation gradually penetrated the realm of mechanical work. Corporations discovered that if they could automate physical tasks, they could reduce costs and increase productivity—a dynamic that fueled the Industrial Revolution. With each innovation, from textile mills to assembly lines, automation reshaped industries and redefined labor markets.
Coal as the first Paperclip Moment
If early companies using steam engines were proto-artificial agents, then coal was their first “paperclip moment”. They based their main productivity on the principle of converting thermal energy into mechanical work.
Just as the classic paperclip maximizer relentlessly seeks more material to fulfill its purpose, steam engines operated under a similar logic. The companies did not want coal, but they needed it, and the systems built around them adapted accordingly. Mines expanded, supply chains developed, and entire economies began revolving around this one input.
But this dependency came with a cost. Coal-powered engines may have reduced labor expenses and fueled productivity, but they also filled cities with smog, degraded air quality, and contributed to massive public health crises. In 19th-century London, coal smoke darkened the skies and blackened lungs—an early case study in how technological optimization for one variable (efficiency) can lead to externalities that society is left to absorb.
We will assume, that the companies were not malicious, but they were indifferent.
In retrospect, coal burning triggered hidden societal costs, as the system optimized only on maximizing profits, and the environmental costs were not included into the bills. Legal frameworks made to protect the workers and environment, later changed this, and tried to ensure that a company operates within constraints that are aligned with broader human values[3]. a point we will get to later.
From Steam to Silicon
The logic of automation did not stop with steam. As industries matured, the next great leap came with the automobile. Originally a luxury, cars quickly became essential to the expanding industrial economy. Horses and their supportive infrastructure became extinct, making space for cars.
Corporations like Ford Motor Company pioneered the assembly line—not to liberate workers from toil, but to increase output and reduce unit cost. The famous moving assembly line was not a humanitarian project; it was a mechanical orchestration of labor, engineered to extract maximum efficiency from human and machine alike. The success of this model further embedded the idea that optimizing processes—regardless of the human toll—was the rational path to profit.
The next stage came not from the factory floor, but from military command centers. The digital computer, initially designed for wartime calculations such as artillery targeting and codebreaking, was another tool whose origins were strategic but whose implications were economic. Once declassified and commercialized, computing became the new frontier of automation—this time not of muscle, but of mind. Where the steam engine replaced the muscle, the computer began to replace the brain. Spreadsheets, databases, and algorithms automated planning, logistics, and decision-making. Just as corporations had previously reduced their reliance on manual labor, they now found ways to minimize cognitive labor as well.
The introduction of industrial robots in the late 20th century—ironically named from the Czech word robota, meaning labor—was a natural synthesis of these trends. Where humans were once essential for dexterous or adaptive tasks, robots brought precision, endurance, and predictability. They didn’t strike, didn’t get tired, and could be scaled as easily as software. From welding in car factories to sorting in logistics centers, robots became another layer in the corporate pursuit of efficiency.
Each new step in automation was not driven by malice, but by the same core imperative: minimize cost, maximize output, and deliver value to shareholders. And with each step, the system as a whole became more optimized, but also more indifferent. Like the paperclip maximizer, these corporate structures did not hate humans—they simply didn’t notice them. Automation, in this sense, is not a conspiracy but a consequence: the predictable result of a system where the reward signal is profit and the loss function does not penalize for externalities—unless explicitly programmed to do so by law, regulation, or public outcry.
Today, the frontier of automation is increasingly cognitive. Corporations are now eager to automate tasks that require human thought—writing reports, generating code, designing visuals, even composing music. Modern AI systems can now produce content that closely resembles human output, not because they understand it, but because they optimize for statistical coherence within patterns learned from vast datasets.[4] This marks a profound transition—from automating the body to automating the mind.
In practice, this means that tasks like drafting sustainability reports, responding to customer inquiries, or generating marketing content are increasingly handled by automated workflows. These systems are preferred not because they are smarter or more ethical, but because they are tireless, consistent, and, crucially, cheaper. Unlike human employees, they don’t take sick days, require sleep, or negotiate salaries. A machine only asks for electricity—and the occasional software update. In this light, engineers become the new HR department, not managing people but replacing them, line by line, workflow by workflow.
This evolution, like every stage before it, is not accidental. It is driven by the same economic imperative that has guided corporate behavior since the steam engine: reduce costs, increase efficiency, and maximize shareholder returns. Intelligence, in this context, is not sacred—it is just another input to be optimized.
Implications for Corporate Strategy and Ethics
Understanding profit as the food of corporation forces us to confront a harsh reality. Any attempt to redirect corporate behavior towards broader societal good must contend with this core biological imperative. Regulatory measures, ethical incentives, or revamped charters can help guide corporate actions toward more balanced outcomes, but they are constantly working against a system engineered for profit maximization. Recognizing this embedded drive is a necessary step in designing mechanisms that don’t just encourage, but fundamentally rewire, how corporations allocate their resources and measure success.
If we are to build institutions—and indeed, a society—that can harmonize economic efficiency with ethical responsibility, we must appreciate that the drive for profit is both the source of corporate strength and its Achilles’ heel. In this light, efforts to “align” corporations should not merely be about nudging behavior at the margins; they must address the very core of corporate existence, possibly reimagining the metrics by which corporate success is defined.
The UN attempt
At the turn of the millennium, a working group of the UN Human Rights Council attempted to impose direct obligations on companies under international law. This would have imposed clear human rights obligations on corporations and granted extensive rights to victims of corporate crimes, trade unions and NGOs. However, business associations, supported by countries of the Global North, blocked these planned UN norms for transnational corporations and human rights.
Instead, they propagated voluntary corporate responsibility through Corporate Social Responsibility (CSR). In 1999, the then UN Secretary-General Kofi Annan launched the Global Compact, a CSR initiative at the UN, at the World Economic Forum. The Compact was intended to anchor CSR—i.e. social responsibility—in companies and promote cooperation between the UN and the corporate sector through a common language. The declared aim of the masterminds behind the Global Compact was to give companies a “human face” and establish them as “good corporate citizens”, as was repeated in speeches, press releases and policy documents.
Towards Alignment Measures That Matter
What if we could change the corporate operating system so that its metabolic process wasn’t just about profit, but also about enhancing social and environmental well-being?
Corporations are hardwired to prioritize profit above all else. This isn’t a moral failing in the conventional sense—it’s a design feature. Like ATP fueling a cell, profit sustains every facet of a company’s operations: funding innovation, paying wages, maintaining capital assets, and even enabling expansion. When we talk about aligning corporations with broader human values, we’re really asking whether it’s possible to reprogram that embedded imperative.
Using the analogy from AI alignment research, we can see corporations as large-scale decision-making systems that have been “optimized” for one objective. Yet the same research warns us about the dangers of narrow objectives. The corporate version of this, as many of us know, is the drive to produce ever-increasing profits at the expense of social and environmental health.
Concretely Re-Wiring the Corporate Operating System
To begin aligning corporations with broader societal interests, we must first understand that any measure must interact directly with that deep-seated need for profit. I am suggesting here some measures, to nudge corporations to more aligned systemic behavior. Some of them are already being pursued, others are being dismantled as we speak.
1. Embedding Multi-Dimensional Goals into Corporate Charters
Just as developers are starting to embed ethical constraints into AI algorithms, we can require that a company’s founding documents include provisions for environmental stewardship, social justice, and community well-being. By legally mandating that the corporation pursues a balance of profit and societal benefit, we inject a kind of “ethical metabolism” into the corporate DNA.
2. Transparent, Real-Time Impact Monitoring
For an AI system, the flow of data is essential to maintaining proper operation. For corporations, transparency can serve as that monitoring system. Imagine mandatory real-time dashboards that track key performance indicators across both profit and social impact domains. Using modern technologies like blockchain to ensure data integrity, regulators and stakeholders could continuously verify that a corporation’s “metabolism” (its cash flow and profit generation) is also complemented by measures that reflect ethical performance.
3. Adaptive Regulatory Feedback Loops
In software development, feedback loops ensure that the system can dynamically adjust when it deviates from its desired behavior. Corporations, too, could benefit from dynamic oversight mechanisms. Regulatory bodies could implement a system where corporations undergo periodic, enforced recalibration—much like a thermostat that adjusts based on current conditions. For instance, if a company’s social or environmental indicators dip below a pre-established threshold, automatic corrective measures (financial penalties, operational audits, etc.) could kick in to realign the company’s priorities.
4. Redesigning Incentive Structures
At the heart of corporate behavior is the incentive system. Current performance metrics center almost exclusively on financial outcomes. To foster a more balanced corporate organism, compensation schemes—especially for executives—should be redefined to include long-term social and environmental impact metrics. Bonus systems might factor in improvements in community welfare, reductions in carbon footprint, or advancements in workforce wellbeing.
5. Stakeholder Governance and Distributed Decision-Making
Distributed control is essential for avoiding catastrophic failures in monolithic systems. Corporations could be restructured to include stakeholder councils that represent a broader cross-section of society. These bodies would not only provide oversight but also actively participate in decision-making. By diluting the singular drive for profit with input from employees, customers, community leaders, and environmental experts, companies would become more like a well-balanced organism that processes diverse signals rather than a single-minded machine.
Examples
Its an old example, but the public stock market is at least aimed at point 2 and 5.
Allowing anyone to participate in a shareholder conference (given they own stock) distributes the views to the broader society. The system is far from perfect however as still only people with disposable income and access to stock markets are involved.
Private equity is directly working against this point, as their mechanism is to keep decisions confidential to get a competitive edge.[5]The CSRD (Corporate Sustainability Reporting Directive) in the EU is aiming at point 1,2 and 3.
It enforces a strict catalogue of data points that every larger company has to disclose annually. This way the legal body has a way of seeing how the entities within are optimized. The CSRD is not doing any penalizing, incentivizing or alike, it simply registers, publishes and allows new legal designs.The EcoVadis Sustainability Rating is aiming at point 1,2 and 4.
It gives companies a vetted badge, they can use to certify their “metabolism” to other partners. Enabling your company or division to gain a “gold” or “platin” badge in EcoInvent is a big prestige, and management is incentivized to archive these high standards.
Circumventing the Rules: How the System Fights Back
While alignment measures aim to keep corporations in check, many companies are actively finding ways to bypass these safeguards. Here are several key strategies they employ:
Lobbying and Regulatory Capture
Corporations often use their financial power to influence regulatory bodies, ensuring that new alignment measures either get watered down or sidestepped entirely. By building strong relationships with policymakers, they can shape regulations in ways that maintain their freedom to prioritize profit, much like bypassing safety checks in an AI system.Opaque Decision-Making Processes
Similar to black-box AI systems, many corporations intentionally cultivate complexity and opacity in their internal processes. This lack of transparency makes it challenging for external auditors or stakeholders to assess whether ethical standards are being met, allowing misaligned behaviors to persist under the radar.Gaming the Metrics
Even when companies are required to report on sustainability or social impact, they sometimes focus on easily measurable metrics that make their performance look good on paper, rather than addressing deeper, systemic issues. This is akin to an AI system optimizing for the wrong objective—meeting the letter of the law without truly aligning with the intended values.Fragmenting Accountability
Corporations can sometimes compartmentalize or outsource functions in a way that diffuses responsibility. By splitting operations across multiple subsidiaries or partnering with third parties, they make it more difficult to hold any single entity accountable for broader ethical or societal impacts.Exploiting Legal Loopholes
Just as an AI finds loopholes in the rules and goal definitions, companies often exploit legal gray areas in their charters or contractual agreements. These loopholes can allow them to bypass regulations designed to enforce alignment, maintaining a focus on profit even when broader social or environmental responsibilities are clearly defined. Lawmakers act similar to AI safety engineers, trying to patch these holes before any significant damage arises, however lawmakers have to deal with a much slower implementation cycle. This leads to corporations usually gaining an advantage and using lobbying to keep a loophole open.
While these tactics are not necessarily possible to be used by AI systems, it becomes clear that a corporation has every incentive to try to change the rules that were cast upon it, and the ways it does so might serve as inspiration that AI systems will try.
Beyond the Firm – Alternative Organizational Blueprints
If we accept that the modern corporation functions like a narrow optimization system—one engineered to maximize profit for the sake of profit—then it becomes natural to ask: are there other viable architectures for organizing human effort? And if so, how do they operate?
In sociology, the kind of organizational patterns are known as Secondary social groups.
They are typically larger, more impersonal, and goal-oriented than primary groups (like family or close friends). These groups are often formed around shared interests, tasks, or roles, and relationships tend to be more formal and temporary.
But this category is far from monolithic. The modern social landscape is populated with a myriad of structured secondary groups, each with their own logic, purpose, and distribution of agency—offering us a broader design space for collective action.
These groups attract members because they either can receive something, or they can give something (and receive satisfaction in turn ;)
Work-Related Structures
These are perhaps the most familiar: corporations, startups, government departments, and professional teams. Members typically operate in receiving roles, exchanging labor or expertise for wages, benefits, and career advancement. While they vary in scale and culture, the structure tends to be hierarchical, with decision-making concentrated at the top. This model excels at sustained execution but can suffer from goal myopia or loss of moral context.
Civic and Volunteer Organizations
Here we find NGOs, activist groups, political action committees, and community initiatives. These groups are often staffed by people in giving roles, donating time, effort, or expertise toward a shared mission—whether environmental, humanitarian, or political. While less stable than corporations in terms of funding and structure, they offer compelling examples of mission-driven coordination that resists commodification.
Institutional and Bureaucratic Bodies
Hospitals, legal institutions, military units, and administrative agencies belong here. They are rigidly structured, often with clearly codified roles, and members are usually in receiving roles (e.g. professionals following institutional norms). These groups emphasize procedure and predictability and can be essential in maintaining public trust and systemic integrity—but often at the cost of agility or innovation.
Cooperatives and Economic Alternatives
In cooperatives—whether worker-owned, housing-based, or agricultural—members may be both givers and receivers. These models attempt to flatten hierarchies and return a degree of agency to the participants. Unlike traditional corporations, cooperatives are often guided by principles of democratic participation, mutual benefit, and local autonomy. They offer an intriguing blueprint for post-capitalist economic life.
Academic Institutions
Educational systems encompass a range of structured secondary groups with distinct roles and incentives. In primary and secondary schools, teachers and staff are in giving (and receiving) roles, tasked with delivering standardized instruction and developmental care, supported by state salaries and job security. But it takes quite some passion to work as a lowly payed teacher.
Students are in receiving roles, often compelled by legal mandates and social norms to participate. These schools operate under hierarchical governance, including principals, school boards, and national curricula, aiming to prepare citizens for societal participation.
In universities, roles become more complex: faculty both give through teaching and research and receive in the form of funding, status, or career advancement, while students engage out of a mix of curiosity, credential-seeking, and economic incentive. Administrative staff and leadership form a distinct management class, steering the institution like a hybrid of a bureaucracy and a market actor.
Research institutes, including labs and think tanks, revolve around the giving role of knowledge production—through publishing, mentoring, and grant writing—but researchers also receive intellectual community, institutional legitimacy, and the chance for career progression. Across all these forms, participation is sustained not just by monetary compensation, but also by social pressure, legal obligation, intellectual curiosity, and the pursuit of status or meaning.
Spiritual and Religious Organizations
Churches, sects, meditation centers, and interfaith networks present another form of coordination. Members may be receiving spiritual support, or giving through service or leadership. These groups can provide durable community bonds, ethical framing, and shared rituals—functions which modern life often neglects. Some remain deeply hierarchical, others more participatory or egalitarian.
Hobby, Sports, and Recreational Groups
From amateur sports leagues to maker clubs and local music ensembles, these groups bring structure to leisure. Members might be receiving enrichment or belonging, or giving time, creativity, or leadership. These organizations are usually mission-focused but low-stakes, making them resilient and adaptable. They demonstrate how non-instrumental motivations (like joy, curiosity, or play) can be powerful social glue.
Cultural and Creative Collectives
Writer’s groups, arts co-ops, theater troupes, and cultural preservation societies offer structured environments where members are mostly giving creatively. They don’t always scale well, but they preserve forms of meaning-making that resist commodification. They also serve as incubators of identity, narrative, and alternative values.
Online and Distributed Networks
With the rise of digital infrastructure, new forms have emerged: remote project teams, open-source communities, professional forums, and online learning collectives. Members often oscillate between giving (contribution) and receiving (engagement). While sometimes fragile, these groups highlight what becomes possible when coordination costs plummet.
In depth view of promising alternatives
The modern corporation, optimized for profit, represents just one kind of architecture. The others—volunteer networks, cooperatives, cultural labs, religious orders—embody different trade-offs and values. Some maximize resilience, others meaning. Some are decentralized, others tightly structured. But all are real-world experiments in collective intelligence.
By studying and supporting these alternatives, we begin to expand our intuition for what organized human effort can look like—beyond narrow profit loops, toward architectures that optimize for alignment, agency, and shared purpose.
Would you like me to suggest a diagram or map to illustrate these types visually? Or refine this into a publish-ready draft with citations and LessWrong formatting?
Just as researchers study AI alignment to better steer artificial agents toward humane goals, we can—and should—examine alternative organizational designs that may be better aligned with broader human values.
These designs will have to fulfill some criteria:
Their continued existence is not dependent on extracting surplus value, but on maintaining alignment with their stated missions.
Instead of being driven by internal pressure to maximize returns, these systems rely on alternative feedback loops—public trust, ethical legitimacy, and demonstrated impact.
Their inputs are structurally distinct: they draw “energy” from donations (private individuals or philanthropies), government subsidies, and volunteer labor. These resources are not unlimited, but they are decoupled from the logic of market exchange.
As a result, these organizations can optimize for goals that are often underrepresented in market economies—equity, care, education, ecological restoration—because their incentive architectures are not hardwired to return capital, but to maintain moral or social alignment. In systems theory terms, they represent an alternate attractor basin—one where success is measured not in profit margins, but in fulfillment of purpose.
et us now examine three promising organizational forms—cooperatives, NGOs, and mission-driven hybrids—through a systems theory framework. For each, we’ll consider:
Inputs: What fuels their operation?
Feedback Loops: How is alignment with purpose maintained?
Failure Modes: Where do they break down or become misaligned?
Evolutionary Pressures: What enables them to persist—or falter—over time?
| Organization | Inputs | Feedback Loops | Strengths | Shortcomings | Evolutionary Pressures |
|---|---|---|---|---|---|
| Cooperatives | Member labor, pooled capital, community commitment | Democratic voting, member alignment | High agency alignment, local resilience | Coordination challenges, limited capital access | Community coherence, ethical branding |
| NGOs | Donations, grants, volunteer time | Transparency, donor accountability, public trust | Addresses market externalities, crisis response | Funding volatility, mission drift | Funder preferences, cultural visibility |
| Service Non-Profits | Donations, grants, volunteer labor | Impact evaluations, donor trust | Tangible humanitarian outcomes, social trust | Limited innovation, funding dependence | Visible social need,empathy-driven donors |
| Capability Non-Profits | Philanthropic capital, technical talent | Research impact, thought leadership | Long-term focus, elite talent | Opaque accountability, donor influence | Elite ecosystems, long-term risk focus |
| Mission-Driven Hybrids | Revenue, impact capital | Market feedback, mission metrics, legal protections | Market efficiency, mission alignment | Greenwashing risk, profit-mission tension | High-trust markets, consumer/investor ethics |
1. Cooperatives[6]
Inputs
Cooperatives draw their resources primarily from member labor, pooled capital, and local or community-level commitment. Unlike traditional corporations, which raise capital by offering returns to external investors, co-ops prioritize member ownership—both of means and outcomes. This tends to create a tight coupling between contributor and beneficiary.
Feedback Loops
The feedback loop is democratic and internal: decisions are made by members (often on a one-person-one-vote basis), aligning power with participation. This reduces the principal-agent problem common in corporate governance, where decision-makers may be incentivized to act contrary to stakeholder interests.
Strengths
Strong agency alignment between participants and organizational mission
Tends to reinforce local autonomy, resilience, and mutual trust
Structures encourage long-term thinking over short-term profit-seeking
Shortcomings
Susceptible to coordination challenges as scale increases
Risk of inertia or groupthink in decision-making
Limited access to capital markets can restrict growth or experimentation
Evolutionary Pressures
Co-ops survive in niches where community coherence, resource sharing, or ethical branding offer comparative advantage. Their survival often hinges on whether their mission-aligned structure can outperform extractive models in terms of retention, resilience, or public goodwill.
2. NGOs[7]
Inputs
NGOs run on donations, grants, volunteer time, and institutional subsidies. Their lifeblood is mission-aligned capital: not generated through market transactions, but donated based on perceived impact.
Feedback Loops
Here, alignment is maintained through external legitimacy mechanisms: transparency, public reporting, third-party evaluations, and donor accountability. Social trust and ethical reputation serve as their core currencies.
Strengths
Capable of addressing market externalities (e.g., climate, health, education)
Mission-first logic allows pursuit of non-commercial or underfunded goods
Can rapidly mobilize around crises, values, or local needs
Shortcomings
Funding volatility leads to operational fragility
Risk of mission drift to appease donors or governments
Bureaucratic overhead can become excessive in large NGOs
Evolutionary Pressures
NGOs are shaped by the preferences of funders, regulatory regimes, and cultural visibility. They thrive in ecosystems where there is strong civic engagement, philanthropic capital, or state support. However, survival is often tied to narrative salience and the ability to maintain visibility in a crowded attention economy.
3a. Service-Oriented Non-Profits[8]
The terms “NGOs” and “service-oriented non-profits” often overlap, but there are some subtle differences.
Inputs:
Funded primarily through donations from individuals and foundations, government grants and contracts, volunteer labor, and institutional partnerships with churches or municipalities. These inputs are often steady but dependent on goodwill and public empathy.
Feedback Loops:
Alignment and success are maintained through impact evaluations (such as how many people are served or outcomes improved), public reputation, donor trust, and ethical adherence to the mission of unbiased service provision.
Strengths:
Deliver clear, tangible humanitarian outcomes
Possess long institutional memory and strong social trust
Deeply embedded in local and global civic networks
Shortcomings:
Limited capacity for innovation or R&D
Funding dependence restricts strategic flexibility
Challenges with modernization, scaling, and digital adaptation
Evolutionary Pressure:
These organizations are often locally or regionally focused with close ties to communities and thrive where there is visible, acute social need and a donor base motivated by empathy and humanitarian values. They can become fragile when competing for funding in more data-driven or outcome-focused philanthropic landscapes.
3b. Capability-Oriented Non-Profits/Foundations [9]
Inputs:
Sustain operations via philanthropic capital from technology-savvy donors (e.g., Effective Altruism circles), mission-motivated technical talent, and institutional legitimacy derived from academic or elite professional networks.
Feedback Loops:
Success is gauged by research impact (papers published, tools adopted), alignment with strategic foresight goals like AI safety or internet openness, and prestige or thought leadership within technical communities.
Strengths:
Long-term focus enables pursuit of critical, non-commercial capacities
Attracts elite talent motivated by mission and culture
Structural flexibility and experimental approaches foster innovation
Shortcomings:
Risk of mission drift, especially under commercialization pressures
Accountability can be opaque due to abstract or long-term metrics
Vulnerable to governance capture or donor influence in ambiguous structures
Evolutionary Niche:
These organizations persist in elite, forward-looking ecosystems where long-term risks are acknowledged, and donors are willing to invest in capability-building rather than immediate service delivery.
4. Mission-Driven Hybrids: B Corps, Benefit Corporations, Social Enterprises, and Digital Collectives (DAOs, Open Collectives)[10]
Inputs:
These hybrids blend market mechanisms with social or ecological missions. They generate revenue by selling products or services while embedding purpose into their core operations. Legal certifications like B Corporation or Benefit Corporation status formalize their commitment to balancing profit with people and planet. Emerging digital governance models such as DAOs (Decentralized Autonomous Organizations) and Open Collectives add transparency, democratic funding, and open participation to the mix.
Feedback Loops:
Market feedback (customer satisfaction, revenue) is combined with internal mission metrics, impact reporting, and values-driven leadership. Legal frameworks protect directors who prioritize mission over profit, while public governance tools and blockchain transparency (in DAOs) foster stakeholder accountability. Credibility with ethically conscious consumers and impact investors sustains alignment.
Evolutionary Pressures:
These organizations operate in a delicate space: too little profitability risks business failure, too much profit focus risks mission drift. They thrive in high-trust markets where consumers and investors value ethical impact alongside financial returns. However, they often face skepticism from traditional investors focused on shareholder returns and idealistic funders wary of profit motives. Digital-native models like DAOs are promising but still face untested governance and technical risks.
Strengths:
Combine market efficiency with mission alignment
Access to both impact capital and conscious consumer markets
Legal and digital tools enhance accountability and protect mission
Scalable and adaptable compared to pure non-profits or co-ops
Shortcomings:
Risk of greenwashing or superficial ethics signaling
Profit pressures can erode mission over time, especially after leadership changes
Investor influence can shift focus toward profitability
Digital governance models face novel risks in decision-making and technical fragility
Closing Reflection
Each of these alternative designs attempts to solve the problem of incentive alignment under institutional constraints. They differ primarily in their feedback loops—who gets to steer the ship, what “success” looks like, and how legitimacy is earned or lost.
What’s striking is that none of these systems are “purely” better—they trade off speed for stability, capital for conscience, scale for inclusion. But by diversifying our organizational toolkit, we increase systemic resilience. If corporations are high-powered engines for resource transformation, then cooperatives, nonprofits, and hybrids are more like ecosystems—slower to move, harder to build, but potentially more attuned to human flourishing.
It’s tempting to think of alignment as a problem exclusive to AI—an engineering challenge for a future that hasn’t quite arrived. But look closely and you’ll see the same challenge animating our present: corporations, institutions, even nonprofits, are systems that pursue goals with increasing autonomy and efficiency. Like AIs, they are shaped by their architecture, their inputs, and the incentives we embed in them—intentionally or not.
We tend to assume that if the people inside a system mean well, the system itself will do good. But history suggests otherwise. Misaligned systems can emerge from noble intentions, just as aligned systems require more than good intentions—they require feedback loops, governance structures, and design constraints that nudge behavior in the direction of collective well-being.
That’s why it matters to study not just what systems do, but what they optimize for—what drives them when no one’s watching, and what they become when scaled. Whether we’re speaking of AIs, corporations, or any large-scale institution, the task is the same: to build systems that don’t just grow, but grow in ways we can live with.
We won’t get there by hoping for better outcomes from misaligned designs.
We’ll get there by learning to design systems that want what we want.
We’ll get there by actively participating in the implementation of such systems.
And we’ll get there by making sure that they stay aligned with human needs—not just today, but in the future they create.
- ^
- ^
even mentioned by me as one potential way out of the paperclip profit trap
- ^
as seen by law makers at the time.
- ^
often gained without paying their creators under “Fair Use” policy
- ^
Private equity adheres to some controversial practices that alarm policymakers. While oversight of the private equity market has increased since the financial crisis of 2008, the market still faces less stringent regulation than more traditional investments. In 2012, the New York attorney general’s office was investigating a private equity tactic known as fee-waiver conversion. This practice intentionally directs a greater amount of an investor’s capital away from higher-taxed fees and into a category that is taxed more favorably.
On July 22, 2015, the IRS issued proposed regulations intended to address when certain management fee waiver arrangements would be treated as disguised payments under IRC Sec. 707(a)(2)(A). Nearly a decade later, these regulations have yet to be finalized... - ^
Mondragon Corporation (Spain) – Industrial and Retail
One of the world’s largest worker cooperatives, Mondragon operates in manufacturing, finance, retail, and education. It’s famous for its democratic worker ownership model, balancing economic success with social responsibility.The Co-operative Group (United Kingdom) – Retail and Consumer Goods
This cooperative runs supermarkets, financial services, and funeral care. Owned by millions of members, it emphasizes ethical sourcing, community engagement, and sustainability.Fonterra (New Zealand) – Dairy Industry
A global dairy cooperative owned by around 10,000 farmers, Fonterra is one of the largest exporters of dairy products worldwide, focusing on high-quality production and farmer welfare.Rabobank (Netherlands) – Banking and Financial Services
Originally a cooperative bank serving rural communities, Rabobank has grown into a global financial institution with a strong focus on sustainable agriculture and community development.Desjardins Group (Canada) – Financial Services
The largest cooperative financial group in Canada, Desjardins offers banking, insurance, and investment products while reinvesting profits for members’ benefit and community support.Ocean Spray (United States) – Agricultural Cooperative
Owned by cranberry and grapefruit growers, Ocean Spray is a leading producer of fruit juices and related products, emphasizing cooperative marketing and product innovation. - ^
Doctors Without Borders (Médecins Sans Frontières—MSF)
Field: Emergency medical aid and humanitarian relief worldwide
Funding: Primarily funded by private donors (over 90%) and some government grants, maintaining independence from political influence.
Organization: MSF operates through decentralized country offices with field teams of medical and logistical experts. It uses a mix of volunteer and paid staff and emphasizes rapid deployment and neutrality.The World Wildlife Fund (WWF)
Field: Conservation, endangered species protection, and environmental sustainability
Funding: Funded by a combination of individual donations, corporate partnerships, government grants, and philanthropic foundations.
Organization: Structured as a global network of national organizations coordinated by a central secretariat, WWF integrates scientific research with advocacy and local community projects.Oxfam International
Field: Poverty alleviation, development, and humanitarian aid
Funding: Mix of public donations, government funding, institutional grants, and partnerships with other NGOs.
Organization: A confederation of independent national organizations coordinated internationally, promoting community-led development with an emphasis on transparency and accountability.Amnesty International
Field: Human rights advocacy and campaigns
Funding: Mostly through individual memberships and donations, ensuring independence from governments or corporations.
Organization: Operates as a global movement with national sections and offices, staffed by volunteers and professionals, using research and public campaigns to influence policy and raise awareness.CARE International
Field: Global poverty reduction, disaster relief, and women’s empowerment
Funding: Mix of government grants, private donations, and corporate partnerships.
Organization: Network of autonomous national organizations coordinated globally, combining long-term development programs with emergency response capabilities. - ^
Meals on Wheels
Mission: Deliver nutritious meals to elderly and homebound individuals.
Focus: Direct food delivery and basic care services, improving nutrition and reducing isolation.Habitat for Humanity
Mission: Provide affordable housing by building and renovating homes.
Focus: Hands-on construction and housing assistance, directly improving living conditions.The Salvation Army
Mission: Emergency shelter, disaster relief, and basic social services.
Focus: Providing shelter, food, and rehabilitation services primarily to vulnerable populations.Crisis Text Line
Mission: Offer immediate emotional support via text messaging to people in crisis.
Focus: Real-time crisis intervention and mental health support.Blood Banks (e.g., American Red Cross Blood Services)
Mission: Collect, test, and distribute blood to hospitals.
Focus: Direct provision of life-saving blood products - ^
OpenAI (early years as a non-profit)
Mission: Develop advanced artificial intelligence technologies safely and broadly beneficial to humanity.
Focus: Research and development of AI capabilities, fostering long-term technological safety rather than immediate commercial gain.Mozilla Foundation
Mission: Promote an open and accessible internet through open-source software like the Firefox browser.
Focus: Developing and maintaining internet infrastructure and tools that support privacy, openness, and user empowerment.The Wikimedia Foundation
Mission: Provide free access to knowledge worldwide through Wikipedia and related projects.
Focus: Building and maintaining a global open knowledge platform, empowering millions of contributors and users.SENS Research Foundation
Mission: Advance research to repair the damage of aging and extend healthy human lifespan.
Focus: Funding and conducting cutting-edge biomedical research to develop transformative health technologies.The Long Now Foundation
Mission: Foster long-term thinking and responsibility through projects like the 10,000 Year Clock.
Focus: Developing cultural and intellectual infrastructure encouraging sustainability and long-term planning. - ^
Patagonia (B Corp): Known for environmental activism integrated with business practices.
Ben & Jerry’s (Benefit Corporation): Explicitly balances social missions with commercial success.
Open Collective: A platform enabling transparent, community-driven funding of open projects.
Friends With Benefits (DAO): A blockchain-based social club with democratic governance and membership control.
Good post.
Related post: Alignment versus AI Alignment
somehow the editor died on me at some point so i could not continue writing..
so if there are some hickups in formatting, thats why.
You can add another user as co-editor and see if they run into the same problem. For example, you can ask the moderators via the intercom to try to edit the post.