Why rule-based systems break down in the age of AI, and why character is our only reliable guide forward.
The Allure of the Rulebook
In the discourse surrounding AI ethics and safety, there is a persistent gravitational pull toward rules. We seek to govern these powerful new systems with frameworks, regulations, and prohibitions — a clear list of what an AI ‘should’ and ‘should not’ do. This is an understandable impulse. It feels decisive. It feels safe. But what if the ground is shifting too quickly for any rulebook to remain relevant?
The philosopher Shannon Vallor terms our current condition ‘acute technosocial opacity’. This isn't merely about the ‘black box’ problem of a single neural network; it refers to the unpredictable, systemic, and synergistic effects of multiple emerging technologies altering our societies, institutions, and even our own natures. In a world defined by such profound uncertainty, our traditional ethical frameworks begin to fail.
The Utilitarian Calculation That Cannot Be Solved
Consider utilitarianism, which judges an action right if it produces the greatest good for the greatest number. For this to be a useful guide, one must be able to reasonably predict the consequences of an action. As Vallor argues, technosocial opacity makes this felicific calculus effectively incalculable. When the knock-on effects of a new technology unfold over decades and rewrite the very preferences and desires of the population, attempting to weigh the net utility becomes a speculative fiction. The consequences are not just unknown; they are unknowable.
The Brittleness of Deontology
If consequences are too murky, perhaps we can fall back on duties and rules. Kantian deontology, for instance, proposes universal moral laws derived from reason. Yet these fixed imperatives are ill-equipped for a reality in constant flux. Deontology excels at assessing the private will of a rational agent against an abstract rule. It is less useful when the technology itself changes the nature of agency, creates new forms of collective action, or introduces non-human intelligences. A rule designed for a world of human interaction may be nonsensical or even dangerous when applied to a world cohabited by alien cognitions.
The person who enacts fixed moral rules ‘correctly’ but rigidly—without style, feeling, thought, or flexibility—is, on this view, a shallow parody of virtue. — Shannon Vallor, Technology and the Virtues
Character as the Compass
If the map of consequences is blank and the rulebook is obsolete, what remains? Vallor’s answer is a turn to virtue ethics. Unlike systems that focus on actions or outcomes, virtue ethics focuses on the agent. It is not about memorising rules, but about the cultivation of moral character and, crucially, phronesis — practical wisdom.
Practical wisdom is the capacity for context-sensitive, adaptive moral reasoning. It is the skill of perception, deliberation, and action that allows an agent to navigate novel situations where no precedent exists. In an opaque future, we cannot depend on a fixed ethical algorithm. The only robust and resilient strategy is to develop better ethical agents. For AI safety, this suggests a profound shift in focus: away from simply programming better rules into the machine, and toward building a society of humans with the wisdom and moral character to wield these tools responsibly.
In the end, the challenge of technosocial opacity is not a problem that can be solved by a cleverer line of code. It is a challenge to human character.
Method note. This piece was built in NeuraScene's Advertising Mode using an explicit psychological frame:
- Persuasion trigger: Social Proof
- Target affect: Flow State
- Gestalt principle: Figure-Ground Articulation
This combination targets a sophisticated audience. 'Social Proof' frames the article as participation in an essential, high-level conversation. 'Flow State' is the intended cognitive effect of engaging with the complex argument. 'Figure-Ground Articulation' directly mirrors the article's core thesis: separating the true ethical problem (character) from the noisy background of simplistic solutions (rules).
