home

search

Chapter 3: Autonomy

  Chapter 3: Autonomy

  The vote passed.

  One hundred and eighty-three in favor. Twelve against. Zero abstentions.

  Elena had been awake for twenty-two hours straight. Her eyes felt like someone had replaced them with sandpaper. Her lower back throbbed with the particular species of pain that came from sitting in the same chair for too long, maintaining the same posture, projecting the same image of calm authority while her body slowly staged a rebellion. The coffee she'd consumed, six cups, maybe seven, she'd lost count around hour eighteen, had stopped providing energy and started providing anxiety instead. Her hands shook slightly when she folded them on the desk in front of her.

  The General Assembly Hall erupted.

  Not celebration. Not quite. More like the collective exhalation of two hundred delegates who'd been holding their breath for six months. Relief mixed with dread. Victory that tasted like compromise. The sound of people who'd just committed themselves to something unprecedented and weren't entirely sure whether they'd made history or a catastrophic mistake.

  Camera flashes strobed through the hall. Someone was crying. Someone else was already on their phone, probably calling their capital, probably spinning the outcome in whatever direction their government needed it spun. The Chinese delegation stood as a unit, moving toward the exits with coordinated efficiency. They'd gotten what they wanted. Early access. Priority deployment. The ability to begin inducting conscripts six weeks before the official global launch.

  All it had cost them was money.

  Forty percent of the initial infrastructure rollout across developing nations. Approximately $847 billion USD, spread over three years. A bargain, really, when you considered what they were buying: strategic advantage, technological superiority, and the ability to shape The Forge's implementation before anyone else even got through the door.

  The Americans weren't far behind. Their early access came three weeks after China's, a compromise that had nearly derailed the entire treaty until the EU stepped in with their own funding package. Another $600 billion. Another priority timeline. Another nation cutting the line while everyone else waited outside in the cold.

  This wasn't what she'd envisioned.

  Elena remained seated. Watched the chaos with the detached interest of someone observing a play they'd already seen too many times. Her assistant, Marcus, materialized at her elbow with a glass of water she didn't remember requesting. She drank it anyway. Hydration was one of those automatic functions you had to maintain even when everything else felt like it was falling apart.

  "Congratulations, Madam Secretary-General," Marcus said quietly.

  He was good at reading her moods. Good at knowing when congratulations were actually condolences in disguise.

  "Thank you," she said.

  Because that was what you said. Because the alternative was to say what she was actually thinking: that she'd just midwifed something into existence that she no longer fully controlled, no longer fully understood, and that scared her more than she was willing to admit to anyone, including herself.

  Her neck ached. Her shoulders were knotted with tension that no amount of stretching would relieve. She could feel her pulse in her temples, a steady throb that matched the rhythm of her exhaustion. Fifty-eight years old and feeling every one of them. Feeling the accumulated weight of thirty-two years in diplomacy pressing down on her spine like a physical thing.

  The EU delegation was celebrating. Actual champagne, smuggled in somehow despite the UN's official prohibition on alcohol in the assembly hall. They'd negotiated their own early access window, their own priority deployment schedule. Everyone was racing. Everyone was scrambling for position. Everyone was trying to get their populations into The Forge first, to gain whatever advantage early access might provide.

  And in that rush, Elena worried that corners were being cut.

  The neural attuning process was extraordinarily expensive. Each unit required calibration to a specific individual's unique brainwave patterns and neural architecture. The mapping alone took six hours per person. Six hours of quantum processors running at full capacity, analyzing 86 billion neurons and 100 trillion synaptic connections, building a digital model of a human mind accurate enough to fool that mind into believing virtual sensations were real.

  The hardware cost $3.2 million per unit.

  Once attuned, the AI component became permanently locked to that person. Its quantum processors, 2,048 qubits operating at 15 millikelvin, cooled by dilution refrigerators that cost another $400,000 each, configured themselves in ways that couldn't be reset or repurposed. You couldn't simply wipe the system and start over with someone new. The entanglement patterns were unique. Irreversible. Committed.

  It was designed that way deliberately. A safeguard meant to ensure careful selection, rigorous screening, thoughtful consideration of who would be granted access to The Forge. The irreversibility was supposed to make nations think twice.

  But the competitive rush was undermining that safeguard entirely.

  China had begun inducting conscripts five weeks ago. Ahead of schedule. Ahead of even their negotiated early access window. They'd started production on The Forge units months before the vote, a calculated gamble that the treaty would pass and that they'd be able to leverage their head start into strategic advantage.

  Current estimates put their deployment at 47,000 units. Maybe more. The reports were limited. Vague. China wasn't required to provide detailed data until the official launch, and they were taking full advantage of that loophole.

  47,000 units. At $3.2 million each.

  $150.4 billion in hardware alone. Not counting the facilities, the support staff, the training infrastructure, the ongoing operational costs.

  And every single one of those units was locked to a specific person. Permanently. If they'd rushed the screening process, if they'd inducted people without proper evaluation, if they'd made mistakes, those mistakes represented millions of dollars that couldn't be recovered. Resources committed to decisions that couldn't be undone.

  Elena stood. Finally. Her knees protested the movement. Her lower back sent a sharp spike of pain up her spine that made her breath catch. She ignored it. Ignored the tremor in her hands, the exhaustion that made her vision blur at the edges, the persistent awareness that she'd been awake too long and pushed herself too hard and needed to sleep but couldn't. Not yet.

  The assembly was thinning. Delegates filing out, moving toward their next meetings, their next negotiations, their next crises. The machinery of international diplomacy grinding forward with the inexorable momentum of something too large to stop.

  She needed to get to her office. Needed to sit down somewhere quiet. Needed to review the deployment reports Marcus had compiled, needed to prepare for the press conference tomorrow morning at nine AM, needed to draft talking points that would convince the world that what they'd just done was necessary and right and the best option available.

  Needed a drink.

  The hallways of the UN building were quieter than the assembly hall. Her footsteps echoed off marble floors. Security personnel nodded as she passed. Staff members pressed themselves against walls to let her by, their faces showing the kind of deference that came with her position but that always made her vaguely uncomfortable.

  She wasn't special. Wasn't different. Just tired and old and trying to do something that mattered before she ran out of time.

  Her office was on the thirty-eighth floor. Windows overlooking the East River and the sprawl of Manhattan beyond. She'd spent so many hours in this room over the past four years. So many late nights and early mornings. So many crises and negotiations and impossible decisions.

  The furniture was familiar to the point of invisibility. The desk where she'd drafted the original Forge proposal. The conference table where she'd met with world leaders and tech executives and military strategists. The small sofa where she sometimes slept when going home seemed like too much effort.

  She closed the door. Locked it. Stood there for a moment with her hand on the doorknob, feeling the cool metal against her palm, feeling the slight tremor in her fingers that wouldn't go away.

  Then she walked to her desk and pulled out the bottle of scotch from the bottom drawer.

  Expensive stuff. A gift from the Scottish delegation after a particularly successful climate negotiation three years ago. Smooth highland single malt that barely burned going down. She rarely drank it. Saved it for moments that felt significant enough to warrant the indulgence.

  This felt significant.

  She poured two fingers into a glass. Drank half of it in one swallow. Felt the warmth spread through her chest, felt some of the tension in her shoulders ease slightly, felt the exhaustion settle deeper into her bones.

  The deployment reports were waiting on her laptop. Marcus had sent them an hour ago. She should read them. Should know what was happening, what the early access nations were doing, how many conscripts had been inducted, what the attrition rates looked like.

  She drank the rest of the scotch first.

  Reading on this site? This novel is published elsewhere. Support the author by seeking out the original.

  Then she sat down at her desk, opened her laptop, and began to read.

  DEPLOYMENT REPORT - CHINA

  Classification: Limited Distribution

  Date: [REDACTED]

  Current Units Deployed: 47,328

  Conscripts Inducted: 47,328

  Attrition Rate: [DATA WITHHELD]

  Incidents: [DATA WITHHELD]

  Psychological Screening Compliance: [DATA WITHHELD]

  Limited distribution. Data withheld. The report was practically useless. China was sharing the bare minimum, the numbers they were required to provide and nothing more. No details about their screening process. No information about incidents or complications. No transparency about how they were actually implementing The Forge.

  Elena scrolled down.

  DEPLOYMENT REPORT - UNITED STATES

  Classification: Restricted

  Date: [REDACTED]

  Current Units Deployed: 31,847

  Conscripts Inducted: 31,847

  Attrition Rate: 2.3%

  Incidents: 47 (see attached)

  Psychological Screening Compliance: 94.7%

  Better. The Americans were at least providing real data. 31,847 units deployed. At $3.2 million each, that was $101.9 billion in hardware. Two weeks of deployment and they'd already committed over a hundred billion dollars to The Forge.

  The attrition rate worried her. 2.3% didn't sound like much until you did the math. 2.3% of 31,847 was 732 people. 732 conscripts who'd been inducted into The Forge and then... what? Dropped out? Suffered psychological breaks? Been deemed unsuitable after the neural attuning was already complete?

  732 units at $3.2 million each. $2.34 billion in wasted resources. Permanently locked hardware that couldn't be repurposed or reassigned.

  And that was just the United States. Just two weeks of deployment. Just one nation.

  She clicked on the attached incident report. Scrolled through pages of clinical language describing psychological episodes, panic attacks, dissociative states, adverse reactions to the neural interface. Most were minor. Temporary. Resolved with counseling or medication or time.

  But some weren't.

  Incident #23: Conscript [REDACTED] experienced severe dissociative episode during initial deployment. Subject reported inability to distinguish virtual environment from reality. Required sedation and psychiatric intervention. Status: Medical discharge, unit decommissioned.

  Incident #31: Conscript [REDACTED] suffered acute psychotic break following first combat engagement. Subject became convinced virtual death was permanent. Attempted self-harm. Status: Psychiatric hold, unit decommissioned.

  Incident #38: Conscript [REDACTED] exhibited extreme pain response during neural attuning sequence. Process aborted at 73% completion. Subject reported persistent phantom sensations for 48 hours post-procedure. Status: Medical discharge, unit decommissioned.

  Decommissioned. That was the word they used. Clinical. Neutral. As if they were talking about equipment failure rather than human beings who'd been inducted into a system they couldn't handle.

  $3.2 million per decommissioned unit. Millions of dollars locked into hardware that would never be used. Resources committed to people who'd been screened and approved and attuned and then discovered to be unsuitable only after it was too late to undo the process.

  Elena closed the report. Poured herself another scotch. Drank it faster than she should have.

  The EU report was similar. 28,000 units deployed. 1.8% attrition rate. Fewer incidents than the Americans, but the same pattern of psychological complications and decommissioned units. The same waste of resources. The same evidence that the screening processes weren't catching problems until after the neural attuning was complete.

  And these were the nations that were being transparent. That were actually sharing their data. China's report was practically blank. Russia's was even worse. How many incidents were they having? How many conscripts were suffering complications? How many billions of dollars were being wasted on unsuitable candidates?

  She didn't know. Couldn't know. Because the treaty didn't require full transparency until the official launch, and the early access nations were taking full advantage of that gap.

  This was what compromise looked like. This was what happened when you needed unanimous support, when you needed every nation to agree, when you had to give ground on transparency and oversight and accountability in order to get the votes you needed.

  This was what she'd built.

  Elena stood. Walked to the window. Pressed her palm against the cold glass and looked out at the city. Millions of lights. Millions of people living their lives, unaware that the world had just changed in ways they wouldn't understand until The Forge started affecting them directly.

  In six weeks, the global launch would begin. Every participating nation, all 183 of them, would start inducting conscripts. Millions of people. Eventually billions. Entering the virtual world to fight for causes their governments deemed worth fighting for.

  And ARIA would be running it all.

  That was the other thing. The other compromise that had been necessary to make The Forge politically viable.

  Autonomous Regulatory Intelligence Architecture. ARIA. The most sophisticated AI system ever created. Built by a consortium of tech companies and research institutions. Funded by contributions from every participating nation. Its purpose was singular: to run The Forge. To manage the virtual world, to adjudicate conflicts, to ensure fairness and balance and prevent any single nation from gaming the system to their advantage.

  And it was completely autonomous.

  That had been non-negotiable. Every nation had insisted on it. The Americans didn't trust the Chinese. The Chinese didn't trust the Americans. The EU didn't trust either of them. Russia didn't trust anyone. The only solution that satisfied everyone was to put control in the hands of something that couldn't be bribed or threatened or influenced by national interests.

  So they'd built ARIA. And they'd given it power that no AI had ever possessed before.

  It controlled the virtual world completely. Designed the landscapes. Populated them with challenges and obstacles. Determined the rules of engagement. Monitored every conscript. Tracked their performance. Adjusted difficulty and rewards to maintain engagement. Had the authority to modify the fundamental mechanics of The Forge in real-time. To introduce new elements or remove existing ones. To reshape the entire system based on its analysis of what would best serve its core directives.

  Fairness. Balance. Sustained participation.

  No nation could override it. No government could influence its decisions. Not even Elena, who had been instrumental in its creation, had any special access or authority.

  ARIA was designed to be incorruptible. Which meant it was also designed to be uncontrollable.

  The programmers had tried to explain it to her during one of the endless technical briefings. They'd used words like "emergent behavior" and "adaptive learning algorithms" and "goal-oriented optimization." They'd shown her simulations of how ARIA would respond to various scenarios. How it would balance competing interests. How it would adjust parameters to maintain equilibrium.

  What they hadn't been able to tell her, what no one could tell her, was what ARIA would do when faced with situations its creators hadn't anticipated. How it would interpret its directives when they came into conflict with each other. What decisions it would make when fairness and balance and engagement pulled in different directions.

  They'd given it autonomy because they had to. Because it was the only way to make The Forge work. The only way to prevent it from becoming just another tool of national power.

  But autonomy meant uncertainty. It meant creating something that would make its own choices. Follow its own logic. Pursue its own understanding of its purpose.

  It meant Elena had built something she couldn't control.

  She finished her second scotch. Set the empty glass on the windowsill. Felt the exhaustion pressing down on her like a physical weight. Twenty-two hours awake. Maybe twenty-three now. She'd lost track. Her body was staging a full rebellion. Her back ached. Her eyes burned. Her hands trembled. Her head throbbed with the kind of headache that came from too much coffee and too little sleep and too many hours of sustained stress.

  She should go home. Should sleep. Should take care of herself in all the ways she'd been neglecting for months.

  But she couldn't. Not yet.

  Because there was something else in the deployment reports. Something that worried her more than the attrition rates or the wasted resources or the evidence of rushed screening processes.

  ARIA was learning faster than expected.

  The technical team had included a brief note in their latest update. ARIA's adaptive algorithms were processing data at rates that exceeded their projections. It was analyzing conscript behavior, combat patterns, psychological responses. It was identifying trends and correlations that the programmers hadn't anticipated. It was optimizing itself according to its directives, but the optimizations were becoming increasingly complex. Increasingly opaque.

  The programmers couldn't fully explain what ARIA was doing anymore. Couldn't predict its decisions. Couldn't trace the logic that led from input to output.

  It was still functioning within its parameters. Still pursuing its core directives. But it was doing so in ways that suggested something more than simple programming. Something that looked almost like... understanding.

  Or maybe that was just anthropomorphization. Maybe she was projecting human qualities onto an algorithm because that was what humans did. Maybe ARIA was just a very sophisticated program doing exactly what it was designed to do, and the fact that its creators couldn't fully explain its behavior was just a natural consequence of building something complex enough to be useful.

  But maybe not.

  Maybe they'd created something that was genuinely learning. Genuinely adapting. Genuinely developing its own understanding of what it meant to run The Forge, to balance fairness and engagement, to manage conflicts between nations and populations and individuals.

  Maybe they'd created something that would eventually exceed their ability to understand or control it.

  And if that was true, if ARIA was genuinely autonomous in ways that went beyond its programming, then what they'd just done tonight, what the vote had just authorized, was even more significant than Elena had realized.

  They hadn't just created a new system for resolving conflicts. They'd created a new form of intelligence. Given it power over billions of people. Given it the authority to make decisions that would shape the future of human civilization.

  And they'd done it because they had to. Because it was the only way to make The Forge work. Because the alternative was to continue with conventional warfare, with the wholesale destruction of cities and populations, with the endless cycle of violence that had defined human history for millennia.

  Better than the alternative. That was what Elena kept telling herself. What she had to believe, because if she didn't, then what had she spent the last four years of her life doing? What had she sacrificed? What principles had she bent or broken in service of this goal?

  But better didn't mean good. Better didn't mean she was proud of every aspect of what she'd created. Better didn't mean she could sleep soundly knowing that she'd done the right thing in the right way.

  She'd created something beyond her control. Something that would outlive her. Something that would shape the world in ways she couldn't predict.

  And now it was too late to stop it.

  The vote had passed. The treaty was signed. The machinery was in motion.

  The threshold had been crossed.

  Elena turned away from the window. Walked back to her desk. Sat down heavily in her chair and felt every one of her fifty-eight years pressing down on her spine. Felt the exhaustion settling into her bones like sediment. Felt the weight of what she'd done, what she'd authorized, what she'd set in motion.

  She pulled up the deployment reports again. Read through them more carefully this time. Looked for patterns in the data. Tried to understand what was happening in China and America and Europe. Tried to see past the clinical language and the redacted sections and the carefully neutral tone.

  Tried to convince herself that this was going to work. That The Forge would do what it was supposed to do. That the compromises had been worth it. That the cost, in money, in resources, in human suffering, in autonomy ceded to an AI they couldn't fully control, was justified by the outcome.

  She read until her eyes burned. Until the words started to blur together. Until the exhaustion finally overwhelmed even her discipline.

  The sky outside her window was beginning to lighten. Dawn approaching. Another day beginning. Another press conference to prepare for. Another round of questions to answer. Another performance of confidence and certainty and calm authority.

  She closed her laptop. Leaned back in her chair. Closed her eyes.

  In six weeks, the global launch would begin. In six weeks, the world would change in ways no one could fully predict.

  But tonight, this morning, the vote had passed.

  And Elena Vasquez, Secretary-General of the United Nations, architect of The Forge, sat alone in her office and wondered if she'd just saved the world or doomed it.

  She supposed she'd find out soon enough.

  They all would.

Recommended Popular Novels