group who believe that it might be at best inefficient and at worst highly dangerous to proceed in this fashion.’
‘Can you elaborate, sir?’
‘I have been invited to fund an enterprise known as the Benign Superintelligence Bootstrap Project,’ Churchland explained. ‘Their aim is to build an artificial intelligence capable of such exquisite powers of self-analysis that it will design and construct its own successor, which will be armed with superior versions of all the skills the original possessed. The successor will then produce a still more proficient third version, and so on, leading to a cascade of exponentially increasing abilities. Once this process is set in motion, within weeks - perhaps within hours - a being of truly God-like powers will emerge.’
Nasim resisted the urge to bury her face in her hands. However surreal the spectacle unfolding on the screen, there was, in retrospect, something inevitable about it. The uploading advocates who’d sold Churchland on an imminent digital resurrection hadn’t lost their critical faculties entirely, but their penchant for finessing away any ‘mere technical problems’ that might stretch out the timetable was, nonetheless, intellectually corrosive, to the point where the next step probably didn’t seem like such a great leap any more: hand-waving all practicalities out of existence, transforming the cyber-eschatologists’ rickety scaffolding of untested assumptions into a cast-iron stairway to heaven.
Fitzwaller cleared his throat. ‘Mr Churchland, it’s not entirely clear to me how that matter is pertinent to the business of this committee.’
Churchland said, ‘Rather than trust humans to perfect the brain-mapping technology that we’ve been discussing, I am leaning towards putting my fate in the hands of an artificial God, for whom such problems will be trivial. The Benign Superintelligence will rule the planet with wisdom and compassion, eliminating war, disease, unhappiness, and of course, death. I am told that it will probably disassemble most of the material in our solar system in order to construct a vast computer that will exploit all the energy of the sun. Perhaps it will spare the Earth, or perhaps the Earth will be reconstructed, more perfectly, within that computerised domain.’
The camera caught Fitzwaller in the transition from bewilderment to revulsion. ‘ “Rule the planet”? Am I to understand that you’re contemplating funding a body that advocates overthrowing the lawful government of the United States?’
Churchland required more oxygen before replying, ‘Keep your shirt on, Congressman. There’s no point fighting it, and the alternative would be far worse. Imagine if one of our country’s enemies did this first. Imagine the kind of despotic superintelligence that Al Qaeda would create.’
‘Mr Churchland,’ Fitzwaller said evenly, ‘does it not occur to you that most people on the planet would prefer not to have their affairs dictated by an artificial intelligence of any kind?’
‘That’s too bad, Congressman,’ Churchland retorted, ‘because I am coming to the view that we probably have no choice.’
Judith stormed into the conference room and slammed her briefcase down on the table. For a moment Nasim assumed that she’d been watching the same feed, but then it became clear from her body language that she was oblivious to the sight of half the HCP’s potential funding sprouting wings and flying away. She was livid, but it had nothing to do with Churchland’s deathbed embrace of Bullshit Squared.
‘Whoever’s idea it was,’ she fumed, ‘it really wasn’t funny.’
Nasim said, ‘Whoever’s idea was what?’
‘Can you think of a reason why five sleaze-bags would have hit on me this morning in Reagan Airport alone?’
‘New perfume?’ Mike suggested. Judith picked up the whiteboard eraser and hurled it at him; he squirmed sideways but it
‘Can you elaborate, sir?’
‘I have been invited to fund an enterprise known as the Benign Superintelligence Bootstrap Project,’ Churchland explained. ‘Their aim is to build an artificial intelligence capable of such exquisite powers of self-analysis that it will design and construct its own successor, which will be armed with superior versions of all the skills the original possessed. The successor will then produce a still more proficient third version, and so on, leading to a cascade of exponentially increasing abilities. Once this process is set in motion, within weeks - perhaps within hours - a being of truly God-like powers will emerge.’
Nasim resisted the urge to bury her face in her hands. However surreal the spectacle unfolding on the screen, there was, in retrospect, something inevitable about it. The uploading advocates who’d sold Churchland on an imminent digital resurrection hadn’t lost their critical faculties entirely, but their penchant for finessing away any ‘mere technical problems’ that might stretch out the timetable was, nonetheless, intellectually corrosive, to the point where the next step probably didn’t seem like such a great leap any more: hand-waving all practicalities out of existence, transforming the cyber-eschatologists’ rickety scaffolding of untested assumptions into a cast-iron stairway to heaven.
Fitzwaller cleared his throat. ‘Mr Churchland, it’s not entirely clear to me how that matter is pertinent to the business of this committee.’
Churchland said, ‘Rather than trust humans to perfect the brain-mapping technology that we’ve been discussing, I am leaning towards putting my fate in the hands of an artificial God, for whom such problems will be trivial. The Benign Superintelligence will rule the planet with wisdom and compassion, eliminating war, disease, unhappiness, and of course, death. I am told that it will probably disassemble most of the material in our solar system in order to construct a vast computer that will exploit all the energy of the sun. Perhaps it will spare the Earth, or perhaps the Earth will be reconstructed, more perfectly, within that computerised domain.’
The camera caught Fitzwaller in the transition from bewilderment to revulsion. ‘ “Rule the planet”? Am I to understand that you’re contemplating funding a body that advocates overthrowing the lawful government of the United States?’
Churchland required more oxygen before replying, ‘Keep your shirt on, Congressman. There’s no point fighting it, and the alternative would be far worse. Imagine if one of our country’s enemies did this first. Imagine the kind of despotic superintelligence that Al Qaeda would create.’
‘Mr Churchland,’ Fitzwaller said evenly, ‘does it not occur to you that most people on the planet would prefer not to have their affairs dictated by an artificial intelligence of any kind?’
‘That’s too bad, Congressman,’ Churchland retorted, ‘because I am coming to the view that we probably have no choice.’
Judith stormed into the conference room and slammed her briefcase down on the table. For a moment Nasim assumed that she’d been watching the same feed, but then it became clear from her body language that she was oblivious to the sight of half the HCP’s potential funding sprouting wings and flying away. She was livid, but it had nothing to do with Churchland’s deathbed embrace of Bullshit Squared.
‘Whoever’s idea it was,’ she fumed, ‘it really wasn’t funny.’
Nasim said, ‘Whoever’s idea was what?’
‘Can you think of a reason why five sleaze-bags would have hit on me this morning in Reagan Airport alone?’
‘New perfume?’ Mike suggested. Judith picked up the whiteboard eraser and hurled it at him; he squirmed sideways but it
Similar Books
