The Terminal Experiment

CHAPTER 38

Cathy was lying on her back in bed, staring at the ceiling, when Peter entered. He could see by the Hobson Monitor that she was wide awake, so he didn’t make any effort to be quiet. “Peter?” said Cathy. “Hmm?”

“What went on this evening?”

“I had to see Sarkar.”

Cathy’s voice was tightly controlled. “Do you know who killed my father? Who killed Hans?”

Peter started to say something, then fell silent.

“Trust,” she said, rolling slightly toward him, “has to be a two-way street.” She waited a moment. “Do you know who killed them?”

“No,” said Peter again, removing his socks. And then, a moment later, “not for sure.”

“But you have your suspicions?”

Peter didn’t trust his voice. He nodded in the darkness.

“Who?”

“It’s only a guess,” he said. “Besides, we’re not even sure that your father was murdered.”

Firmly: “Who?”

He let out a long sigh. “This is going to take some explaining.” He had his shirt off now. “Sarkar and I have been doing some … research into artificial intelligence.”

Her face, blue-gray in the dim room, was impassive.

“Sarkar created three duplicates of my mind inside a computer.”

Cathy’s voice was tinged with mild surprise. “You mean expert systems?”

“More than that. Much more. He’s copied every neuron, every neural net. They are, for all intents and purposes, complete duplicates of my personality.”

“I didn’t know that sort of thing was possible.”

“It’s still experimental, but, yes, it’s possible. Sarkar invented the technique.”

“God. And you think one of these — these duplicates was responsible for the murders?”

Peter’s voice was faint. “Maybe.”

Cathy’s eyes were wide with horror. “But — but why would duplicates of your mind do something you yourself would not?”

Peter had finished changing into his pajamas. “Because two of the simulations are not duplicates. Parts of what I am have been removed from them. It’s possible that we accidentally deleted whatever was responsible for human morality.” He sat on the edge of the bed. “I tell you, I would never kill anyone. Not even Hans. But part of me very much wanted him dead.”

Cathy’s voice was bitter. “And my father? Did part of you want him dead, too?”

Peter shrugged.

“Well?”

“I, ah, have never really liked your father. But no, until recently, I had no reason to hate him. But … but then you told me about your counseling session. He hurt you when you were young. He shook your confidence.”

“And one of the duplicates killed him for that?”

A shrug in the darkness. “Turn the fucking things off,” said Cathy.

“We can’t,” said Peter. “We tried. They’ve escaped out into the net.”

“God,” said Cathy, putting all her terror and fury into that single syllable.

They were silent for a time. She had moved away from him slightly in the bed. Peter looked at her, trying to decipher the mixture of emotions on her face. At last, her voice trembling slightly, she said, “Is there anyone else you want dead?”

“Sarkar asked me the same thing,” he said, annoyed. “But I can’t think of anyone.”

“What about — what about me?” said Cathy.

“You? Of course not.”

“But I hurt you.”

“Yes. But I don’t want you dead.”

Peter’s words didn’t seem to calm her. “Christ, Peter, how could you do something so stupid?”

“I — I don’t know. We didn’t mean to.”

“What about the detective?”

“What about her?”

“What will happen when she gets too close to the truth?” asked Cathy. “Will you want her dead, too?”

Sarkar arrived at Peter and Cathy’s house at 10:15 the next morning. They sat there, the three of them, chewing on bagels that were past their prime.

“So what do we do now?” said Cathy, arms folded across her chest.

“Go to the police,” said Sarkar.

Peter was shocked. “What?”

“The police,” said Sarkar again. “This is completely out of control. We need their help.”

“But—”

“Call the police. Tell them the truth. This is a new phenomenon. We didn’t expect this result. Tell them that.”

“If you do that,” said Cathy slowly, “there will be repercussions.”

“Indeed,” said Peter. “Charges would be laid.”

“What charges?” said Sarkar. “We’ve done nothing wrong.”

“Are you kidding?” said Peter. “They could charge me with manslaughter, maybe. Or as an accessory to murder. And they could charge you with criminal negligence.”

Sarkar’s eyes went wide. “Crim—”

“Not to mention getting you under hacker laws,” said Cathy. “If I understand all this correctly, you’ve created a piece of software that’s out there violating other people’s computer systems and stealing resources. That’s a felony.”

“But we intended nothing wrong,” said Sarkar.

“The crown attorney could run circles around us,” said Peter. “A man and his best friend create software that kills people the man hated. Easy enough to discredit any claim I didn’t have that in mind all along. And remember that case against Consolidated Edison? Frankenstein statutes. Those who seek to profit from technology must bear the costs of unforeseen consequences.”

“Those are American laws,” said Sarkar. “I suspect a Canadian court would adopt a similar principle,” said Cathy.

“Regardless,” said Sarkar, “the sims have to be stopped.”

“Yes,” said Cathy.

Sarkar looked at Peter. “Pick up the phone. Dial nine-one-one.”

“But what could the police do?” asked Peter, spreading his arms. “I’d be in favor of telling them, perhaps, if there was something they could do.”

“They could order a shutdown of the net,” said Sarkar.

“Are you kidding? Only CSIS or the RCMP could do that — and I bet they’d need to invoke the War Measures Act to suspend access to information on that large a scale. Meanwhile, what if the sims have moved down into the States? Or across the Atlantic?” Peter shook his head. “There’s no way we’d ever get the net scoured clean.”

Sarkar nodded slowly. “Perhaps you’re right.” They were silent for a time. Finally, Cathy said, “Isn’t there some way you can clean them off the net yourself?”

They looked at her expectantly.

“You know,” she said, “write a virus that would track them down and destroy them. I remember the Internet worm, from back when I was in university — it was all over the world in a matter of days.”

Sarkar looked excited. “Maybe,” he said.

“Maybe.”

Peter looked at him. He tried to keep his voice calm. “The sims are huge, after all. They can’t be that hard to find.”

Sarkar was nodding. “A virus that checked all files bigger than, say, ten gigabytes … It could look for two or three basic patterns from your neural nets. If it found them, it would erase the file. Yes — yes, I think I could write something like that.” He turned to Cathy. “Brilliant, Catherine!”

“How long would it take to write?” asked Peter.

“I am not sure,” replied Sarkar. “I’ve never written a virus before. Couple of days.”

Peter nodded. “Let’s pray that this works.”

Sarkar looked at him. “I face Mecca five times a day and pray. Perhaps we would have better luck if both of you really did pray, too.” He rose to his feet. “I better get going. I’ve got a lot of work to do.”