With the new influx of light, the full terraformation of Titan seemed very promising. They could capture and export the methane and ethane; spread foamed rock to make islands on the ice; use heat from the ocean below to warm the atmosphere; melt water lakes on their islands of rock and soil; landscape the islands, introduce bacteria, plants, animals; heat the air enough to get melted seas on the glacier surfaces; hold the atmosphere inside an ultrathin bubble; and light everything with the sunlight sent up from the Vulcanoids. The Titans looked out their tent walls with sharp anticipation. My oh my, they said. If we can just keep our shit together here we’re gonna make this a real nice place.
I
t was in one of the famous Titanic sunsets that Swan saw Wahram, crossing the gallery deck to greet her and Inspector Genette. She ran to him and embraced him, then let him go and looked at him, feeling shy. But he gave her that brief smile of his, and she saw that all was well between them. Absence makes the heart grow fonder—especially, she thought, absence from her.
“Welcome to our work in progress,” he said. “You see how the Vulcan light is helping us.”
“It’s beautiful,” she said. “But is it enough light to heat you? Can you get up to biosphere temperatures, wouldn’t that be almost two hundred K higher?”
“The light alone can’t do it. But we have an interior ocean that averages about two hundred eighty K, so heat per se is no problem. We’ll shift some of that heat out to our air. And with this extra light helping, it’ll be fine, even more than fine. There will be gas balance problems, but we can work them out.”
“I’m happy for you.” She looked up at the immense thunderheads over the tent, flaring orange and salmon and bronze. Above the clouds, brilliant chips of light blazed in a royal-blue sky, chips bigger and brighter than any stars: a few of the gathering mirror solettas, she assumed, redirecting the Vulcan light to Titan’s nightside. The huge thunderheads, lit by the sun from one side and mirrors from the other, looked like marble statues of clouds. The sunset was going to last a couple of days, they told her.
“Beautiful,” Swan said.
“Thanks,” he said. “This is my real home, believe it or not. Now let’s grab the inspector and go for a walk. We want to talk to you in confidence.”
“Is everyone else here?” Genette asked him when they approached.
Wahram nodded. “Follow me.”
T
he three of them donned suits and left the spaceport city, called Shangri-La, by way of a gate at the northern end of the city tent. They walked a few kilometers north on a broad track, ramping gradually up a tilted glaciated plain to an overlook. Here a broad flagstoned area made a kind of open plaza, overlooking an ethane lake. The metallic sheen of the lake reflected the clouds and sky like a mirror, so it was a stunning plate of mixed rich color, gold and pink, cherry and bronze, all in discrete Fauvist masses; really nature had no fear when it came to spinning the color wheel. The reflections of the new mirrors in the lake were like chunks of silver, swimming in liquid copper and cobalt. True sunlight and mirrored sunlight crossed to make the landscape shadowless, or faintly double-shadowed—strange to Swan’s eye, unreal-looking, like a stage set in a theater so vast the walls were not visible. Gibbous Saturn flew through the clouds above, its edge-on rings like a white flaw cracking that part of the sky.
A clear rectangular pavilion tent had been set up on one corner of the plaza. Inside it stood a smaller cloth tent, like a yurt or a partially deflated buckyball, resting on the bigger tent’s floor. Wahram led Swan and the inspector through the locks of the tent, then into the inner yurt. There they found a small group of people sitting on cushions on the floor, in a rough circle.
They all stood to greet the newcomers. There were about a dozen or fifteen of them there. Obviously most of them already knew Wahram and Genette, and Swan was introduced to more people than she could remember.
When the introductions were done and they were all seated on the floor, Wahram turned to Swan. “Swan, we would like to have a conversation with you that does not include Pauline. We hope you will again agree to turn her off.”
Swan hesitated, but something in Wahram’s face—some strangled inarticulate entreaty, as one might see on the face of Toad when trying to convince Rat and Mole to join him in something he thought terribly important—caused her to say, “Yes, of course. Turn everything off, Pauline.” And after she heard the click Pauline used to announce her sleep, Swan pushed the button behind her ear for good measure.
“She’s off,” Swan said. She turned off Pauline all the time, but she didn’t like other people asking her to do it.
Inspector Genette jumped up and stood on the table before her; they were almost exactly at eye level. “We’re also wondering if we can make a check to be sure that Pauline is completely inactivated. Sometimes the human host cannot be sure. You’ll notice that I left Passepartout back in the city, for instance.”
“It could be recording you from a distance, no?” she said.
Genette looked doubtful. “I don’t think so, but it’s precisely to forestall any such eavesdropping that we are inside this confidential space. We have black-boxed ourselves. But we’d like to make sure the interior is clear by running some tests on you.”
“All right,” Swan said, as huffy as Pauline would have been. “Check her out, but I’m sure she’s asleep.”
“Sleeping people still hear things. We want her off. And indeed, may I recommend to you the advantages of keeping your qube separated from your own body.”
“Impolite people have often suggested that,” Swan replied.
The tests of Pauline’s level of activity were run by way of wands placed against her neck; then Swan was asked to briefly don a flexible mesh cap.
“All right,” Wahram said when one of his colleagues nodded
confirmation. “We are alone here now, and this conversation is not being recorded. We must all agree to keep what is said here secret. Will you do that?” he said to Swan.
“I will,” Swan said.
“Good. Alex started these meetings, along with Jean here. She felt there were problems developing that should be discussed outside the realm of the system’s artificial intelligences. And one problem was a new kind of qube appearing on the scene. Inspector?”
Inspector Genette said to Swan, “You recall those supposed people on the
Inner Mongolia
? In a way they passed the Turing test, or the Swan test, I guess you could call it, in that you thought they were people putting on an act. People do that sometimes, and in many ways it’s a likelier explanation than the existence of a completely achieved humanoid.”
“I still think they were people,” Swan said. “Do you know any different?”
“Yes. Those were three of the humanoid qubes that we have discovered. There are about four hundred of them. Most of them act very much like people, and keep a low profile. A few act very strangely. The three you met were some of the strange ones. Another one made that break-in attempt at Wang’s station on Io. We recovered the remains of it from the lava, and the quantum dot framework was still detectable.”
Swan shook her head. “Those three I met seemed a little too foolish to be machines, if you see what I mean.”
“Maybe you’re just used to Pauline,” the inspector suggested.
Swan said, “But she’s often foolish. Nothing new there. Although I admit, she surprises me quite a lot. More than most people surprise me.”
“You are always saying otherwise to her,” Wahram noted with a curious glance.
“Yes. I like to tease her.”
Genette nodded. “But you programmed Pauline to have a bold character—a conversationalist, directed to respond to things at a slant. There’s some recursive programming in her that gives more weight to associative and metaphorical thinking than to logical if-thens.”
“Well, but that’s only part of it. Deduction is logical, supposedly, and she has a strong deduction program. But deduction turns out to be almost as metaphorical as free association. In the end it’s wild what she will say.”
Wahram said to the entire group, “The question of programming lies at the heart of today’s meeting. There’s clear evidence to suggest that some qubes are actively self-programming, in particular the ones involved with assembling these humanoids with qubes for brains. We don’t know that any humans asked them to do that, and we don’t know why they’re doing it. So—the first questions concern what they are, and who’s making them. We know that they can’t communicate internally with each other because of the decoherence issues. They’re not some kind of entangled group mind, in other words. But they can communicate just like we do, by talking with each other, using all the ways we ourselves communicate. But in their case, when they employ quantum encryption, it’s not possible to break their codes. Robin here”—who was the person on the other side of Wahram, and who nodded at Swan—“has been coordinating the recording of their conversations over radio and the cloud, and even in some direct vocal communications. While we can’t crack their codes, we can see that they’re talking.”
Swan said, “But go back a bit—how could they self-program? I’ve heard that recursive self-programming does nothing but speed up operations they already know.”
“Well, but if they were instructed to try to make something, for instance, then it might lead to some odd results. Pushing at ways to make something work could have initiated other ideas in
them. It might be much like the way they play a game of chess. They’re given a task, which is to win, and they’re told to figure out ways to do it, and then, in their usual testing of all possible options, they might have had certain unexpected successes at modeling effective courses of action to get what they want. That wouldn’t be exactly a higher-order process, but it still might do the job, and lead to new algorithms. And that could then feed back into trying more things. At some point in trying to self-program for more effectiveness, they might have stumbled into consciousness, or something like it. Or the process might just have resulted in some strange new behaviors, even destructive behaviors. This, anyway, is the theory we’ve been pursuing.”
“Do the original qube programmers think this kind of process could go very far? I mean, wouldn’t the qubes still be stuck in algorithms?”
“As it turns out, the programmers who first built quantum computers used differing structures, and they ended up creating several different internal operating architectures. So really there are different kinds of qubes, each kind with different forms of cognition—different protocols, algorithms, neural networks. They have brain imitations of various sorts—aspects of what you might call self-awareness, and many other features of consciousness. They’re not simply one design, and in terms of their mentation, they may have started speciating.”
Inspector Genette took over: “We’re seeing clear signs of self-programming in the qubes. Where that may have led is hard to say. But we’re worried, because they don’t have the brain architecture and chemistry that makes us think the way we do. We think very emotionally. Our emotions are crucial to decision making, long-term thinking, memory creation—our overall sense of meaning. Without these abilities we wouldn’t be human. We wouldn’t be able to function as individuals in groups. And yet the qubes don’t have emotions, but are instead thinking by way of
different architectures, protocols, physical methods. Thus they have mentalities that are not at all human, even if they are in some sense conscious. And we can’t even be sure that they resemble each other in the ways they’ve emerged into this new state. We don’t know if they think in math or in logic terms, or in a language like English or Chinese. Or if different qubes aren’t different in that way too.”
Swan nodded as she thought it over. If the silly girls had been qubes—the lawn bowler also—that was rather amazing, just in terms of morphology. As to mentation, none of this particularly surprised her. “I talk to Pauline about these issues all the time,” she told them. “But what’s clear to me from those conversations is how crippled the qubes are by these mental absences you speak of. Maybe it is the lack of emotions. There’s so much they can’t do.”
“So it has seemed,” Wahram said after a silence. “But now it looks like they may be generating goals for themselves. Maybe there are some pseudo-emotions there; we don’t know. Probably they still aren’t very wise—more like crickets than dogs. But, you know—we don’t know how our own minds work, in terms of creating the higher levels of consciousness. Since we can’t get inside the qubes to see what’s happening in them, we’re even less sure of them than we are of us. So… it’s a problem.”
“Have you taken some of them apart to see?”
“Yes. But the results are ambiguous. It’s curiously similar to trying to study our own brains—it’s the moment of thought that you want to study, but even if you can find where in the thinking mechanism the thoughts are happening, you can’t be sure what exactly is causing those thoughts, or how they are experienced from the inside. In both cases they involve quantum effects that can’t easily be tracked to a physical source or action.”
“There’s some worry that we set a bad example by doing too much of this kind of thing,” Genette added. “What if they get the idea that it’s all right for them to study us in the same way?”
Swan nodded unhappily, recalling the look in the eyes of the lawn bowler—even in the eyes of the silly girls, now that she was reconsidering them. They had had a look that said they would do almost anything. Or that they didn’t understand what they were saying.
But people had that look all the time.
“So,” Wahram said. “You see our problem. And now it’s getting more urgent, because there’s solid evidence that these qube humanoids were ordered up by other qubes—qubes in boxes or robots, or asteroid frameworks, as was usual.”
“Why would they do that?” Swan asked.
Wahram shrugged.
“Is it bad?” Swan asked, thinking it over. “I mean, they can’t band together into some kind of hive mind creature, because of decoherence. And so ultimately they’re just people with qube minds.”