"I think that reflects an inadequacy in the language as spoken." That time, the gel almost sounded like Rowan.

"Really."

"Hey," said the gel. "I could explain it to you if you wanted. Could piss you off though."

Scanlon looked at Rowan. Rowan shrugged. "It does that. Picks up bits and pieces of other people's speech patterns, mixes them up when it talks. We're not really sure why."

"You never asked?"

"Someone might have," Rowan admitted.

Scanlon turned back to the table. "Gel, I like your suggestion. Please explain to me how you can prefer without preference."

"Easy. Preference describes a tendency to... invoke behaviors which generate an emotional payoff. Since I lack the receptors and chemical precursors essential to emotional experience, I can't prefer. But there are numerous examples... of processes which reinforce behavior, but which ... do not involve conscious experience."

"Are you claiming to not be conscious?"

"I'm conscious."

"How do you know?"

"I fit the definition." The gel had adopted a nasal, sing-song tone that Scanlon found vaguely irritating. "Self-awareness results from quantum interference patterns inside neuronal protein microtubules. I have all the parts. I'm conscious."

"So you're not going to resort to the old argument that you know you're conscious because you feel conscious."

"I wouldn't buy it from you."

"Good one. So you don't really like reinforcement?"

"No."

"Then why change your behavior to get more of it?"

"There ... is a process of elimination," the gel admitted. "Behaviors which aren't reinforced become extinct. Those which are, are ... more likely to occur in the future."

"Why is that?"

"Well, my inquisitive young tadpole, reinforcement lessens the electrical resistance along the relevant pathways. It just takes less of a stimulus to evoke the same behavior in future."

"Okay, then. As a semantic convenience, for the rest of our talk I'd like you to describe reinforced behaviors by saying that they make you feel good, and to describe behaviors which extinguish as making you feel bad. Okay?"

"Okay."

"How do you feel about your present functions?"

"Good."

"How do you feel about your past role in debugging the net?"

"Good."

"How do you feel about following orders?"

"Depends on order. Good if promotes a reinforced behavior. Else bad."

"But if a bad order were to be repeatedly reinforced, you would gradually feel good about it?"

"I would gradually feel good about it," said the gel.

"If you were instructed to play a game of chess, and doing so wouldn't compromise the performance of your other tasks, how would you feel?"

"Never played a game of chess. Let me check." The room fell silent for a few moments while some distant blob of tissue consulted whatever it used as a reference manual. "Good," it said at last.

"What if you were instructed to play a game of checkers, same caveat?"

"Good."

"Okay, then. Given the choice between chess and checkers, which game would you feel better playing?"

"Ah, better. Weird word, y'know?"

"Better means more good."