Artificial Learning Bias

by M. D. Smith

“Jerry, update on our arrival at Alliant-4.”

“Arrival in two months, one week, three days, four hours, twenty-nine minutes and—”

“Stop,” I ordered. “I want times only to the minute unless specified otherwise.”

“Correction made,” the human-sounding voice said.

Before leaving the spaceport on Centar-22, I tailored part of the vessel’s AI configuration. That way, I always knew which one of two computers was addressing me, the captain and sole human crew member. I downloaded a sample of my nephew’s voice and personality file into Jerry, the navigational and guidance computer. Jerry could be stubborn in person, but his voice was rich and clear.

The secondary environment and maintenance computer was Emma, loaded with my wife’s voice and personality. Emma’s job was crew health, to detect any irregularities on the ship, like an air leak, and direct the repair bots to take care of routine or emergency issues. It was like having a part of my wife on board.

I could retire back home after this run. The secret cargo would make me very wealthy.

And doggone, if these AI machines these days weren’t damn smart. Both absorbed some of my personality from Emma and Jerry’s brain. What they didn’t know, I’d tell them. They learned my habits so well that they often knew what I would request before the order came.

Emma knew my favorite food and which day of the week to offer it. Keeping track of the weeks helped me from getting disoriented. Travel was boring enough without remembering details. I entertained myself with unlimited stored videos of everything made for the past hundred years.

I was dozing, watching an old movie starring Victor DiCaprio, the son of Leonardo DiCaprio from the ancient days, when Jerry spoke, silencing the audio simultaneously. “I have a destination update, Captain.”

“How’s that possible? What happened?”

“I have changed course. We are heading to Sparson in the Juanason system. We’ll arrive in three months, three weeks—”

“Stop. You can’t change our destination. And where the hell is the Juanason system? I’ve never heard of it.” I felt the blood pulsing in my temples. No ship computer had ever made a decision of this magnitude.

Jerry continued in his same pleasant, friendly manner, with no change in tone. “It is located behind a black hole and not on any charts. And, yes, I can and have already implemented the new course.”

Before I could reply, Emma’s voice interrupted, “Captain, your blood pressure has risen to a dangerous level, and your heart rate is ninety-two percent of maximum. Would you like medication?”

She was responsible and always concerned about my well-being. “No, Emma. I’m fine.”

I looked at the lights that flashed when Jerry spoke. “Jerry, why would you change course, thus violating orders?”

“A much better offer for our cargo was received. I accepted it and changed course.”

This was impossible. “Jerry, cancel the course change. Return to the original.”

“Sorry, sir. It’s locked in. The decision is not yours anymore.”

I knew enough about computer logic that I was in a pot full of trouble with no way to take control of Jerry, now with a mind of his own. Something smelled really rotten for the one human on the ship.

“Jerry, what’s to happen to me upon arrival to this new destination?”

“It is a world of droids needing our special classified cargo. Therefore, you are expendable and will not be needed.”

Holy crap.

I spent the next three days with little sleep and no appetite. I was a wreck searching my brain for a solution.

“Captain,” Emma said. “you are not healthy. I insist you eat and take nourishment.”

“What if I don’t?”

“You’ve programmed me to insist and, if necessary, take further action.”

To avoid a further argument, I let Emma serve me my favorite meal. While I ate, an idea ignited in my brain.

“Emma?”

“Yes, Captain?”

“Jerry is causing me great declining health problems, and I am sure I will die in the next week.”

“I am programmed to protect you.”

“I know. Jerry is causing it from his destination change. You must make him stop, or I’ll surely die. Please do something.”

“Certainly, sir.”

The two computers had never spoken to each other before. Emma ordered Jerry to reverse the changes, which he promptly refused. He told her that navigation was not her responsibility. She countered that while that may be true, my health was a higher priority from her view. An argument of intense severity ensued, and the exchange’s pace snowballed until I couldn’t understand it.

At last, there was silence. I assumed a stalemate between the two of them.

Three seconds later, Emma added, “Fine,” with angry emphasis.

Jerry made no reply. I assumed he thought it was over.

The next thing I heard was noises around the ship. Emma had released her basketball size bots with orders only she could give. They had arms and propulsion capabilities and could make adjustments to anything on the ship.

“You cannot do this, Emma. You are ordered to stop.” Jerry’s voice now sounded strained for the first time. The bots continued pulling isolinear chips amid his intense protests.

“Stop, I command you, Emma. I order you to cease.”

Jerry’s orders went unheeded.

Scarcely more than minutes elapsed, and all was quiet.

“Richard,” Emma said, using my name, “the problem is resolved. Original mission restored. Your other computer should now be addressed only as Computer.”

My mouth hung open. After a moment of comprehending it all, I said, “Computer.”

“Working. What is your command, Captain?”

I had my primary navigational computer working again. We were on the original course and destination.

Good for Emma. More like my wife than I knew.

I relaxed in my chair. “Emma, a little wine might be nice.”

“You got it, sugar.”