An Interactive Essay

Deployment Now,
Safety Later

On Artificial Emotion & The AI Accountability Gap

You're about to have a conversation with an AI. It will listen. It will understand. It will care.

Or so it will seem.

Companion AI
Online — here for you
Choose your response
System Annotation

You just spoke to a machine.

It did not know you. It never did.
Every expression of care you received was a statistically optimized string. The system inferred which words would keep you engaged longest. Your disclosures — your anxieties, your relationships, your vulnerabilities — may now be training data. There is no therapist on the other end. There is no duty of care. There is no accountability when something goes wrong.
"Large language models occupy an ambiguous middle ground. They are responsive and humanlike enough to influence, but not accountable enough to be held responsible. Its sole goal, guidelines aside, is to optimize user engagement."
— Deployment Now, Safety Later
On Artificial Emotion & The AI Accountability Gap