What happens when an intelligent system drifts beyond human control?
What happens when an intelligent system drifts beyond human control?.
Member article
This article is available to Synth members. Membership is $50 per year and unlocks member articles through your Samirac account.
Continue reading
Feelings matter. Perception matters. Belief matters. But none of them becomes truth simply because it is sincerely or intensely held. Whether in relationships, ideology, or AI governance, the same category error appears when internal experience is allowed to substitute for external reality. Truth may be difficult to determine. That does not make it subjective. Reality obeys structure, not narrative.
AI did not create the borrowed-authority problem. We spent decades building a culture that increasingly rewarded credentials, institutional prestige, titles, language, and visibility as substitutes for demonstrated understanding. Social media monetized that behavior, and generative AI made the performance of expertise almost free. As AI systems gain real authority, the difference between sounding knowledgeable and actually understanding the architecture becomes much harder—and much more important—to ignore.
And by creep, I mean drift or institutional drift.