“Memory” is the feature everyone asked for and few thought through. The pitch is lovely: the assistant remembers your preferences, your projects, your writing style, the fact that you are vegetarian and allergic to long emails, so you never have to repeat yourself. In practice, it is one of the most consequential privacy decisions in consumer AI, dressed up as a convenience toggle, and most people flipped it on without reading past the word “remember.”
Convenience and surveillance are the same feature
The uncomfortable truth is that there is no version of persistent memory that is not also a growing personal record. For the assistant to remember your details, it has to store your details. The thing that makes it feel like it knows you is a file — structured or otherwise — accumulating what you have told it, and inferring more from what you did not. The warmth and the dossier are not two features. They are one feature seen from two angles.
A system that remembers everything you tell it is, definitionally, a system that keeps a record of everything you tell it. The friendliness is the interface; the record is the substance.
The profile that shapes what you are shown
