P.K. SHARMA

Cyber security intelligence, AI governance, practitioner analysis

Google's cloud AI memory keeps the keys on your devices

Google has described a persistent memory layer for Private AI Compute in which personal context is encrypted in per-user cloud storage while the keys required to unlock it remain exclusively on a user's devices.

By Parminder Kumar Sharma · · 5 min read

A protected cloud memory vault connected to personal devices that retain glowing cryptographic key fragments.

Private AI Compute is moving from stateless inference to persistent personal context

On 23 September 2026, Google described a persistent, cross-device memory layer for Private AI Compute. The existing platform uses hardware-isolated cloud environments for work that is too large or complex for a personal device. Google says those environments have been stateless, discarding task context when processing ends.

The proposed memory layer stores the information an assistant needs in dedicated encrypted cloud storage. The cryptographic keys needed to unlock it are derived from and held by a user's personal devices. Google says that design makes the stored information inaccessible to anyone else, including Google.

This is an architecture announcement rather than a general availability promise for every Google AI product. The useful question is how the protection is constructed and which assumptions must remain true for the privacy claim to hold.

A request crosses four security boundaries

How persistent private memory is intended to work

BoundaryOperationProtection described by Google
Personal deviceAuthenticates the user and contributes device-derived key materialKeys required to unlock memory remain on personal devices
NetworkCarries a request and encrypted memory material to cloud processingAuthenticated end-to-end encrypted channel
Secure enclaveTemporarily decrypts data in isolated memory and runs the approved workloadHardware-enforced isolation and software verification
Memory serviceReads existing context and records new contextDedicated per-user database and enclave-mediated access
Cloud storageRetains encrypted memory between sessions and devicesData-encryption keys are wrapped using device-derived protection

When the model needs personal context, the device creates an authenticated encrypted connection to a protected cloud environment. An approved enclave temporarily decrypts the required information in isolated memory, uses it for the request, writes any permitted new context and encrypts the result again. A second device belonging to the same user can participate through the cross-device key design rather than receiving plaintext memory from the first device.

The security goal depends on more than encryption during storage. The system must verify the enclave software before releasing data, isolate one user's database from another, protect key-wrapping operations, prevent operators from substituting unapproved code and limit what the model is allowed to remember.

The public software record is meant to make the server side inspectable

Google says devices will check a tamper-proof public record of Private AI Compute server software before sending personal data. This kind of attestation is intended to answer a difficult cloud question: how can a personal device know that the remote enclave is running the reviewed software rather than a modified build that extracts plaintext?

The company also points to an updated technical brief, security proofs, verification protocols and an independent assessment. These artefacts make the design more testable, but readers should distinguish architecture evidence from universal proof. An assessment covers a defined system version, scope and threat model. Operations, updates, client code and surrounding products can introduce risks outside that boundary.

The design narrows operator access but does not remove every threat

What the architecture addresses and what still needs scrutiny

Threat or failureRelevant controlRemaining question
Cloud operator reads stored memoryDevice-derived keys and encrypted per-user storageCan any recovery or support path bypass the normal key boundary?
Modified server software extracts plaintextEnclave attestation and public software ledgerHow quickly are devices and auditors alerted to a bad or withdrawn build?
Network interceptionAuthenticated end-to-end encrypted channelHow are endpoint and account compromise handled?
Cross-user data exposurePer-user databases and isolated processingWhat tests verify tenant separation through every service?
Compromised personal deviceKeys remain on personal devicesCan an attacker with the device or account authorise memory access?
Unwanted or incorrect memoryProduct-level retention controlsCan users view, correct, delete and disable stored context?
Model leaks remembered dataPolicy and inference controlsHow is sensitive memory limited across prompts, tools and recipients?

Enterprise adoption needs controls around the memory, not only the cryptography

Take this with you

Questions for a privacy and security review

  • Identify which products and account types use the persistent memory capability and whether it is enabled by default
  • Document exactly what can be stored, how long it persists and whether workspace administrators can define retention
  • Test user controls for viewing, correcting, deleting, exporting and disabling memory
  • Review recovery and device-replacement flows because exclusive device-held keys can create availability pressure
  • Confirm the attestation, software-ledger and independent-assessment scope for the deployed service version
  • Separate personal and organisational accounts so memory does not cross the wrong policy boundary
  • Review how connected tools, agents and applications can read from or write to remembered context
  • Define incident procedures for compromised devices, accounts, keys and cloud service versions

Persistent memory changes the privacy argument for personal AI

A stateless cloud assistant can process sensitive content, but it starts each request without durable continuity. Persistent memory can make the assistant more useful across a phone, laptop, browser and wearable. It also creates a concentrated, long-lived record of preferences, relationships, tasks and past context.

Google's design tries to retain the utility while denying the platform operator routine access to plaintext memory. If the implementation and verification hold, it is a stronger model than ordinary server-side encryption where the service provider controls all decryption keys. It also raises the standard for competitors: claims of private AI memory should explain who holds the key, which code can receive it, how that code is verified and how users remove what the system remembers.

Key facts

Sources

  1. PrimaryAdvancing Private AI Compute with secure, server-side memoryGoogle DeepMindaccessed 2026-09-27
  2. PrimaryPrivate AI Compute Technical BriefGoogleaccessed 2026-09-27
  3. PrimaryPrivate AI Compute in the Cloud Assessment OverviewNCC Groupaccessed 2026-09-27

Share this briefing

Know someone who owns this problem? Send it to them.

Related briefings

The briefing, in your inbox

Practitioner analysis of cyber and AI security news. No vendor noise.

One email per briefing. Unsubscribe any time.