Encryption Ends at the Screen: An AI Privacy Lab

End-to-end encryption protects a message while it travels between participants. It cannot, by itself, stop an operating-system feature from reading the message after an authorized device displays it.

Goal

Trace where encryption protects data and identify the new trust boundary created when an operating-system AI agent can inspect screens, files, notifications, or accessibility data.

Activity

Give students this scenario:

Two people exchange an end-to-end encrypted Signal message. The recipient’s phone then lets an AI assistant inspect the visible conversation to answer a question.

Students draw a five-stage path:

  1. sender writes the message;
  2. the app encrypts it;
  3. the message crosses the network;
  4. the recipient’s app decrypts and displays it;
  5. an OS-level AI feature attempts to read the screen.

For each stage, label:

  • who can access the message;
  • whether encryption protects it at that moment;
  • which permission or technical control matters;
  • one useful feature and one privacy risk.

Then compare three controls: blocking screen capture, excluding an app from AI access, and denying broad accessibility permissions.

Deliverable

Submit the annotated data-flow diagram and a 100-word explanation of why “end-to-end encrypted” does not mean “invisible to everything on the endpoint.”

Discussion and safety

Use a fictional message—never display a real private conversation. Distinguish encryption failure from endpoint access: the encrypted transport can remain sound even when another authorized component reads plaintext on the device.

Source material

First spotted in the November 21, 2026 PTIR Daily Briefing. Signal’s November 20 announcement explains that OS-level AI agents can capture information after Signal has decrypted and displayed it. Signal now blocks Siri AI screen access by default on supported iPhones and documents the limits of that protection, especially on macOS. The story generated this lab because it gives beginners a concrete way to locate an encryption boundary without treating “encrypted” as a magical guarantee.

Consult Signal’s original privacy announcement.

Written on November 21, 2026