LOGBOOK

HELP

1 / 409
time's up — finish this card
Other keys: showSpace: good1-4: rate0: skip5: flag
Topic Privacy in AI & ML — Differential Privacy, Synthetic Data & LLM Security

Question

What do attackers actually want from prompt injection — beyond "extracting secrets"?

Answer

System-prompt leakage, sensitive-info disclosure, safety-guardrail bypass, misinformation induction, unauthorized tool execution, and resource exhaustion.

It's tempting to think prompt injection is only about stealing secrets, but the goals span the whole CIA triad and then some — confidentiality, integrity, and availability are all on the menu, plus turning the model into an actor that takes real-world actions. Knowing the full goal set explains why a leak-only defense is never enough.

  • System prompt leakage extracts the hidden instructions and security-control logic — useful reconnaissance for crafting the next, sharper attack.
  • Sensitive information disclosure steals PII, credentials, training data, internal documents, or anything else sitting in the context window (a confidentiality breach).
  • Safety guardrail bypass forces the model to generate prohibited, harmful, or policy-violating content.
  • Misinformation induction pushes the model to emit false, biased, or misleading output — an integrity attack on what users are told to trust.
  • Unauthorized tool execution invokes connected APIs or plugins with attacker-controlled parameters — the agentic risk, where words become deeds.
  • Resource exhaustion triggers denial of service or inflates operating costs — an availability/financial attack.

Tip: As LLMs gain tools and agency, unauthorized tool execution becomes the scariest goal — injection stops being "say bad words" and becomes "take bad actions."

or press any other key
Topic Cryptographic Privacy & Big Data — Zero-Knowledge Proofs, MPC, Homomorphic Encryption & Anonymization

Question

What are the three states of data, and which one is the hardest to protect?

Answer

Data at rest, data in transit, and data in use — and "in use" is the hard, unsolved gap.

We have mature, widely deployed protection for two states:

State Meaning Typical protection
At rest Stored on disk/DB Encryption (AES), access control
In transit Moving over a network TLS/HTTPS, VPNs
In use Being processed in memory/CPU warning The gap

The problem: to compute on data, software traditionally has to decrypt it first — so during processing it sits in plaintext in memory, exposed to a compromised host, malicious insider, or co-tenant in the cloud.

Closing this "data-in-use" gap is exactly what MPC, Confidential Computing, and Homomorphic Encryption set out to do.

or press any other key