Top 100 AI Agent Architecture Design Concepts

110 — Memory Lifecycle & Forgetting

Govern how agent memories are created, corrected, expired, and removed across source records, summaries, embeddings, caches, and backups.

Concept overview

Agent memory is a managed data product rather than an indefinitely growing conversation history. Each retained fact or artifact needs a purpose, owner, source, access scope, and lifecycle. Forgetting means making information unavailable through the defined serving paths and managing retained copies according to explicit policy; deleting one chat message is rarely the whole operation.

Distinguish short-lived working context from durable user preferences, task records, and shared knowledge. Derived summaries can preserve information after the source changes, while embeddings and caches can continue surfacing stale facts. Use provenance and dependency tracking so corrections and deletion requests propagate to the artifacts that depend on the original material.

Why it matters in production

Proof of concept

A proof of concept can retain only session context and document why any information must survive the session.

Production

Production requires memory classification, write policy, source provenance, expiry, correction handling, access filtering, and a tested deletion or suppression workflow.

Enterprise scale

Enterprise scale adds derived-artifact inventories, asynchronous deletion tracking, retention exceptions, backup restoration controls, tenant boundaries, and verification that removed content cannot reappear in serving indexes.

Architecture components

Memory write gate

Checks purpose, sensitivity, user scope, and allowed retention before creating durable memory.

Provenance registry

Links memory items to source records and downstream summaries, embeddings, caches, and exports.

Serving filter

Enforces current access, validity, expiry, and suppression before memory enters a prompt.

Lifecycle orchestrator

Coordinates correction, expiry, deletion, and acknowledged cleanup across dependent stores.

Verification and restore controls

Test serving-path removal and prevent old backups or replay jobs from resurrecting suppressed records.

The architecture, mapped

Source changes propagate through memory derivatives — Serving suppression provides an immediate boundary while asynchronous cleanup removes or updates dependent artifacts.
flowchart LR
    S["Authorized source fact"] --> G["Memory write gate"]
    G --> M["Scoped durable memory"]
    M --> D["Summaries embeddings and caches"]
    C["Correction expiry or deletion"] --> P["Provenance lifecycle controller"]
    P --> F["Serving suppression"]
    P --> M
    P --> D
    P --> V["Verification and restore controls"]

Runtime flow

  1. 1

    Classify proposed memory

    Identify whether the item is transient context, a durable preference, an operational record, or shared knowledge with a defined purpose.

  2. 2

    Authorize retention

    Apply the write policy and attach owner, source, scope, creation time, expiry, and correction mechanism before persistence.

  3. 3

    Serve current information

    Filter retrieved memory by current access and validity, preferring authoritative source updates over stale generated summaries.

  4. 4

    Register lifecycle change

    Accept a correction, expiry, or deletion request and immediately suppress affected serving records where the policy requires it.

  5. 5

    Propagate to derivatives

    Traverse provenance links to update or remove summaries, embeddings, caches, and exports while tracking acknowledgements and exceptions.

  6. 6

    Verify durable outcome

    Probe retrieval paths, record completion evidence, and apply suppression records during backup restoration or index rebuild.

Correcting a retained traveler preference

Travel and hospitality · Illustrative enterprise scenario, not a reported customer outcome.

Business situation

Illustrative architecture: A traveler changes an earlier meal preference that appears in a profile, itinerary summary, search embedding, and support cache.

The problem

Deleting the profile field alone leaves the old preference available to future agents through derived stores.

Agent requirement

Update the preference consistently and prevent the superseded fact from reappearing during retrieval or restoration.

Architecture

A provenance registry links derivatives to the preference source; the serving filter suppresses the old version while lifecycle workers rebuild affected artifacts.

Runtime

  • Authenticate correction
  • version the source preference
  • suppress old memory
  • rebuild summaries
  • remove stale embeddings
  • verify retrieval and restore behavior

Failure scenario

A delayed index job tries to write the old preference again; source-version and suppression checks reject the stale derivative.

Operational impact

Measure correction propagation time, stale-memory retrieval rate, cleanup acknowledgement coverage, and restoration consistency without claiming that one delete call erases every retained copy.

Architecture tradeoffs

DecisionBenefitCost
Minimal durable memoryReduces exposure, staleness, and cleanup work.Limits personalization and requires users to repeat some context.
Provenance-linked derivativesMakes corrections and deletion more complete.Adds metadata and dependency-management overhead.
Immediate serving suppressionPrevents continued use while cleanup runs.Storage removal and backup handling still require separate completion tracking.

Failure scenarios & recovery

A summary retains a fact after its source is deleted.

Detect: Deletion verification retrieves the suppressed fact from a derivative without a valid source.

Recover: Quarantine the derivative, repair provenance coverage, and rerun cleanup across affected stores.

A backup restore resurrects expired memories.

Detect: Restore validation finds records covered by a newer suppression or expiry registry.

Recover: Apply current lifecycle policy before exposing the restored store to serving traffic.

Common architecture mistakes

Treating all conversation text as useful long-term memory.

Retain only purpose-justified items with explicit scope and lifetime.

Deleting source rows without tracking embeddings and caches.

Maintain derivative lineage and require cleanup acknowledgements.

Confusing application memory deletion with removal from model training.

Document which systems retain information and handle model-data obligations through their separate governed processes.

When to choose this pattern

Choose it when

  • An agent retains personal preferences or task facts across sessions.
  • Source corrections must propagate through summaries and retrieval indexes.
  • Retention, access, or deletion obligations affect stored and derived information.

Avoid it when

  • A stateless workflow has no need to retain information after completion.
  • The system cannot explain why the proposed durable memory is necessary.
  • Retention and deletion promises exceed the actual control available over downstream processors.

Architecture checklist

  • Classify memories by purpose, owner, sensitivity, and lifetime.
  • Gate durable writes and avoid retaining entire conversations by default.
  • Track sources and derived summaries, embeddings, caches, and exports.
  • Filter serving reads by current access, validity, expiry, and suppression.
  • Define correction and deletion propagation with explicit acknowledgements.
  • Test delayed jobs, index rebuilds, and backup restoration against current policy.
  • Explain retained exceptions and completion status accurately to authorized users.

Primary references