Control where tenant information is processed and retained, and prevent cross-tenant access across every derived artifact and operational surface.
Concept overview
Residency governs permitted locations for processing, storage, replication, and access under an organization's applicable obligations. Tenant isolation governs separation between customers or organizational units. They intersect but are not interchangeable: two tenants in one region still need isolation, while one tenant's logs or backups can cross a residency boundary accidentally.
Map the complete data path, including prompts, embeddings, caches, traces, evaluation samples, support exports, and disaster-recovery copies. A regional database setting alone does not constrain model endpoints or telemetry. The enforcement design must account for identity, routing, storage partitions, encryption keys, and operator access.
Why it matters in production
Proof of concept
A proof of concept should use synthetic tenants and document every processor and artifact rather than assuming deployment region covers the whole workflow.
Production
Production requires authenticated tenant context, location-aware routing, scoped retrieval, partitioned caches, controlled telemetry, and tested backup and failover behavior.
Enterprise scale
Enterprise scale adds per-tenant policy variants, regional capacity planning, key ownership, support-access controls, migration procedures, and evidence that derived stores honor the same boundaries.
Architecture components
Tenant policy registry
Defines allowed processing regions, service classes, retention rules, and isolation requirements.
Identity-bound router
Derives tenant scope from authentication and selects only policy-compatible runtime and model endpoints.
Partitioned data services
Enforce tenant scope in relational, object, vector, cache, and workflow stores.
Regional telemetry pipeline
Applies minimization, access control, and permitted storage locations to traces and operational records.
Migration and recovery controller
Validates that replicas, backups, failover targets, and export jobs remain within approved policy.
The architecture, mapped
Policy spans primary and derived data — The same tenant and location policy constrains models, retrieval, telemetry, and recovery targets.
flowchart LR
I["Authenticated tenant"] --> P["Tenant location policy"]
P --> R["Permitted execution router"]
R --> M["Allowed model endpoint"]
R --> D["Tenant-scoped data stores"]
R --> T["Regional telemetry"]
P --> B["Approved backup and failover"]
D --> B
T --> B
Runtime flow
1
Resolve trusted tenant
Bind the request to authenticated tenant identity and load the current policy version before retrieval or model selection.
2
Choose permitted execution
Filter runtime, model, and tool endpoints by processing-location and isolation requirements, failing closed if none qualify.
3
Retrieve within boundaries
Enforce tenant and resource predicates in every store, including caches and derived search indexes.
4
Process and record minimally
Send only necessary data and route logs, traces, and artifacts through compatible regional pipelines.
5
Validate secondary paths
Check backups, asynchronous jobs, evaluation exports, and operator access against the same tenant policy.
6
Handle movement explicitly
Perform migrations or disaster recovery only through approved destinations with verified cleanup and policy transition records.
Regional customer support assistant
Enterprise software · Illustrative enterprise scenario, not a reported customer outcome.
Business situation
Illustrative architecture: A software provider serves customers whose approved processing regions and support-access rules differ.
The problem
The main database is regional, but shared embeddings, global logs, and a fallback model can move customer content outside the intended boundary.
Agent requirement
Apply the tenant's policy to every processing and derived-data path, including failure recovery.
Architecture
A policy router selects regional runtimes and model endpoints; all stores require authenticated tenant keys and telemetry remains in the permitted pipeline.
Runtime
Resolve tenant policy
choose compliant endpoint
retrieve scoped cases
generate minimized answer
store regional trace
reject incompatible fallback
Failure scenario
The preferred model endpoint fails; the router returns a controlled degraded response because the available alternative violates the tenant's location policy.
Operational impact
Measure blocked cross-boundary attempts, data-path coverage, policy-compatible availability, and isolation test results; architecture controls alone do not establish legal compliance.
Architecture tradeoffs
Decision
Benefit
Cost
Dedicated tenant infrastructure
Provides a stronger operational separation boundary.
Raises cost and fleet-management overhead.
Shared infrastructure with strict policy
Improves utilization and standardization.
Requires comprehensive enforcement and careful noisy-neighbor management.
Residency-constrained failover
Preserves approved location boundaries during outages.
May reduce available recovery capacity or increase downtime.
Failure scenarios & recovery
A semantic cache key omits tenant and policy version.
Detect: Isolation tests return a cached answer derived from another tenant's material.
Recover: Disable the affected cache, investigate exposure, and rebuild entries with enforced tenant-aware keys.
A disaster-recovery job targets an unapproved region.
Detect: Recovery preflight rejects the destination against tenant policy.
Recover: Use an approved recovery target or report constrained availability without silently moving data.
Common architecture mistakes
Checking only the primary database region.
Inventory models, embeddings, logs, backups, support tools, and evaluation exports.
Trusting a tenant ID supplied in the prompt.
Derive tenant context from authenticated application claims and verify it downstream.
Assuming encryption replaces isolation.
Enforce access and partition boundaries even when all stored data is encrypted.
When to choose this pattern
Choose it when
A shared agent platform serves customers with different data-handling obligations.
Derived indexes and telemetry contain sensitive tenant information.
Availability planning must respect location and access constraints during failures.
Avoid it when
All processed content is public and there is no meaningful tenant or location policy.
The proposed dependency cannot meet the required processing boundary.
A region label would be used as a substitute for legal and contractual assessment.
Architecture checklist
Inventory every primary, derived, operational, and recovery data path.
Bind tenant context to authenticated identity and propagate it through tools.
Constrain model and tool routing by current tenant policy.
Partition caches and indexes with enforced tenant and permission semantics.
Test cross-tenant reads, writes, exports, and noisy-neighbor behavior.
Verify backup, support-access, migration, and failover destinations.
Document policy-compatible degradation when no permitted endpoint is available.