Healthcare Data Quality Platform
AWSS3Step FunctionsGlueGreat Expectations
Production-grade medallion architecture: Raw → Quarantine → Curated zones in S3. Step Functions orchestrate Lambdas and Glue jobs. Great Expectations enforces data quality. An AI agent operates on curated data to flag anomalies and provide insight summaries.
Highlights
- Zone promotions with automated quarantine policy.
- Observability and error routing patterns.
- Glue-based transforms; partitioned curated datasets.
- AI agent on curated datasets for anomaly surfacing.
Stack & Flow
S3 Zones → Step Functions → Lambdas/Glue → Great Expectations → Curated insight layer.