Write-Audit-Publish (WAP) is a pattern for designing data pipelines where a pipeline is built up of several sections. Each section produces a result data set that is used by one or more downstream sections and conforms to the same three-stage process:
- Write: The main work of the section is done and data is written to a staging area that is inaccessible to other sections
- Audit: The staging data is checked using automated checks
- Publish: Only data that passes the audit is published to downstream sections of the pipeline
