Workflow
The process is a file, dpf/workflow.yaml, loaded and validated when the factory
starts. This page is generated from the workflow the running deployment loaded — if
it sets DPF_WORKFLOW to a different file, this page shows that process. To change
it, see Change the workflow.
who is human for a step a person does, agent for one an agent can draft and a
person accepts, and auto for one the factory does itself. needs lists the steps
that must be done first.
1. Source
What decision this serves, which tables could answer it, and getting them landed so the work can start.
- Ends with: The tables are loaded
- Its document: Data contract v0.1
- Gate: approval to load — The source owner approves loading these tables for this purpose
- RACI: accountable Source System, responsible Use Case Team, consulted Data Hub, informed Data Hub
| Step | Who | Needs | Produces | Agent |
|---|---|---|---|---|
Define the data product (brief) |
human | — | brief |
— |
Choose the source tables (sources) |
human | brief |
source_pins |
— |
Data contract v0.1 (demand) |
human | sources |
loaded |
— |
2. Refine
Turn landed tables into a defined data product: what it must do, how the shared layer is shaped, and what it promises.
- Ends with: The data product is defined
- Its document: Data contract 0.x, agreed
- Gate: agreement — The source owners and the consumers agree the contract
- RACI: accountable Use Case Team, responsible Data Hub, consulted Source System, informed Source System
| Step | Who | Needs | Produces | Agent |
|---|---|---|---|---|
Draft the requirements (requirements) |
agent | brief, demand |
requirements |
requirements |
Design the data model (model) |
agent | requirements, sources |
data_model |
modelling |
Data contract (contract) |
agent | model |
contract |
contract |
3. Deliver
Prove it works with the thing that consumes it, then put it in production.
- Ends with: The data product is in production
- Its document: Data contract v1.0
- Gate: sign-off — The consuming use case signs off the integration test
- RACI: accountable Data Hub, responsible Data Hub, consulted Use Case Team, informed Source System
| Step | Who | Needs | Produces | Agent |
|---|---|---|---|---|
Build and validate (build) |
auto | model, contract |
run |
— |
System integration test (sit) |
human | build |
sit |
— |
Go live (release) |
human | sit |
release |
— |