data-engineering/skills/04-data-lineage/SKILL.md

Data Lineage Skill

Use this skill when business and technical implementation are clear enough to model data flow.

Goal

Represent where data comes from, how it is processed, what intermediate artifacts exist, what final outputs are written, and how downstream modules consume them.

Procedure

1. Convert business stages into process steps.
2. Convert tables/files/APIs/caches/memory objects into data nodes.
3. Add lineage edges between nodes and steps.
4. Add field-level mappings for important IDs and business fields.
5. Mark intermediate artifacts separately from final business outputs.
6. Record evidence for every material edge.

Output Sections

• Data source inventory
• Process-step lineage
• Field-level lineage
• Intermediate artifacts
• Final outputs
• Downstream consumption
• Evidence and verification status