数据管道
etl-pipeline-refactor
更新于 2026-08-18
ETL Pipelines · 重构规则
Refactoring rules for ETL Pipelines: characterisation tests, behaviour-free diffs and seam-by-seam extraction.
- 技术栈
- ETL Pipelines
- 主题
- 重构
- 条目
- 9 条
- 版本
- v0.2.0
✓ 应当这么做
- ✓ Characterise current behaviour with tests before touching structure
- ✓ Keep refactor commits free of behaviour change and vice versa
- ✓ Extract one seam at a time and delete the old path in the same change
✕ 常见反模式
- ✕ Rewriting and changing features in one unreviewable diff
- ✕ Leaving both old and new implementations alive indefinitely
- ✕ Refactoring code no requirement currently touches
◎ 交付前验证
- ◎ Row counts and key uniqueness compared against the previous run
- ◎ Backfill path tested on a partition
- ◎ Lineage graph updated for the new source