Overview › ETL

ETL

The pipelines that build the data — all code on GitHub under github.com/8020rei-com ↗.

Repositories

gaia-data-ds ↗production · the 7-step ETL behind REI client scoring — Alpha runs at step 4 raw-etl-data ↗vendor ingest · API → Bronze DataFramework ↗shared framework (vendored) data-models ↗legacy models + roofing notebooks data-ds-template ↗starting point for new pipelines

Walkthroughs

BuildZoom ETL walkthroughBronze → Silver → Gold, field by field Engine transparencyDuckDB vs Athena SQL vs Spark — the three-engine reality

ETL quality lives elsewhere by design: per-source audits on Data and Audits; walkthroughs in the Log.