Project Kickoff Checklist

System Selection

• Selected system using Decision Framework (DuckDB, Postgres, AWS, Snowflake)
• Confirmed data size, users, and expected growth
• Identified if migration may be needed later

Data Definition

• Identified all data sources (CSV, API, database)
• Confirmed data structure and expected columns
• Defined primary keys or unique identifiers

Project Setup

• Created project folder structure
• Created requirements.txt
• Set up environment (pip install)

Data Layers

• Defined bronze tables (raw ingestion)
• Defined silver tables (cleaned, structured)
• Defined gold tables (business-ready outputs)

Naming & Structure

• Applied naming conventions (bronze.raw_, silver.*_clean, gold.*)
• Ensured consistency across schemas and tables

Execution Plan

• Confirmed main.py will run full pipeline
• Verified input/output paths
• Planned validation checks

Output

• Defined final output (Excel, CSV, API, dashboard)
• Identified consumers of the data