Skip to content

๐Ÿ”„ Epic 2 โ€” Infrastructure & ETL Pipeline Architecture

ID Task Status Notes
E2-1 Proposal: analytics DB on current hosting (DigitalOcean) โœ… Proposal drafted (below)
E2-2 Follow with IT team for production DB ๐Ÿšง Pending provisioning & credentials

Hosting Proposal (Summary)

graph LR
    A[DAS Operational DB<br/>das-db] -->|daily ETL 02:00| B[Analytics MySQL 8<br/>etl_test on DigitalOcean]
    B --> C[MkDocs Docs Site<br/>Cloudflare Workers]
    B --> D[BI Tools<br/>Power BI / Looker Studio]
Component Decision Rationale
Engine MySQL 8.0 Window functions (ROW_NUMBER, DENSE_RANK) required by Pipeline A
Collation utf8mb4_0900_ai_ci Matches das-db; avoids collation errors on joins
Schema etl_test โ†’ rename bi_database at go-live Clean promotion path
Refresh Daily 02:00, chunked See ETL Runbook
Access gate Cloudflare Access (@marathonmyanmar.com) See Data Usage Terms

Open item

Production DB provisioning (E2-2) is the gate for go-live. Until IT completes it, all work continues on the local etl_test environment.