๐ Epic 2 โ Infrastructure & ETL Pipeline Architecture¶
| ID | Task | Status | Notes |
|---|---|---|---|
| E2-1 | Proposal: analytics DB on current hosting (DigitalOcean) | โ | Proposal drafted (below) |
| E2-2 | Follow with IT team for production DB | ๐ง | Pending provisioning & credentials |
Hosting Proposal (Summary)¶
graph LR
A[DAS Operational DB<br/>das-db] -->|daily ETL 02:00| B[Analytics MySQL 8<br/>etl_test on DigitalOcean]
B --> C[MkDocs Docs Site<br/>Cloudflare Workers]
B --> D[BI Tools<br/>Power BI / Looker Studio]
| Component | Decision | Rationale |
|---|---|---|
| Engine | MySQL 8.0 | Window functions (ROW_NUMBER, DENSE_RANK) required by Pipeline A |
| Collation | utf8mb4_0900_ai_ci |
Matches das-db; avoids collation errors on joins |
| Schema | etl_test โ rename bi_database at go-live |
Clean promotion path |
| Refresh | Daily 02:00, chunked | See ETL Runbook |
| Access gate | Cloudflare Access (@marathonmyanmar.com) |
See Data Usage Terms |
Open item
Production DB provisioning (E2-2) is the gate for go-live. Until IT completes it,
all work continues on the local etl_test environment.