Sodium
Sharp and mono, for infrastructure and data tools.
A backfill
sessions-rollup
Running6m 12sPartitions
48.2M
12/ 16
0
about 4m
- Read sourceRead sourceraw.sessions4.1sDoneDone
- Dedupe rowsDedupe rows1.2M rows38sDoneDone
- Write partitionsWrite partitionswh.sessions_dailyWriting partitions
- Compact filesCompact filesQueuedQueued
Runs
Runs6
| Run | Status |
|---|---|
| run_8f2a91 | Running |
| run_8f2a90 | Failed |
| run_8f2a8e | Succeeded |
| run_8f2a8c | Succeeded |
| run_8f2a8b | Warning |
| run_8f2a8a | Queued |
Failed load
Load failed at line 6
The source dropped column region on Oct 18.
-- one row per order, by regioninsert into wh.orders_dailyselect order_id, customer_id, region, sum(amount) as amount, count(*) as itemsfrom raw.orderswhere loaded_at >= '2026-10-18'group by order_id, customer_id, regionrun_8f2a905 lines
On call
orders-daily
Job failed02:14 UTCThe source dropped a column, so the next run at 03:00 will fail the same way.
orders-daily
write_partitions
2026-10-18
3 of 3
Warehouse
wh-analytics
size LCreditsNear limit
Storage
Concurrency
- events38.4 TB
- orders12.1 TB
- sessions7.6 TB
- staging2.9 TB
Queries by hour, today
| Hour | Queries |
|---|---|
| 00:00 | 310 |
| 03:00 | 220 |
| 06:00 | 480 |
| 09:00 | 1.2K |
| 12:00 | 1.6K |
| 15:00 | 1.5K |
| 18:00 | 980 |
| 21:00 | 640 |
Nightly sync
nightly-sync
02:00 UTC- Extract, Sources
- Load, Sources to Warehouse48,210 rows
- Transform, Warehouse
- Test, WarehouseOK
- Publish, Dashboard
- Orders: 1.2M, 58% of the total
- Events: 612K, 29% of the total
- Files: 287K, 13% of the total
Pipeline history
| Day | Runs |
|---|---|
| Mon | 24 |
| Tue | 26 |
| Wed | 25 |
| Thu | 31 |
| Fri | 28 |
| Sat | 12 |
| Sun | 9 |
2026-10-18
Column region missing in the source.
0 B
2026-10-17
Loaded and compacted.
2.4 GB
2026-10-16
Loaded and compacted.
2.3 GB
- Cron
- 0 2 * * *
- Timezone
- UTC
- Retries
- 3, 5m apart
- Owner
- data-platform