Case study 13 / 19
5TB Telco Data to BigQuery
Backend synchronization workflows for national-scale modem telemetry into BigQuery, supporting centralized analytics and near real-time reporting.
- Stack
- AWS EC2 · AWS RDS · Google BigQuery · Apache Airflow · Apache Beam
- Links
- Write-up
The problem
National-scale modem telemetry needed to be synchronized into a centralized analytics environment. The data volume was large enough that simple exports and manual reporting patterns were not reliable for recurring operational insight.
What I built
Designed backend data synchronization workflows that moved 5TB+ modem data into Google BigQuery. The system supported scheduled delivery, centralized analytics, reporting automation, and near real-time operational visibility.
Proof
- 01 Handled 5TB+ of modem telemetry data.
- 02 Used cloud data infrastructure including AWS services and Google BigQuery.
- 03 Built scheduled data workflows with tools such as Apache Airflow and Apache Beam.
Result
Enabled centralized analytics and more reliable reporting automation for national-scale telco operational data.