AWS · EC2 VPC 2023 internship

Simplifying billing data storage

Moving billing and metering data access from replicated MySQL tables to DynamoDB.

My role: Schema design, migration, and API changes
Outcome: 83% lower average query latency

Billing and metering APIs
Access-pattern-driven queries
Shared DynamoDB tables

The new access path replaced reads from copies of MySQL tables on individual hosts.

The problem

VPC data was spread across roughly a thousand servers holding their own copies of MySQL tables. Maintaining those replicas added load and operational overhead.

The work

I designed DynamoDB tables around the application's access patterns, using write sharding and multithreading, migrated the data, and updated the related billing and metering APIs.

The result

The new path reduced average query latency by 83% and let hosts use a shared data source instead of maintaining their own replicas.