Migrating 1.1billion rows of data to AWS

Post acquisition, the resulting technology organization aims to accelerate the scale and speed at which the company creates customer value with transformative products and services in the digital space.

The technology team was challenged to accelerate the rate of innovation at which their data sciences team could iterate over vast datasets, training and fine tuning data models, all while reducing long term operating costs and upfront capital investments.

Providing a cost effective and reliable avenue to migrate data rows from datacenter backed MySQL-server instances to a managed alternative that could scale as their workloads progressively moved into AWS, while giving them an edge on reliability and operational overhead.

Knowing that executing data migrations are seldom one-time affairs, Protagona looked at AWS DMS, specifically their Serverless service, to prove out and design the components that would enable the customer to effectively maintain one-way replication between their datacenter backed MySQL instances and a binary-compatible Amazon RDS deployment on AWS. This nearly eliminated the need for costly code refactoring, training, or retooling of their analytics applications.

DMS Serverless provided the ideal foundation to build a scalable and highly predictable solution that seamlessly integrated with their existing platform.‍

With secure and private point-to-point connectivity between datacenter and AWS accounted for, DMS Serverless made the initial batch data load and subsequent replication straight forward.‍

Once in RDS, point in time recovery and snapshot capabilities were of critical importance for test teams to validate and certify workloads as they progressively moved as well.‍