Moving millions of files from NAS to Amazon FSx for Windows FS

Post acquisition, the resulting technology organization aims to accelerate the scale and speed at which the company creates customer value with transformative products and services in the digital space.

The technology team was challenged to accelerate the rate of innovation at which their data sciences team could iterate over vast datasets, training and fine tuning data models, all while reducing long term operating costs and upfront capital investments.

Quickly and reliably migrate over 10M files, spanning multiple NAS datacenter appliances to a Windows File Server compatible storage in AWS, while enabling the operations and data sciences teams to maintain their toolbox unchanged.

Knowing that durability and reliability were key pillars of any proposed solution, and understanding that changes to the toolset used by the customer had to be kept to a minimum, Protagona devised a solution that combined AWS’ DataSync agent-based file system replication with Amazon FSx for Windows File Server.

‍

This combination gave the customer the ability to turn replication on/off when and as needed, while landing replicated content directly on a storage service compatible with their tooling. This in turn allowed the incremental validation and testing of both data and functionality.

‍

FSx’s native data encryption, AWS Backup integration, and its multi-AZ 99.99% SLA made it a natural choice to house migrated files.