1. Database Migration Services in AWS
We talked about storing data in the cloud, but how does data get into the cloud? Let's look at database migration to understand how AWS helps moving data into the cloud.
2. What is database migration?
Database migration is moving all of your data from one environment to a brand new environment.
Think of it like moving into a new office where you would first plan the move, assess feasibility, ensure a smooth transition, and then update your contacts about the new address.
3. Why do we need data migration?
So, why do we need to move data to new environments?
Legacy systems are unable to meet the rapidly changing scalability and efficiency requirements today.
4. Why do we need data migration?
New world applications like generative AI have advanced systemic needs for compute and storage.
5. Why do we need data migration?
And since businesses now rely on data from a vast array of sources, they need a unified management layer for all their data in one place, and migrating to new advanced environments helps establish these goals.
6. Data migration in practice
A typical migration project will consist of five steps starting with an assessment of existing data structures, formats, and dependencies of the source data.
7. Data migration in practice
Secondly, preparation, where you would develop a clear migration plan and organize the source data.
8. Data migration in practice
Third, execution, where necessary tools and operations will be deployed to perform the database migration without inconsistencies.
9. Data migration in practice
Next, validation to verify data integrity post-migration and conduct thorough testing.
10. Data migration in practice
And finally, optimization, to fine-tune the performance of applications in the new environment.
11. Migration in AWS
Now, how does AWS support database migration? It offers four services: the Database Migration Service, AWS Snow Family, DataSync, and the Schema Conversion Tool to enable database migration. Let's look at each of these in more detail.
12. AWS Database Migration Service
Database Migration Service facilitates the migration of databases and analytics engines to AWS.
It replicates into multiple availability zones ensuring near-zero downtime, and supports a diverse range of source and target databases.
It performs validation checks and task monitoring to ensure data integrity during and post-migration.
13. AWS Snow Family
The AWS Snow Family is a collection of devices that facilitate offline migration of petabyte-scale data.
They process data at edge locations or remote sites that are physically closer to where the source data is stored.
They implement robust security measures like encryption and tamper-evident seals to ensure data integrity.
14. AWS DataSync
AWS DataSync is a service that specializes in transferring large amounts of data from on-premises storage to the cloud.
It has parallel processing capabilities which ensure fast and efficient data transfer and it provides seamless integration with S3 and other data storage services.
It also supports automation through AWS management console and internal AWS APIs.
15. AWS Schema Conversion Tool
And finally, the AWS Schema Conversion Tool automates database schema conversion by mapping source objects to corresponding target objects, minimizing manual effort.
It allows conversion rule customizations, validates the converted schema before performing the migration, and offers live diagnostics and recommendations to address potential issues during migration.
16. When to use which service?
We looked at four database migration services that AWS offers. But, in what scenarios do each of them excel?
Database Migration Service is ideal for large-scale, complex data migration projects across heterogeneous databases.
17. When to use which service?
AWS Snow Family is effective for scenarios with large physical data volumes, restricted bandwidth, or where data must be processed at the edge before moving to AWS.
18. When to use which service?
AWS DataSync is ideal for scenarios requiring frequent and automated large-scale data transfers between on-premises storage and AWS.
19. When to use which service?
And AWS Schema Conversion Tool is useful for migration projects where the source and target databases have different structures, enabling a seamless transition with reduced manual intervention.
20. Let's practice!
Time to get a quick knowledge check on database migration services in AWS.