Selecting the right database and database migration plan for your workloads

{"value":"There has been a tectonic shift in the approach to hosting enterprise workloads. Companies are rapidly moving from on-premises data centers to cloud-based services. The driving factor has been the ability to innovate faster on the cloud.\n\nYour transition to cloud can be straightforward, but it does go beyond the usual ‘lift-and-shift’ approach. To start with, you’ll need a cloud provider that provides a data store and computing facility. But you’ll be able to grow your business with a provider that has purpose-built resources and a platform that supports innovation. Companies are using higher-level services such as fully managed databases and serverless compute offered by[Amazon Web Services (Amazon Web Services)](https://aws.amazon.com/)to get the most out of their cloud adoption journey.\n\nIn this blog, we will focus on the database tier of enterprise applications. We will evaluate the reasons for moving to managed or purpose-built databases. Then we’ll discuss in more detail the options you have and how to implement the right database migration plan for your workloads.\n\n#### **Why move to a managed database?**\n\nManaged databases, or [purpose-built databases](https://aws.amazon.com/products/databases/), are managed services by Amazon Web Services that free you to focus on other business and technical priorities. Different types of databases fill certain needs, and so the database tier in an application should never be a one-size-fits-all approach. Based on the kind of application you are developing, you should research managed options that suit your business and enterprise use cases.\n\n\n\n\nTable 1. Managed databases by Amazon Web Services\n\n#### **Managed database features**\n\n**Manageability**. The top priority and most valuable asset that you own as a company is your data. While data remains your key asset, spending time on database management is not the optimum use of your time. Managed services have built-in reliable tooling for multiple aspects of database management, which can help your database operate at the highest level.\n\n**Availability and disaster recovery**. Most managed databases at Amazon Web Services are highly available by default. For example, [Amazon Aurora ](https://aws.amazon.com/rds/aurora/?c=db&sec=srv&aurora-whats-new.sort-by=item.additionalFields.postDateTime&aurora-whats-new.sort-order=desc) is designed to offer 99.99% availability, replicating six copies of your data across three Availability Zones (Figure 1). It backs up your data continuously to [Amazon S3](https://aws.amazon.com/s3/). It recovers transparently from physical storage failures; instance failover typically takes less than 30 seconds.\n\n\n\nFigure 1. Replication across three Availability Zones with [Amazon Aurora](https://aws.amazon.com/cn/rds/aurora/?trk=cndc-detail) DB cluster\n\nWith managed databases, you get multiple options to create a highly available and fault tolerant database. Alternatively, if you choose to self-host a database elsewhere you will have to formulate your own disaster recovery (DR) strategy. This takes meticulous DR planning and relies heavily on a constant monitoring solution.\n\n**Elasticity and agility**: Cloud offers elasticity for scaling your database. You can scale in minutes and spin up and down additional servers and storage size as needed. It offers you flexibility with capacity planning. You can always reassess your database tier to see if it is over or under provisioned.\n\n#### **Self-managed databases on Amazon Web Services**\n\n##### *If I do not need a managed database, should I still use [Amazon EC2 ](https://aws.amazon.com/cn/ec2/?trk=cndc-detail)to host my database?*\n\nHere are some cases when you may find it beneficial to host your database on [Amazon EC2 ](https://aws.amazon.com/ec2/) instances:\n- You need full control over the database and access to its underlying operating system, database installation, and configuration.\n- You are ready to plan for the high availability of your database, and prepare your disaster recovery plan.\n- You want to administer your database, including backups and recovery. You must perform tasks such as patching the operating system and the database, tuning the operating system and database parameters, managing security, and configuring high availability or replication.\n- You want to use features that aren’t currently supported by managed services.\n- You need a specific database version that isn’t supported by Amazon Web Services managed database service.\n- Your database size and performance needs exceed the limits of the managed service.\n- You want to avoid automatic software patches that might not be compliant with your applications.\n- You want to achieve higher IOPS and storage capacity than the current limits of the managed services.\n\n##### ***Can I customize my underlying OS and database environment?***\n[Amazon RDS Custom ](https://aws.amazon.com/rds/custom/) is a managed database service for applications that require customization of the underlying operating system and database environment. With [Amazon RDS](https://aws.amazon.com/cn/rds/?trk=cndc-detail) Custom, you have access to the underlying EC2 instance that hosts the DB engine. You can access the EC2 instance via secure shell (Amazon Web Services Systems Manager and SSH) and perform the customizations to suit your application needs.\n\n#### **Choosing which migration plan to implement**\nThe first step in your cloud database migration journey is identifying which database that you want to migrate to. For relational databases, determine the migration strategy. In the majority of the database migrations, you can choose to rehost, replatform, or refactor.\n\nRefer the [ Amazon Web Services Prescriptive Guidance for choosing a migration strategy](https://docs.aws.amazon.com/prescriptive-guidance/latest/strategy-database-migration/choose-strategy.html) for relational databases.\n\nThe next is determining which database migration plan best serves your needs. Amazon Web Services provides a number of options to help correctly handle your data migration with minimal downtime. Here are the database migration plans that you can consider using for your cloud database adoption journey:\n\n**1. Amazon Web Services-offered Amazon Web Services Database Migration Service (Amazon Web Services DMS):** [ Amazon Web Services Database Migration Service (Amazon Web Services DMS)](https://aws.amazon.com/dms/) is a self-service option for migrating databases. You can use Amazon Web Services DMS to migrate between homogeneous database types, such as going from one MySQL instance to a new one. You can also use Amazon Web Services DMS between heterogeneous database types, such as moving from a commercial database like Oracle to a cloud-native relational database like Aurora. Read tutorials about migrating sample data: Amazon Web Services Database Migration Service Step-by-Step Walkthroughs.\n\nAmazon Web Services DMS offers minimal downtime, supports widely used databases, supports on-going replication, is offered as a low-cost service, and is highly reliable. If you are looking for an end-to-end service for database migration, consider Amazon Web Services DMS.\n\n2. **Amazon Web Services Database Migration Service (DMS) with Amazon Web Services Schema Conversion Tool (SCT)**: If you are migrating between heterogenous databases, use the[Amazon Web Services Schema Conversion Tool (SCT)](https://aws.amazon.com/dms/schema-conversion-tool/?nc=sn&loc=2). It converts the source database schema and the database code objects (like views, stored procedures, and functions) to a format compatible with the target database (Figure 2).\n\n\n\nFigure 2. Supported conversions with Amazon Web Services Schema Conversion Tool\n\nFor heterogeneous migrations, consider using Amazon Web Services DMS with Amazon Web Services SCT.\n\n**3. Database Freedom Program:** If you are new to cloud computing or if your database migration plan must be evaluated and validated by industry experts, then try the Database Freedom Program. Database Freedom is a unique program designed to assist customers in migrating to Amazon Web Services databases and analytics services. They will provide technical advice, migration support, and financial assistance.\n\nYou can use the [ Contact Us](https://aws.amazon.com/solutions/databasemigrations/database-freedom/) page for the Database Freedom program to get in touch with experts that can assist you in your cloud adoption journey.\n\n**4. Amazon Web Services Professional Services and Partners:** You may have in-house database expertise, but need end-to-end implementation assistance across different application tiers. Get help from the [Professional Services of Amazon Web Services ](https://aws.amazon.com/professional-services/)or connect with the certified network of Amazon Web Services Partners. [Amazon Web Services Database Migration Service Delivery Partners ](https://aws.amazon.com/dms/partners/?partner-solutions-cards.sort-by=item.additionalFields.partnerNameLower&partner-solutions-cards.sort-order=asc&awsf.partner-solutions-filter-partner-type-storage=*all&awsf.partner-solutions-filter-partner-location-storage=*all) help customers use Amazon Web Services DMS to migrate databases to Amazon Web Services securely, while minimizing application downtime and following best practices.\n\n#### **Conclusion**\nMigrating to the cloud is a journey that is ever-evolving. To remain focused on your innovations, leverage the managed services of Amazon Web Services for your migration journey.\n\nI hope this post helps you consider using a managed database service when available, and effectively evaluate and choose the right database migration plan for your enterprise. For any queries, feel free to get in touch with us. We will be happy to help you in your cloud journey.\n\nHappy migrating!\n\n##### **Additional Reading**\n\n- [Optimizing costs in Amazon RDS](https://aws.amazon.com/blogs/database/optimizing-costs-in-amazon-rds/)\n- [Security best practices for Amazon RDS](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_BestPractices.Security.html)\n- [Best practices for working with Amazon Aurora Serverless](https://aws.amazon.com/blogs/database/best-practices-for-working-with-amazon-aurora-serverless/)\n- [Best Practices for Designing and Architecting with DynamoDB](https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/best-practices.html)\n- [Best Practices for Amazon RDS](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_BestPractices.html)\n\n\n\n**Nikhil Anand**\nNikhil is a Solutions Architect at Amazon Web Services with an extensive background in DevOps and Compute offerings at Amazon Web Services. He is an avid reader keen to explore different technologies. Outside of work, he likes to keep himself engaged with sports and never misses a workout opportunity.","render":"<p>There has been a tectonic shift in the approach to hosting enterprise workloads. Companies are rapidly moving from on-premises data centers to cloud-based services. The driving factor has been the ability to innovate faster on the cloud.</p>\n<p>Your transition to cloud can be straightforward, but it does go beyond the usual ‘lift-and-shift’ approach. To start with, you’ll need a cloud provider that provides a data store and computing facility. But you’ll be able to grow your business with a provider that has purpose-built resources and a platform that supports innovation. Companies are using higher-level services such as fully managed databases and serverless compute offered by<a href=\\"https://aws.amazon.com/\\" target=\\"_blank\\">Amazon Web Services (Amazon Web Services)</a>to get the most out of their cloud adoption journey.</p>\\n<p>In this blog, we will focus on the database tier of enterprise applications. We will evaluate the reasons for moving to managed or purpose-built databases. Then we’ll discuss in more detail the options you have and how to implement the right database migration plan for your workloads.</p>\n<h4><a id=\\"Why_move_to_a_managed_database_6\\"></a><strong>Why move to a managed database?</strong></h4>\\n<p>Managed databases, or <a href=\\"https://aws.amazon.com/products/databases/\\" target=\\"_blank\\">purpose-built databases</a>, are managed services by Amazon Web Services that free you to focus on other business and technical priorities. Different types of databases fill certain needs, and so the database tier in an application should never be a one-size-fits-all approach. Based on the kind of application you are developing, you should research managed options that suit your business and enterprise use cases.</p>\\n<p><img src=\\"https://dev-media.amazoncloud.cn/81bbd9b4770e4c82be8d643317f9660a_image.png\\" alt=\\"image.png\\" /><br />\\n<img src=\\"https://dev-media.amazoncloud.cn/28813842c5af486096b55d5c0e060787_image.png\\" alt=\\"image.png\\" /></p>\n<p>Table 1. Managed databases by Amazon Web Services</p>\n<h4><a id=\\"Managed_database_features_15\\"></a><strong>Managed database features</strong></h4>\\n<p><strong>Manageability</strong>. The top priority and most valuable asset that you own as a company is your data. While data remains your key asset, spending time on database management is not the optimum use of your time. Managed services have built-in reliable tooling for multiple aspects of database management, which can help your database operate at the highest level.</p>\\n<p><strong>Availability and disaster recovery</strong>. Most managed databases at Amazon Web Services are highly available by default. For example, <a href=\\"https://aws.amazon.com/rds/aurora/?c=db&amp;sec=srv&amp;aurora-whats-new.sort-by=item.additionalFields.postDateTime&amp;aurora-whats-new.sort-order=desc\\" target=\\"_blank\\">Amazon Aurora </a> is designed to offer 99.99% availability, replicating six copies of your data across three Availability Zones (Figure 1). It backs up your data continuously to <a href=\\"https://aws.amazon.com/s3/\\" target=\\"_blank\\">Amazon S3</a>. It recovers transparently from physical storage failures; instance failover typically takes less than 30 seconds.</p>\\n<p><img src=\\"https://dev-media.amazoncloud.cn/a9ba4c9e69c2440b98eed96826e77d95_image.png\\" alt=\\"image.png\\" /></p>\n<p>Figure 1. Replication across three Availability Zones with Amazon Aurora DB cluster</p>\n<p>With managed databases, you get multiple options to create a highly available and fault tolerant database. Alternatively, if you choose to self-host a database elsewhere you will have to formulate your own disaster recovery (DR) strategy. This takes meticulous DR planning and relies heavily on a constant monitoring solution.</p>\n<p><strong>Elasticity and agility</strong>: Cloud offers elasticity for scaling your database. You can scale in minutes and spin up and down additional servers and storage size as needed. It offers you flexibility with capacity planning. You can always reassess your database tier to see if it is over or under provisioned.</p>\\n<h4><a id=\\"Selfmanaged_databases_on_Amazon_Web_Services_29\\"></a><strong>Self-managed databases on Amazon Web Services</strong></h4>\\n<h5><a id=\\"If_I_do_not_need_a_managed_database_should_I_still_use_Amazon_EC2_to_host_my_database_31\\"></a><em>If I do not need a managed database, should I still use Amazon EC2 to host my database?</em></h5>\\n<p>Here are some cases when you may find it beneficial to host your database on <a href=\\"https://aws.amazon.com/ec2/\\" target=\\"_blank\\">Amazon EC2 </a> instances:</p>\\n<ul>\\n<li>You need full control over the database and access to its underlying operating system, database installation, and configuration.</li>\n<li>You are ready to plan for the high availability of your database, and prepare your disaster recovery plan.</li>\n<li>You want to administer your database, including backups and recovery. You must perform tasks such as patching the operating system and the database, tuning the operating system and database parameters, managing security, and configuring high availability or replication.</li>\n<li>You want to use features that aren’t currently supported by managed services.</li>\n<li>You need a specific database version that isn’t supported by Amazon Web Services managed database service.</li>\n<li>Your database size and performance needs exceed the limits of the managed service.</li>\n<li>You want to avoid automatic software patches that might not be compliant with your applications.</li>\n<li>You want to achieve higher IOPS and storage capacity than the current limits of the managed services.</li>\n</ul>\\n<h5><a id=\\"Can_I_customize_my_underlying_OS_and_database_environment_43\\"></a><em><strong>Can I customize my underlying OS and database environment?</strong></em></h5>\n<p><a href=\\"https://aws.amazon.com/rds/custom/\\" target=\\"_blank\\">Amazon RDS Custom </a> is a managed database service for applications that require customization of the underlying operating system and database environment. With [Amazon RDS](https://aws.amazon.com/cn/rds/?trk=cndc-detail) Custom, you have access to the underlying EC2 instance that hosts the DB engine. You can access the EC2 instance via secure shell (Amazon Web Services Systems Manager and SSH) and perform the customizations to suit your application needs.</p>\\n<h4><a id=\\"Choosing_which_migration_plan_to_implement_46\\"></a><strong>Choosing which migration plan to implement</strong></h4>\\n<p>The first step in your cloud database migration journey is identifying which database that you want to migrate to. For relational databases, determine the migration strategy. In the majority of the database migrations, you can choose to rehost, replatform, or refactor.</p>\n<p>Refer the <a href=\\"https://docs.aws.amazon.com/prescriptive-guidance/latest/strategy-database-migration/choose-strategy.html\\" target=\\"_blank\\"> Amazon Web Services Prescriptive Guidance for choosing a migration strategy</a> for relational databases.</p>\\n<p>The next is determining which database migration plan best serves your needs. Amazon Web Services provides a number of options to help correctly handle your data migration with minimal downtime. Here are the database migration plans that you can consider using for your cloud database adoption journey:</p>\n<p><strong>1. Amazon Web Services-offered Amazon Web Services Database Migration Service (Amazon Web Services DMS):</strong> <a href=\\"https://aws.amazon.com/dms/\\" target=\\"_blank\\"> Amazon Web Services Database Migration Service (Amazon Web Services DMS)</a> is a self-service option for migrating databases. You can use Amazon Web Services DMS to migrate between homogeneous database types, such as going from one MySQL instance to a new one. You can also use Amazon Web Services DMS between heterogeneous database types, such as moving from a commercial database like Oracle to a cloud-native relational database like Aurora. Read tutorials about migrating sample data: Amazon Web Services Database Migration Service Step-by-Step Walkthroughs.</p>\\n<p>Amazon Web Services DMS offers minimal downtime, supports widely used databases, supports on-going replication, is offered as a low-cost service, and is highly reliable. If you are looking for an end-to-end service for database migration, consider Amazon Web Services DMS.</p>\n<ol start=\\"2\\">\\n<li><strong>Amazon Web Services Database Migration Service (DMS) with Amazon Web Services Schema Conversion Tool (SCT)</strong>: If you are migrating between heterogenous databases, use the<a href=\\"https://aws.amazon.com/dms/schema-conversion-tool/?nc=sn&amp;loc=2\\" target=\\"_blank\\">Amazon Web Services Schema Conversion Tool (SCT)</a>. It converts the source database schema and the database code objects (like views, stored procedures, and functions) to a format compatible with the target database (Figure 2).</li>\\n</ol>\n<p><img src=\\"https://dev-media.amazoncloud.cn/2212733fb78947b093bc5183a216d2c3_image.png\\" alt=\\"image.png\\" /></p>\n<p>Figure 2. Supported conversions with Amazon Web Services Schema Conversion Tool</p>\n<p>For heterogeneous migrations, consider using Amazon Web Services DMS with Amazon Web Services SCT.</p>\n<p><strong>3. Database Freedom Program:</strong> If you are new to cloud computing or if your database migration plan must be evaluated and validated by industry experts, then try the Database Freedom Program. Database Freedom is a unique program designed to assist customers in migrating to Amazon Web Services databases and analytics services. They will provide technical advice, migration support, and financial assistance.</p>\\n<p>You can use the <a href=\\"https://aws.amazon.com/solutions/databasemigrations/database-freedom/\\" target=\\"_blank\\"> Contact Us</a> page for the Database Freedom program to get in touch with experts that can assist you in your cloud adoption journey.</p>\\n<p><strong>4. Amazon Web Services Professional Services and Partners:</strong> You may have in-house database expertise, but need end-to-end implementation assistance across different application tiers. Get help from the <a href=\\"https://aws.amazon.com/professional-services/\\" target=\\"_blank\\">Professional Services of Amazon Web Services </a>or connect with the certified network of Amazon Web Services Partners. <a href=\\"https://aws.amazon.com/dms/partners/?partner-solutions-cards.sort-by=item.additionalFields.partnerNameLower&amp;partner-solutions-cards.sort-order=asc&amp;awsf.partner-solutions-filter-partner-type-storage=*all&amp;awsf.partner-solutions-filter-partner-location-storage=*all\\" target=\\"_blank\\">Amazon Web Services Database Migration Service Delivery Partners </a> help customers use Amazon Web Services DMS to migrate databases to Amazon Web Services securely, while minimizing application downtime and following best practices.</p>\\n<h4><a id=\\"Conclusion_71\\"></a><strong>Conclusion</strong></h4>\\n<p>Migrating to the cloud is a journey that is ever-evolving. To remain focused on your innovations, leverage the managed services of Amazon Web Services for your migration journey.</p>\n<p>I hope this post helps you consider using a managed database service when available, and effectively evaluate and choose the right database migration plan for your enterprise. For any queries, feel free to get in touch with us. We will be happy to help you in your cloud journey.</p>\n<p>Happy migrating!</p>\n<h5><a id=\\"Additional_Reading_78\\"></a><strong>Additional Reading</strong></h5>\\n<ul>\\n<li><a href=\\"https://aws.amazon.com/blogs/database/optimizing-costs-in-amazon-rds/\\" target=\\"_blank\\">Optimizing costs in Amazon RDS</a></li>\\n<li><a href=\\"https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_BestPractices.Security.html\\" target=\\"_blank\\">Security best practices for Amazon RDS</a></li>\\n<li><a href=\\"https://aws.amazon.com/blogs/database/best-practices-for-working-with-amazon-aurora-serverless/\\" target=\\"_blank\\">Best practices for working with Amazon Aurora Serverless</a></li>\\n<li><a href=\\"https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/best-practices.html\\" target=\\"_blank\\">Best Practices for Designing and Architecting with DynamoDB</a></li>\\n<li><a href=\\"https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_BestPractices.html\\" target=\\"_blank\\">Best Practices for Amazon RDS</a></li>\\n</ul>\n<p><img src=\\"https://dev-media.amazoncloud.cn/4207104a8bc745b8a7bc2ce1b8f1a110_image.png\\" alt=\\"image.png\\" /></p>\n<p><strong>Nikhil Anand</strong><br />\\nNikhil is a Solutions Architect at Amazon Web Services with an extensive background in DevOps and Compute offerings at Amazon Web Services. He is an avid reader keen to explore different technologies. Outside of work, he likes to keep himself engaged with sports and never misses a workout opportunity.</p>\n"}