A naukri.com initiative
Amazon
4w
107
Image Credit: Amazon
Accelerate your migration to Amazon OpenSearch Service with Reindexing-from-Snapshot
- Reindexing-from-Snapshot (RFS) is a new mechanism that simplifies migrating from self-managed OpenSearch and Elasticsearch clusters in legacy versions to Amazon OpenSearch Service.
- RFS uses shard-level codependency and snapshots to migrate data from OpenSearch and Elasticsearch clusters at high throughput without impacting the performance of the source cluster.
- RFS minimizes the performance impact to source clusters by retrieving data from a snapshot of the source cluster for data migration. This ensures that there is minimal downtime and data consistency concerns during migration.
- Reindexing is the core mechanism adopted by RFS for data migration, and it can migrate data across multiple major versions in one hop and make sure the data is fully updated and readable in the target cluster’s version.
- RFS leverages RFS workers to operate at the shard-level for high throughput. Each worker pulls down an un-migrated shard from the snapshot bucket and reindexes its documents against the target cluster.
- During the RFS migration, users can monitor the progress of the migration using the console CLI, which reports both the number of shards yet to be migrated and the number that have been completed.
- RFS is a low-cost solution for data migration, and it can take as little as 35 minutes to perform a migration, depending on the cluster size.
- To use RFS to migrate to Amazon OpenSearch Service, try the Migration Assistant solution.
- This post is written by Senior AWS Product Manager, Hang (Arthur) Zuo, Senior AWS Engineer, Chris Helma, AWS Software Development Engineer II, Andre Kurait and Sr. Search Specialist Solutions Architect with Amazon OpenSearch Service, Prashant Agrawal.
Read Full Article
6 Likes
For uninterrupted reading, download the app