- AUTHOR Nitin Pund
- PUBLISHED ON July 31, 2020
Migrating the Enterprise Data Backup Efficiently and Cost-Effectively
Our customer is a leading warehousing company that maintains the inventory for several online shopping giants. The company also stores and distributes the products from manufacturers and designers. The customer accesses and stores the operational data on an enterprise-scale database for its day-to-day operations. They also need to back up the transactional data for future reference/audit purposes. Over the last five years the data has increased multifold and managing the backed up data has become a challenge for the customer.
High Backup Cost: The data is stored in AWS RDS and the backup is stored as RDS Snapshots, which in-turn are backed by S3 storage. This option charges the users based on the size of the data. As the business demanded that the data should be backed up every week, the size would easily run into Terabytes. Effectively, a weekly backup would mean a significant cost to the customer.
Redundant Features: This data backup was only required for disaster recovery and audit purposes: essentially on a need basis. It meant that the customer did not need to retrieve this data too often, and therefore was looking for a cost-effective solution.
After analyzing the requirements, Niyuj recommended them to switch to Amazon S3 Glacier Storage. This option would help them in bringing the costs down, while not compromising on the data integrity. The customer was new to this offering and did not have the skilled manpower required to migrate to the new storage. Niyuj supported the customer in setting up the new storage, configuring the auto backup mechanism, and in data migration. We also trained the resources at the customer location in monitoring the backup operations and following the best practices.
The implementation brought down the total cost by 90%. The significant cost advantage was achieved without compromising the volume of data. The knowledge sharing with customer’s resources helped them in confidently adapting to the new system. Glacier also provided features where the customer can configure the solution based on parameters such as the frequency of retrieval and the timeline requirements.
When should you choose Amazon S3 Glacier over Amazon S3 Standard Storage?
Here is a quick, ballpark cost calculation about how one should choose the suitable alternative. (Disclaimer: The amounts quoted below are only for bringing the cost advantage to the fore and are subjected to change. They are solely the propriety of Amazon. Also, choosing the suitable backup alternative includes other requirements that vary from customer to customer.)
There can be cases where you do not need to frequently access the backed-up data. For example, you need to access it only once in six months or even less frequently than that. In this case we can choose Amazon Glacier as it can reduce the cost of storage. For example, storing the data to the tune of 1500 GB on Standard S3 costs about $150 per month. This is a lot of money for backing up the data that you do not access very often. However, storing the same amount of data on Amazon Glacier costs only around $15 per month, which is the tenth of the cost compared to the Standard S3 version.
So, if you are also looking for ways to cut down the data storage costs without compromising the data integrity, do reach out to us.