By Alexander Eiriksson, COO at Securstore Online Backup
July 02, 2012

Securstore Online Data Backup Expert Tips: Dedupe Performance – A Matter of Some Concern?

Storage efficiencies delivered by deduplication technology has been discussed threadbare. The cost benefits derived from dedupe has also been enthusiastically acclaimed. The technology has been harnessed into primary or secondary storage and benefits of each adoption have been thrashed out. But, what about data integrity—post dedupe? Does the rush to adopt the technology take into consideration long term data integrity and performance risk concerns? At what point will the dedupe technology break down? When will it fail to deliver the expected results? It cannot be consistent across volumes!

Imperfectly designed dedupe mechanisms can impact system performance and create data instability. Dedupe works by segmenting data into blocks and generating hash codes for each segment for comparison with stored hash values. Segments with same hash codes are discarded as duplicates. As volumes of data increase, hash comparisons can take longer time and performance degradations can occur.

Cloud service providers ensure dedupe performance and lookup efficiencies by storing the hash table in the DRAM. But, the DRAM can quickly overflow and occupy space in the hard drive causing latency issues to degrade performance. One method of overcoming the problem is to reduce or control the physical size of the hash table. Another is to reduce the size of entries into the hash table. Smaller tables will reduce the possibility of overflow. Alternately, the size of the DRAM can be increased. This has cost implications. A few vendors feel that it would perhaps be more effective if the efficiency of the lookup engine were enhanced. The engine should be intelligent enough to put frequently used sections of the hash table into memory. The RAM cache may be used for the index.

As a result, deduplication performance is a matter of concern. Cloud users must evaluate the deduplication engine that is offered and ensure that the vendor puts in all the hard work necessary to ensure optimum performance of the engine. We at Securstore (powered by Asigra) spend huge amounts of time and resources on ensuring that the customers are not disadvantaged by the poor quality of the deduplication. Asigra fine tunes their solutions to meet the demands of the data center and build up capacities for handling increasing data volumes. The heuristics algorithm, that is used automatically, assigns sections that must occupy the RAM and sections that must be relegated to the hard drive. The data correlation techniques used reflects the years of experience behind the use of the technology. Securstore is very proud to be working with Asigra’s award winning solutions.

Securstore provides a bespoke offsite backup solution catered for customers who have both mission-critical data and non-critical data i.e. it provides customers with a secure & efficient backup and recovery solution which is sustainable over time. This coupled with agentless technology and advanced support for all environments and applications makes it suitable for any type of business, data centre provider or reseller.

Watch Securstore video – guided tours here:

About the Author: Alexander Eiriksson is the COO of Securstore, an Asigra based cloud backup provider certified by British Standards Institute for ISO 27001 and ANAB. Established in 1991, Securstore provides businesses and enterprise customers a technically advanced solution in UK, Europe, USA, Africa, Asia and the Middle East.

General Tags: SaaS, online backup companies, online file storage, CEO interviews, cloud computing, online data backup, online backup news, online backup, backing up online, online backup reviews, software as a service, online file backup, online backup providers directory, data security, compare online backups, data storage, top rated online backups, online backup services

Like us on Facebook

Do you like this post? Subscribe to our RSS feed ===========================


Related posts:

  1. Securstore Online Data Backup Expert Tips: Data Organization for Cloud Computing
  2. Securstore Online Data Backup Expert Tips: Asigra V12 Snapshots
  3. Securstore Online Data Backup Expert Tips: Asigra V12 – Ground-breaking Cloud Technology
  4. SecurStore Online Data Backup Expert Tips: Encryption/Decryption Algorithms – Is your Data Really Safe?
  5. Securstore Online Data Backup Expert Tips: Agility and Flexibility are Automatic Fall outs of the Cloud
  6. Securstore Online Data Backup Expert Tips: What to Look for While Selecting a Cloud Backup Service
  7. SecurStore Online Data Backup Expert Tips: Building a Global Ecosystem for your Business
  8. Securstore Online Data Backup Expert Tips: Has the Cloud Made the Tape Obsolete?
  9. Securstore Online Data Backup Expert Tips: Range of Encryption Algorithms – The Choice is yours
  10. SecurStore Online Data Backup Expert Tips: Benefiting from Virtualized Environments

Tags: , , ,