Image Storage Optimization using Deduplication

Rajalakshmi K. R., Dr. Saritha Chakrasali

Abstract: One of the challenges of the today?s industry is the storage of similar data, repeatedly and thereby consumption of disk space for it, whether local on the physical standalone server or on cloud. An increase in volumes of same data across several user profiles, causes heavy increase in amount of data stored and causes more disk space usage. Storage of same redundant data can be avoided as much as possible. Major Contribution to the reduction of the storage space is elimination of data duplication and usage of hash coding techniques to conserve space. Images play an important role in today?s use of data. An attempt is made in this paper to develop an application to reduce data duplication using hashing technique on a Hadoop Framework.

Keywords: Optimization, Hadoop, De-Duplication, Images, Storage