Satellite Data Archival on Object Storage Along with Hierarchical Storage Management

Pradeep C., Prasad G., ANSV Murali Krishna

Abstract: The use of Indian Remote Sensing Satellite data has brought in transitions towards development in wide range of applications such as agriculture, weather monitoring and prediction, managing natural resources and disaster management, etc., catering to the needs of these applications in managing the data resources has brought in challenges. The need for storage solutions to archive such a huge data with relatively good accessible speed becomes a paramount. Software-defined Storage solutions represent a transformative shift in the data storage industry with enhanced safety, efficiency, and flexibility. It has the potential to save hundreds of peta-bytes by reducing the cost. This paper explores the design considerations and frameworks handled for the installation and deployment of object storage and explain the functional concepts and the intricate relationship between the object storage and the existing SAN storage. Moreover, it extracts the possibilities of integrating the on-premises object storage solution with a HSM based storage architecture. This new type of storage system has been introduced to deliver real-time data support for enhancing overall data product generation, application development and data dissemination. The functionality and effectiveness of this customized object storage solution has been assessed at the IMGEOS Data Center in NRSC, Hyderabad. The placement of software-defined storage system possesses connectivity capabilities enabling interaction with the environment and the applications accessing the storage, thereby reinforcing data availability and accessibility.

Keywords: EO, IMGEOS, NLSAS, SAN, SSD, User Meta Data, Data Archival