Distributed Storage of Remote Sensing Data Based on Hadoop Platform

Distributed Storage of Remote Sensing Data Based on Hadoop Platform in Virtual Environment

Cheng Li1, Xicun Zhu1, 2*, Lulu Gao1, Huansan Zhao1, Yu Wei1, Gengxing Zhao1

1College of Resources and Environment, Shandong Agricultural University, Tai’an, Shandong
2National Engineering Laboratory on Efficient Utilization of Soil and Fertilization, Tai’an, Shandong

American Journal of Agricultural Research

A distributed remote sensing data storage system based on Hadoop platform is designed to solve the problem of low storage efficiency and low security of mass remote sensing data. Uesd virtualization technology to PC as hardware based virtual computing node the Hadoop Cluster required, without increasing the dedicated server clusters and does not change the original PC use conditions, built the Hadoop platform by the virtual machine cluster. Using LandSat-8 satellite image data as the experimental object, through the design of file tree structure, the remote sensing image data according to the band and split into several blocks of image coordinates, combined with the Hadoop distributed file system (HDFS) characteristics of block storage data block, the remote sensing data stored in the distribution of the whole virtual computer cluster in. Build Hadoop platform remote sensing data distributed storage system with low cost.

Keywords:  Virtualization Hadoop HDFS Remote Sensing Data

Free Full-text PDF