HBase Application and Investigation

Project Details

Project Lead
Judy Qiu 
Project Manager
Xiaoming Gao 
Project Members
Xiaoming Gao, Evan Roth, Pavan Venkatramanachar, Rohit Khapare, Amey Jahagirdar  
Supporting Experts
 
Institution
Indiana University, School of Informatics and Computing  
Discipline
Computer Science (401) 
Subdiscipline
11.04 Information Sciences and Systems 

Abstract

HBase is the Hadoop implementation of the BigTable system presented by Google. It is designed to store and server a huge amount of data, which is organized in a non-relational data model, in a reliable and efficient manner. HBase has been released for a while but not much research work has been done in terms of applying it in scientific data storage or investigating its performance in supporting scientific computing. In this project, we will apply a distributed HBase deployment to store the metadata and data of a digital library system, and investigate its performance and related issues such as data locality, indexing, and load balance in supporting a search-oriented application as well as some data mining jobs.

Intellectual Merit

We will experiment the application of HBase in data intensive problems and use our experience to try to improve it. We will investigate indexing mechanisms for HBase type of storage solutions.

Broader Impacts

Provide insight to the indexing of non-relational databases.

Scale of Use

5 or 6 physical nodes.