A Massive Data Retrieval Method for Power Information Collection Systems

摘要: With the development of smart grid and big data, massive data retrieval has received intensive attentions by practitioners and developers, especially for its using in power information collection applications. It is a tricky task for improving the retrieval efficiency of massive data. The main big data solutions are likely to store the data in Hbase, which is difficult to improve the performance when querying small data from a large volume of data. Existing methods for this problem are inclined to use phoenix to query Hbase, but they exhibit inefficient under multiple table joining. In this paper, to sovle the quick retrieval for massive data in power information collection systems, we present a method via using Elasticsearch and Hbase to augment the performance of massive data retrieval. Specifically, we store the Rowkey and index information in elasticsearch to help accelerate the querying of Hbase. Then an experiment in real …