An efficient divide-and-conquer approach for big data analytics in machine-to-machine communication

作者: Awais Ahmad , Anand Paul , M. Mazhar Rathore

DOI: 10.1016/J.NEUCOM.2015.04.109

关键词:

摘要: Machine-to-Machine (M2M) communication relies on the physical objects (e.g., satellites, sensors, and so forth) interconnected with each other, creating mesh of machines producing massive volume data about large geographical area living non-living environment). Thus, M2M is an ideal example Big Data. On contrary, platforms that handle Data might perform poorly or not according to goals their operator (in term cost, database utilization, quality, processing computational efficiency, analysis feature extraction applications). Therefore, address aforementioned needs, we propose a new effective, memory efficient system architecture for in M2M, which, unlike other previous proposals, does require whole set be processed (including raw sets), kept main memory. Our designed exploits divide-and-conquer approach block-wise vertical representation follows particular petitionary strategy, which formalizes problem applications. The goes from servers, where first transformed into several blocks can quickly processed, then it classifies reorganizes these same source. In addition, are aggregated sequential manner based machine ID, equally partitions using fusion algorithm. Finally, results stored server helps users making decision. feasibility efficiency proposed implemented Hadoop single node setup UBUNTU 14.04 LTS core?i5 3.2GHz processor 4GB show efficiently extract various features (such as River) satellite data.

参考文章(33)
Gelernter, Luoming, Cao, Qiao, Dong, Judith, Meng, Xiaofeng, Li, Xiuquan, Mining Data Correlation from Multi-Faceted Sensor Data in Internet of Things 中国通信. ,vol. 8, pp. 132- 138 ,(2011)
Samuel Marchal, Xiuyan Jiang, Radu State, Thomas Engel, A Big Data Architecture for Large Scale Security Monitoring international congress on big data. pp. 56- 63 ,(2014) , 10.1109/BIGDATA.CONGRESS.2014.18
Shibo He, Jiming Chen, David K. Y. Yau, Youxian Sun, Cross-Layer Optimization of Correlated Data Gathering in Wireless Sensor Networks sensor mesh and ad hoc communications and networks. pp. 1- 9 ,(2010) , 10.1109/SECON.2010.5508271
P.E. Ross, Managing care through the air [remote health monitoring] IEEE Spectrum. ,vol. 41, pp. 26- 28 ,(2004) , 10.1109/MSPEC.2004.1363637
Lakshmish Ramaswamy, Victor Lawson, Siva Venkat Gogineni, Towards a Quality-centric Big Data Architecture for Federated Sensor Services international congress on big data. pp. 86- 93 ,(2013) , 10.1109/BIGDATA.CONGRESS.2013.21
Cyril Cecchinel, Matthieu Jimenez, Sebastien Mosser, Michel Riveill, An Architecture to Support the Collection of Big Data in the Internet of Things world congress on services. pp. 442- 449 ,(2014) , 10.1109/SERVICES.2014.83
W. Nor Haizan W. Mohamed, Mohd Najib Mohd Salleh, Abdul Halim Omar, A comparative study of Reduced Error Pruning method in decision tree algorithms ieee international conference on control system, computing and engineering. pp. 392- 397 ,(2012) , 10.1109/ICCSCE.2012.6487177
Jin Zhou, Liang Hu, Feng Wang, Huimin Lu, Kuo Zhao, An efficient multidimensional fusion algorithm for IoT data based on partitioning Tsinghua Science & Technology. ,vol. 18, pp. 369- 378 ,(2013) , 10.1109/TST.2013.6574675
Ninh Pham, Rasmus Pagh, A near-linear time approximation algorithm for angle-based outlier detection in high-dimensional data Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '12. pp. 877- 885 ,(2012) , 10.1145/2339530.2339669
Tzu-Chuan Juan, Shih-En Wei, Hung-Yun Hsieh, Data-centric clustering for data gathering in machine-to-machine wireless networks 2013 IEEE International Conference on Communications Workshops (ICC). pp. 89- 94 ,(2013) , 10.1109/ICCW.2013.6649207