Big data development platform for engineering applications
作者： Chien-Heng Wu , Franco Lin , Wen-Yi Chang , Whey-Fone Tsai , Hsi-Ching Lin
DOI: 10.1109/BIGDATA.2016.7840914
关键词:
摘要: The present study utilizes VirtualBox virtual environment technology to develop the Personal, small size, Big Data platform that can effectively replicate a VM Hadoop system and provides an for developers easily design implement Map/Reduce programming. This also performs benchmark by using Hadoop, small-cluster NCHC's large-scale cluster, Braavos. results show is ideal code development testing purpose, Braavos cluster most appropriate production runs. Moreover, based on standard WordCount example, computing time of 232 times faster than Hadoop. In addition, engineering image recognition flow monitoring, given illustrate way big data analytics in system. Finally, term platform, ready users download. first author this paper would like give demonstration proposed as well application.
sci-hub.se 参考文章(4)
M. Muste, I. Fujita, A. Hauet, Large‐scale particle image velocimetry for measurements in riverine environments Water Resources Research. ,vol. 44, ,(2008) , 10.1029/2008WR006950
Franco Lin, Wen-Yi Chang, Lung-Cheng Lee, Hung-Ta Hsiao, Whey-Fone Tsai, Jihn-Sung Lai, Applications of Image Recognition for Real-Time Water Level and Surface Velocity international symposium on multimedia. pp. 259- 262 ,(2013) , 10.1109/ISM.2013.49
M. Muste, H.-C. Ho, D. Kim, Considerations on direct stream flow measurements using video imagery: Outlook and research needs Journal of Hydro-environment Research. ,vol. 5, pp. 289- 300 ,(2011) , 10.1016/J.JHER.2010.11.002
Muthu Dayalan, , MapReduce: simplified data processing on large clusters operating systems design and implementation. ,vol. 5, pp. 10- 10 ,(2004) , 10.21276/IJRE.2018.5.5.4