Scalable inference of decision tree ensembles: Flexible design for CPU-FPGA platforms

作者: Muhsen Owaida , Hantian Zhang , Ce Zhang , Gustavo Alonso

DOI: 10.23919/FPL.2017.8056784

关键词: Decision treeK-D-B-treeParallel computingSpeedupFractal tree indexIncremental decision treeScalabilityComputer scienceCentral processing unitID3 algorithm

摘要: Decision tree ensembles are commonly used in a wide range of applications and becoming the de facto algorithm for decision based classifiers. Different trees an ensemble can be processed parallel during inference, making them suitable use case FPGAs. Large ensembles, however, require careful mapping to on-chip memory management accesses. As result, existing FPGA solutions suffer from inability scale beyond tens lack flexibility support different ensembles. In this paper we present classifier together with software driver efficiently manage FPGA's resources. The architecture utilizes resources fit half million nodes memory, delivering up 20× speedup over 10-threaded CPU implementation when fully processing on FPGA. It also combine that do not achieving order magnitude compared pure implementation. addition, programmed at runtime process varying sizes.

参考文章(19)
Flora Amato, Mario Barbareschi, Valentina Casola, Antonino Mazzeo, An FPGA-Based Smart Classifier for Decision Support Systems Studies in Computational Intelligence. pp. 289- 299 ,(2014) , 10.1007/978-3-319-01571-2_34
Mario Barbareschi, Salvatore Del Prete, Francesco Gargiulo, Antonino Mazzeo, Carlo Sansone, Decision Tree-Based Multiple Classifier Systems: An FPGA Perspective multiple classifier systems. pp. 194- 205 ,(2015) , 10.1007/978-3-319-20248-8_17
Rafał Kułaga, Marek Gorgoń, FPGA Implementation of Decision Trees and Tree Ensembles for Character Recognition in Vivado Hls Image Processing and Communications. ,vol. 19, pp. 71- 82 ,(2014) , 10.1515/IPC-2015-0012
Thomas G. Dietterich, Ensemble Methods in Machine Learning Multiple Classifier Systems. pp. 1- 15 ,(2000) , 10.1007/3-540-45014-9_1
Neal Oliver, Rahul R. Sharma, Stephen Chang, Bhushan Chitlur, Elkin Garcia, Joseph Grecco, Aaron Grier, Nelson Ijih, Yaping Liu, Pratik Marolia, Henry Mitchel, Suchit Subhaschandra, Arthur Sheiman, Tim Whisonant, Prabhat Gupta, A Reconfigurable Computing System Based on a Cache-Coherent Fabric 2011 International Conference on Reconfigurable Computing and FPGAs. pp. 80- 85 ,(2011) , 10.1109/RECONFIG.2011.4
Roel Aaij, B Adeva, M Adinolfi, A Affolder, Z Ajaltouni, S Akar, J Albrecht, F Alessio, M Alexander, S Ali, G Alkhazov, P Alvarez Cartelle, AA Alves, S Amato, S Amerio, Y Amhis, L An, L Anderlini, J Anderson, R Andreassen, M Andreotti, JE Andrews, RB Appleby, O Aquines Gutierrez, F Archilli, A Artamonov, M Artuso, E Aslanides, G Auriemma, M Baalouch, S Bachmann, JJ Back, A Badalov, C Baesso, W Baldini, RJ Barlow, C Barschel, S. Barsuk, W Barter, V Batozskaya, V Battista, A Bay, L Beaucourt, J Beddow, F Bedeschi, I Bediaga, S Belogurov, K Belous, I Belyaev, E Ben-Haim, G Bencivenni, S Benson, J Benton, A Berezhnoy, R Bernet, M-O Bettler, M van Beuzekom, A Bien, S Bifani, T Bird, A Bizzeti, PM Bjørnstad, T Blake, F Blanc, J Blouw, S Blusk, V Bocci, A Bondar, N Bondar, W Bonivento, S Borghi, A Borgia, M Borsato, TJV Bowcock, E Bowen, C Bozzi, T Brambach, D Brett, M Britsch, T Britton, J Brodzicka, NH Brook, H Brown, A Bursche, J Buytaert, S Cadeddu, Roberto Calabrese, M Calvi, M Calvo Gomez, P Campana, D Campora Perez, Angelo Carbone, G Carboni, R Cardinale, A Cardini, L Carson, K Carvalho Akiba, G Casse, L Cassina, L Castillo Garcia, M Cattaneo, Ch Cauet, R Cenci, M Charles, Ph Charpentier, M Chefdeville, S Chen, S-F Cheung, N Chiapolini, M Chrzaszcz, X Cid Vidal, G Ciezarek, PEL Clarke, M Clemencic, HV Cliff, J Closier, V Coco, J Cogan, E Cogneras, V Cogoni, L Cojocariu, G Collazuol, P Collins, A Comerma-Montells, A Contu, A Cook, M Coombes, S Coquereau, G Corti, M Corvo, I Counts, B Couturier, GA Cowan, DC Craik, M Cruz Torres, S Cunliffe, R Currie, C D’Ambrosio, J Dalseno, P David, PNY David, A Davis, K De Bruyn, S De Capua, M De Cian, JM De Miranda, L De Paula, W De Silva, P De Simone, C-T Dean, None, Search for the lepton flavour violating decay τ$^{−}$ → μ$^{−}$ μ$^{+}$ μ$^{−}$ Journal of High Energy Physics. ,vol. 2015, pp. 1- 20 ,(2015) , 10.1007/JHEP02(2015)121
R. Struharik, Decision tree ensemble hardware accelerators for embedded applications 2015 IEEE 13th International Symposium on Intelligent Systems and Informatics (SISY). pp. 101- 106 ,(2015) , 10.1109/SISY.2015.7325359
Jason Oberg, Ken Eguro, Ray Bittner, Alessandro Forin, Random decision tree body part recognition using FPGAs field programmable logic and applications. pp. 330- 337 ,(2012) , 10.1109/FPL.2012.6339226
Yun R. Qu, Viktor K. Prasanna, Scalable and dynamically updatable lookup engine for decision-trees on FPGA ieee high performance extreme computing conference. pp. 1- 6 ,(2014) , 10.1109/HPEC.2014.7040952
Fareena Saqib, Aindrik Dutta, Jim Plusquellic, Philip Ortiz, Marios S. Pattichis, Pipelined Decision Tree Classification Accelerator Implementation in FPGA (DT-CAIF) IEEE Transactions on Computers. ,vol. 64, pp. 280- 285 ,(2015) , 10.1109/TC.2013.204