Cloud-Based Evaluation Framework for Big Data

摘要: The VISCERAL project is building a cloud-based evaluation framework for evaluating machine learning and information retrieval algorithms on large amounts of data. Instead downloading data running evaluations locally, the will be centrally available cloud to evaluated programmed in computing instances cloud, effectively bringing This approach allows performed Terabytes without needing consider logistics moving or storing local infrastructure. After discussing challenges benchmarking big data, design system presented, concentrating components coordinating participants benchmark managing ground truth creation. first two benchmarks run segmentation 3D medical images.