%0 Report %D 2013 %T Basic Network Data Analysis %A Pietro Michiardi %A Antonio Barbuzzi %A Alessandro Finamore %A Stefano Traverso %A Daniele Apiletti %A Elena Baralis %A Tania Cerquitelli %A Silvia Chiusano %A Luigi Grimaudo %A A. Rufini %A Francesco Matera %A A. Valentii %A Maurizio Dusi %A Mohamed Ahmed %A Tivadar Szemethy %A L. Németh %A R. Szalay %A Ilias Leontiadis %A Yan Grunenberger %A P. Casas %A Alessandro D’Alconzo %A A Bär %A D Rossi %A YiXi Gong %K algorithms %K big data %K storage %X
This document describes the requirements, input, output for the algorithms needed to perform analytic tasks on a large amount of data, in the context of WP3. Starting from the use cases defined in WP1, we identify the algorithms needed to address the various scenario requirements. Operating on a large amount of data, these algorithms strive for parallel and scalable approaches; the designing and implementation of the algorithm itself can be a challenging research task since today very little is known concerning how to develop efficient and scalable algorithms that runs on parallel processing frameworks.
The algorithm in the storage layer are characterized by the fact that they operate on a large amount of data, and produce a concise representation of it, extracting features and aggregating it, so that the produced output is easier to handle and understand. Depending on the amount of data produced, on the scenario characteristics and on the time constraints, algorithms can require a real time (or near real time) or a batch processing.
For each algorithm and use case, the input data and the initial state, the computation to run and the output produced are described.
The document defines the requirements for the mPlane architecture on the background of a set of scenarios explored by the consortium, a survey of existing comparable measurement systems and platforms and applicable standards therefore, and a set of architectural first principles drawn from the description of work and the consortium's experience. As mPlane is intended to be a fully flexible measurement platform, freely integrating existing probes and repositories with ones to be developed in the project, this document is primarily concerned with the definition of interfaces among mPlane components. While it does enumerate capabilities to be provided by these components, these are primarily intended to ensure the platform has the flexibility required to meet all the scenarios envisioned; the enumerations of measurements, metrics, data types, and other component capabilities are therefore not to be construed to limit the scope of work on components within the project to just those scenarios treated in this document; nor do the scenarios enumerated here define the capabilities to be demonstrated in the project's integrated trial.
%I mPlane Consortium %C Torino %8 01/2013 %G eng %9 Public Deliverable