Predictive Intelligence in Analytics Aggregation of Partial Ordered Subsets
研究了在分布式数据分区中，查询控制器如何通过聚合偏序子集并应用预测智能，高效返回有序查询结果，对大数据分析和流处理应用有参考价值。
Nowadays, the increased amount of users' devices produce huge volumes of data that should be efficiently managed by modern applications. Streams are adopted to deliver data that, usually, are stored into a number of partitions. Splitting the data offers a lot of advantages as applications can process them in parallel, thus, they increase the speed of processing. Progressive analytics are also adopted to deliver partial responses, during processing, thus, saving time in the execution of applications. Data exploration and analytics queries are very significant for future applications. Usually, such queries demand for an ordered set of objects as a response and require intelligent predictive schemes to deliver the responses on top of the partial results retrieved by the distributed data partitions. A finite set of query processors are adopted to produce these partial results. Processors are placed in front of each partition and report progressive analytics to a central entity. In this paper, we envision the query controller (QC) as the central entity that collects progressive analytics and return the final response to users/applications. The QC receives partial ordered sets of objects and aggregates them to derive the final outcome. We focus on a QC that applies time-optimized techniques and aggregation operators to deliver every response, i.e., ordered sets, over streams of partial ordered subsets. We perform a comprehensive performance assessment with synthetic data and report on the performance of the QC. Our experimental evaluation reveals the pros and cons of the proposed model and a comparison assessment places this paper in the respective literature.