SQLS:A Storm-Based Query Language System for Real-Time Stream Data Analysis

作     者：JI Yimu ZHANG Dianchao SUN Yanfei ZHAO Chuanxin HE Jing WANG Ruchuan CHEN Guoliang 

作者机构：Computer of ScienceNanjing University of Posts and Telecommunications Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks Key Laboratory of Computer Network and Information IntegrationSoutheast University Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of EducationNanjing University of Science and Technology Computer of TelecommunicationsNanjing University of Posts and Telecommunications Department of ComputerAnhui Normal University Engineering and ScienceVictoria University 

出 版 物：《Chinese Journal of Electronics》 (电子学报(英文))

年 卷 期：2016年第25卷第6期

页      面：1025-1033页

核心收录：

学科分类：12[管理学] 1201[管理学-管理科学与工程(可授管理学、工学学位)] 

基　　金：supported by ZTE Foundation(No.2014W58) the National Natural Foundation(No.61170065,No.61373017) Jiangsu Natural Science of Young Foundation(No.BK20130876) 

主　　题：Continuous query Ad hoc query Storm CQL Real-time query processing 

摘      要：In this work, a Storm-based query language System(SQLS) is proposed for real-time data stream analysis. The system is compatible with Continuous query language(CQL) specification. It supports both continuous queries and one-time queries over streaming data, and meets the requirements of user experience(traditional SQL queries) and Qo S(such as real-time and throughput). In order to better meet the requirement of throughput and enhance the processing efficiency, the load shedding algorithm and cache optimization are employed during the implementation of SQL-like operators. Finally, performance testing of the proposed SQLS has been conducted on standalone Storm platform and Storm clusters. Experimental results show that our system can not only meet the needs of users, but also extend the function of real-time streaming queries processing.