Journal of East China Normal University(Natural Science) ›› 2023, Vol. 2023 ›› Issue (2): 119-131.doi: 10.3969/j.issn.1000-5641.2023.02.013

• Computer Science • Previous Articles    

Time series database query optimization for anomaly detection

Shuai ZHANG1, Huiqi HU1,*(), Yaoqiang XU2, Xuan ZHOU1   

  1. 1. School of Data Science and Engineering, East China Normal University, Shanghai 200062, China
    2. East China Branch of State Grid Corporation of China, Shanghai 200120, China
  • Received:2022-01-17 Online:2023-03-25 Published:2023-03-23
  • Contact: Huiqi HU E-mail:hqhu@dase.ecnu.edu.cn

Abstract:

With the development of the Internet of Things, a large number of sensor devices can be connected to a network. Anomaly detection of data generated by these devices is related to the stability of system services. A time series database is a database system optimized for time series data. As an important component of a monitoring system, time series databases are responsible for storing and querying continuous streams of time series data. The current time series database, however, cannot fully utilize system computing resources and cannot meet the latency requirements when coping with queries from multiple data sources. To address these drawbacks, we redesigned the query execution model of a time series database based on the well-known InfluxDB, and we proposed InfluxDB-PP (parallel processing) as a method to address the aforementioned problems. The experimental results show that InfluxDB-PP reduces query latency by about 85.7% compared to InfluxDB for real-time anomaly data query scenarios.

Key words: monitoring system, time series database, multi-source data query optimization

CLC Number: