ReCTSi: Resource-efficient Correlated Time Series Imputation via Decoupled Pattern Learning and Completeness-aware Attentions

Zhichen Lai, Dalin Zhang*, Huan Li*, Dongxiang Zhang, Hua Lu, Christian S. Jensen

*Corresponding author

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningpeer review

Abstract

Imputation of Correlated Time Series (CTS) is essential in data preprocessing for many tasks, particularly when sensor data is often incomplete. Deep learning has enabled sophisticated models that improve CTS imputation by capturing temporal and spatial patterns. However, deep models often incur considerable consumption of computational resources and thus cannot be deployed in resource-limited settings. This paper presents ReCTSi (Resource-efficient CTS imputation), a method that adopts a new architecture for decoupled pattern learning in two phases: (1) the Persistent Pattern Extraction phase utilizes a multi-view learnable codebook mechanism to identify and archive persistent patterns common across different time series, enabling rapid pattern retrieval during inference. (2) the Transient Pattern Adaptation phase introduces completeness-aware attention modules that allocate attention to the complete and hence more reliable data segments. Extensive experimental results show that ReCTSi achieves state-of-the-art imputation accuracy while consuming much fewer computational resources than the leading existing model, consuming only 0.004% of the FLOPs for inference compared to its closest competitor. The blend of high accuracy and very low resource consumption makes ReCTSi the currently best method for resource-limited scenarios. The related code is available at https://github.com/ryanlaics/RECTSI.
OriginalsprogEngelsk
TitelKDD 2024 - Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
Antal sider10
ForlagAssociation for Computing Machinery
Publikationsdato25 aug. 2024
Sider1474-1483
ISBN (Elektronisk)9798400704901
DOI
StatusUdgivet - 25 aug. 2024
Begivenhed30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2024 - Barcelona, Spanien
Varighed: 25 aug. 202429 aug. 2024

Konference

Konference30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2024
Land/OmrådeSpanien
ByBarcelona
Periode25/08/202429/08/2024
SponsorACM Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD), ACM Special Interest Group on Management of Data (SIGMOD)
NavnProceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
ISSN2154-817X

Citer dette