Paper Overview
- Field: Machine Learning
- Authors: Peng Chen, Yihang Wang, Zhongwen Rao, Yang Shu, Yuying Qiu, Yuxuan Chen, Lujia Pan, Bin Yang, Chenjuan Guo
- Published: 2026-11-10
- arXiv: 2611.14491
- Multi-domain feature extractor: adaptively captures temporal dependencies and channel correlations for domain-specific data via progressive multi-scale modeling and adaptive slot-channel modeling.
- Multi-task collaborative training: unifies forecasting, anomaly detection, and classification during pre-training by exploiting task specificity and commonality through task customization and cross-task training.
- Generalization: state-of-the-art results in few-shot and zero-shot scenarios across multiple tasks and domains, with strong inference efficiency.
Abstract (Original)
Time series analytics has been widely applied across various domains. While existing time series foundation models (TSFMs) have demonstrated promising results, they still face two major challenges: 1) Most TSFMs mainly rely on stacking Transformer layers to increase parameter size, lacking the ability to adaptively model complex time series patterns from multi-domain data. 2) Current TSFMs are primarily pre-trained for specific tasks, e.g., forecasting or anomaly detection, and a few models support multiple tasks, but they fail to fully leverage task specificity and commonality, resulting in suboptimal performance. To address these challenges, we propose TimeSeek, a novel generalized time series analytics model that adaptively models time series patterns from multi-domain data and unifies multiple tasks during pre-training.
Conceptually, TimeSeek is guided by "selective information sharing under domain and task heterogeneity". On the multi-domain side, it introduces a multi-domain feature extractor that adaptively captures temporal dependencies and channel correlations based on domain-specific characteristics, including progressive multi-scale modeling and adaptive slot-channel modeling. On the task-diversity side, it employs multi-task collaborative training that leverages both task specificity and commonality via task customization and cross-task training, effectively unifying multiple tasks during pre-training.
After pre-training on large-scale time series data, TimeSeek achieves state-of-the-art performance in forecasting, anomaly detection, and classification tasks under both few-shot and zero-shot settings, with considerable inference efficiency.
Key Contributions
*Auto-collected on 2026-11-12*