Data Augmentation Policy Search for Long-Term Forecasting

Liran Nochumsohn, and Omri Azencot. TMLR, 2025. Abstract Data augmentation serves as a popular regularization technique to combat overfitting challenges in neural networks. While automatic augmentation has demonstrated success in image classification tasks, its application to time-series problems, particularly in long-term forecasting, has received comparatively less attention. To address this gap, we introduce a time-series automatic augmentation approach named TSAA, which is both efficient and easy to implement. The solution involves tackling the associated bilevel optimization problem through a two-step process: initially training a non-augmented model for a limited number of epochs, followed by an iterative split procedure. During this…
Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributes

Nimrod Berman, Eitan Kosman,
Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learning

Ilya Kaufman and Omri Azencot. TMLR, 2024. Abstract Transformer models have consistently achieved remarkable results in various domains such as natural language processing and computer vision. However, despite ongoing research efforts to better understand these models, the field still lacks a comprehensive understanding. This is particularly true for deep time series forecasting methods, where analysis and understanding work is relatively limited. Time series data, unlike image and text information, can be more challenging to interpret and analyze. To address this, we approach the problem from a manifold learning perspective, assuming that the latent representations of time series forecasting models lie…