Neural Network-Based Estimation of Time-Dependent Parameters in AR(p) Processes

Neural Network-Based Estimation of Time-Dependent Parameters in AR(p) Processes

🎙 Agnieszka Kopeć and Martyna Wiącek 👥 4K 📅 July 31, 2026 ⏱ 57 min 👁 229 📄 original study 🧭 2026-08-15
Available in: English (current) Français

Keywords

neural networkAR(p)time-varying parameterslikelihoodprediction intervals

Summary

This seminar presents a likelihood-based framework for estimating time-varying parameters in autoregressive (AR) models using feedforward neural networks. The approach retains the classical AR(p) structure but models the intercept, autoregressive coefficients, and innovation scale as functions of time, represented by a neural network. The network is trained by minimizing the negative log-likelihood, with Gaussian and Laplace innovation distributions considered. For the TVAR(1) case, recursive point forecasts and prediction intervals are derived, with closed-form intervals under Gaussian innovations and tractable constructions under Laplace innovations. Experiments on synthetic data demonstrate the method’s ability to recover time-varying coefficients, while an application to electricity spot prices illustrates its interpretability and forecasting performance. The framework combines neural network flexibility with the transparency of stochastic time-series modeling, offering an interpretable alternative to black-box forecasting approaches.

129 words

Critical Evaluation

Value of the Information & Strength of the Argument

The presentation provides a clear and well-structured argument for the proposed method. The motivation is compelling: classical AR models assume constant parameters, which is unrealistic for many real-world time series, while pure neural network approaches lack interpretability. The hybrid approach addresses this gap. The mathematical derivations are rigorous, with explicit loss functions for Gaussian and Laplace innovations. The forecasting methodology is thoroughly explained, including the derivation of prediction intervals. The synthetic experiments validate the method’s ability to recover known parameters, and the real-data application to electricity prices demonstrates practical utility. The argumentation is solid, though the presentation could benefit from a more detailed discussion of limitations and comparisons with alternative methods.

Scientific Rigor, Source Quality, Title Accuracy

The presentation is scientifically rigorous, with clear mathematical formulations and reproducible experiments. The speakers cite their own previous work and provide links to the arXiv paper and GitHub repository, enhancing transparency. The title accurately reflects the content. The presentation does not include external sources or references to prior literature, which limits the contextualization of the work. The adequacy between title and content is high, as the talk precisely covers the estimation of time-dependent parameters in AR(p) processes using neural networks.

206 words

Title / Content Match

The title accurately reflects the content, which focuses on estimating time-dependent parameters in AR(p) processes using neural networks.

Quality & Reliability

8/10

The presentation is a detailed account of original research, with clear methodology, mathematical derivations, and experimental results. The speakers are PhD students with relevant expertise. The work is available on arXiv and code on GitHub, enhancing transparency. However, the study is not yet peer-reviewed, and the presentation lacks external validation or discussion of limitations.

Key Moments

Cited Sources

  • arXiv paper — The paper presenting the full methodology and results.
  • GitHub repository — Code and experiments for reproducibility.

Concurring Sources

  • arXiv paper — The paper itself, which provides the full methodology and results.

Contribution & Novelties

The main contribution is a hybrid framework that combines the interpretability of classical AR models with the flexibility of neural networks, allowing time-varying parameters to be estimated via likelihood-based training. This offers an interpretable alternative to black-box forecasting. The derivation of prediction intervals for both Gaussian and Laplace innovations is a novel aspect.

Pour aller plus loin :

90 words

Radar Profile

The radar profile shows high scores in information quantity, quality, and technical level, indicating a dense and rigorous presentation. The slightly lower reliability score reflects the lack of peer review and limited external validation.

Reliability 7/10