Feature Selection in Jump Models
Abstract:
Jump models switch infrequently between states to fit a sequence of data while taking the ordering of the data into account. In this talk, we propose a new framework for joint feature selection, parameter and state-sequence estimation in jump models. Feature selection is necessary in high-dimensional settings where the number of features is large compared to the number of observations and the underlying states differ only with respect to a subset of the features. We develop and implement a coordinate descent algorithm that alternates between selecting the features and estimating the model parameters and state sequence, which scales to large data sets with large numbers of (noisy) features. We demonstrate the usefulness of the proposed framework by comparing it with a number of other methods on both simulated and real data in the form of financial returns, protein sequences, and text. The resulting sparse jump model outperforms all other methods considered and is remarkably robust to noise.
This is joint work with Erik Lindstrom and Peter Nystrup.
Available online:
• Full article
• Python implementation of the sparse jump model and computation examples
Bio – Petter Kolm:
Petter Kolm
Clinical Full Professor and Director of the M.S. in Mathematics in Finance Program, Courant Institute of Mathematical Sciences, New York University
Partner, CorePoint-Partners.com
Petter is the Director of the Mathematics in Finance Master’s program and a Clinical Professor of Mathematics at the Courant Institute of Mathematical Sciences, New York University. In this role he interacts with major financial institutions such as investment banks, financial service providers, insurance companies and hedge funds. Petter worked in the Quantitative Strategies group at Goldman Sachs Asset Management developing proprietary investment strategies, portfolio and risk analytics in equities, fixed income and commodities.
Petter was awarded “Quant of the Year” in 2021 by Portfolio Management Research (PMR) and Journal of Portfolio Management (JPM) for his contributions to the field of quantitative portfolio theory. Petter is a frequent speaker, panelist and moderator at academic and industry conferences and events. He is a member of the editorial boards of the International Journal of Portfolio Analysis and Management (IJPAM), Journal of Financial Data Science (JFDS), Journal of Investment Strategies (JoIS), and Journal of Portfolio Management (JPM). Petter is an Advisory Board Member of Alternative Data Group (ADG), AISignals and Operations in Trading (Aisot), Betterment (one of the largest robo-advisors) and Volatility and Risk Institute at NYU Stern. He is also on the Board of Directors of the International Association for Quantitative Finance (IAQF) and Scientific Advisory Board Member of the Artificial Intelligence Finance Institute (AIFI).
Petter is the co-author of several well-known finance books including, Financial Modeling of the Equity Market: From CAPM to Cointegration (Wiley, 2006); Trends in Quantitative Finance (CFA Research Institute, 2006); Robust Portfolio Management and Optimization (Wiley, 2007); and Quantitative Equity Investing: Techniques and Strategies (Wiley, 2010). Financial Modeling of the Equity Markets was among the “Top 10 Technical Books” selected by Financial Engineering News in 2006.
As a consultant and expert witness, Petter has provided his services in areas including alternative data, data science, econometrics, forecasting models, high frequency trading, machine learning, portfolio optimization with transaction costs, quantitative and systematic trading, risk management, robo-advisory, smart beta strategies, trading strategies, transaction costs, and tax-aware investing.
He holds a Ph.D. in Mathematics from Yale University; an M.Phil. in Applied Mathematics from the Royal Institute of Technology, Stockholm, Sweden; and an M.S. in Mathematics from ETH Zurich, Switzerland.