This project investigates how abstract Fourier expansions involving rational function systems can model linear time-invariant dynamical systems and generalize these results to kernel expansions to develop novel modeling schemes for machine learning methods and nonlinear maps. We thereby develop mathematically justified, data-driven approximation algorithms applicable across a diverse range of disciplines.
This project develops new mathematical tools to understand and model complex systems, from engineering to machine learning. Many real-world systems—like electrical circuits or mechanical devices—can be described using equations that link their inputs to their outputs. Often, we do not know the exact rules governing a system, so instead we try to learn a model directly from measured data. This project proposes new ways to break down these system descriptions into simpler building blocks, using tools from harmonic analysis, making the resulting models more robust and reliable, even when the system's complexity is unknown in advance.
Beyond these classical dynamical systems, the project extends similar ideas to modeling general nonlinear relationships in data, which is central to many machine learning methods. We show how these harmonic analysis techniques, originally developed for describing dynamical systems, can be adapted to build more efficient machine learning models, particularly ones based on "kernel methods," which currently struggle with large datasets due to high computational costs. Our approach makes these techniques more scalable and practical for real-world use.
Another goal is to simplify complex models without sacrificing accuracy, a process known as model order reduction. We propose new methods to shrink complicated system descriptions into much simpler ones while preserving important properties like stability. These methods are also applicable to more general nonlinear models, including neural networks and complex physical processes.
Finally, we address a major challenge in modern artificial intelligence: many powerful machine learning models, such as deep neural networks, act as unpredictable "black boxes," making them unsuitable for safety-critical use. To address this, we design new types of neural network components that are both efficient and more interpretable, giving insight into how the model makes decisions.