At Safe Intelligence, we’ve been exploring how to make neural networks more reliable for real-world applications by using formal robustness guarantees. I recently published a paper along with my supervisor Alessio Lomuscio on making neural networks more reliable for asset allocation. We use verification methods to train the networks to make more consistent investment decisions with robustness guarantees, reducing risk in noisy markets.
While neural networks have been shown to perform well in time series tasks, they remain highly sensitive to small changes in the input data. In our context, where the input to the networks is noisy financial data, this sensitivity can lead to unexpected and potentially costly allocation decisions when the model is deployed. Our work addresses this challenge head-on by quantifying and improving the robustness of the models.
The Challenge with Neural Networks in Finance
While neural networks can uncover complex patterns in market data, they have a concerning weakness: small changes in their input data can sometimes cause them to make drastically different decisions. Imagine a neural network managing your investment portfolio. It might perform beautifully during testing, but when deployed with real money, slight market fluctuations or data noise could trigger unexpected and potentially costly investment decisions.
Our Solution: Verification and Certified Training
We’ve developed two key innovations to address this problem:
A verification framework that can determine whether a neural network might make erratic allocation decisions (what we call “allocation spikes”) when faced with small variations in market data.
A specialised training method that makes these networks more robust, helping them maintain stable decision-making even in the presence of noisy data.
What We Found
Our research revealed some striking insights:
Why This Matters
For anyone considering using AI in investment management, our work offers a practical way to:
This research represents a step toward making neural networks more trustworthy for high-stakes financial decisions. While neural networks offer powerful capabilities for investment management, they need to be both performant and reliable. Our approach helps achieve both goals.