HSE AI Research Centre Simplifies Particle Physics Experiments
Scientists at the HSE AI Research Centre have developed a novel approach to determining robustness in deep learning models. Their method works eight times faster than an exhaustive model search and significantly reduces the need for manual verification. It can be applied to particle physics problems using neural networks of various architectures. The study has been published in IEEE Access.
Machine learning (ML) and artificial intelligence (AI) are increasingly used in particle physics to make the analysis of experimental data easier and faster. Neural networks, for example, help process instrument signals and reconstruct missing information about particle properties. Since such predictions influence subsequent analysis, it is essential to understand how robust they are. However, in practice, model accuracy is often the only metric evaluated, and little attention is paid to how much the results may vary across different training instances. This issue is particularly pronounced for deep neural networks: their behaviour is hard to interpret, and repeated training can produce noticeably different outcomes. As a result, despite their potential advantages, many physicists remain wary of using neural networks.
Scientists at the HSE AI Centre have proposed a novel solution. They developed a method that automatically compares dozens of neural network variants and identifies the most reliable and stable ones. The idea is as follows: if a model is trained repeatedly on slightly modified data with different initial weights, the distribution of errors reveals how robust the model is to small changes in conditions. A robust model will produce nearly identical results across these tests.
The researchers tested their method on a task in which, based on an image formed by the cells of an electromagnetic calorimeter, one must determine the energy of a particle and the point at which it struck the detector. An electromagnetic calorimeter is a device made up of many cells that measure the amount of energy deposited in each cell when a particle passes through.
Fedor Ratnikov
'For the analysis, we generated half a million virtual signals simulating the detector’s operation and repeatedly fed them into different models, each time changing the training and test samples. We then used this method to identify the most reliable models and examine their properties. In doing so, we determined the minimum amount of training data required for a model to become robust—that is, to perform consistently across different training runs,' comments Fedor Ratnikov, Leading Research Fellow at the Laboratory of Methods for Big Data Analysis of the HSE AI and Digital Science Institute.
A key element of the approach is a special selection algorithm. For each model variant, the researchers collected a set of errors accumulated over dozens of independent runs and used this distribution to estimate how predictably the model behaves. This makes it possible to automatically filter out models that performed well only by chance and to identify those that remain stable under any reasonable changes in conditions.
Alexey Boldyrev
'We repeatedly trained all the models on half a million calorimeter simulation events, each time splitting the data into new training and test sets and initialising the weights randomly. This allowed us not only to measure how often each model made mistakes but also to track how its learning behaviour changed from one run to the next,’ comments Alexey Boldyrev, Research Fellow at the Laboratory of Methods for Big Data Analysis of the AI and Digital Science Institute.
The study also showed that models supplied not only with raw signals but also with simple, pre-known physical values require less data and reach stable results more quickly. The authors estimated the minimum amount of data needed for such models to maintain consistent performance across runs and identified two architectures that were reliably accurate and robust.
Andrey Shevelev
'The new method allows for much faster selection of robust AI models for certain particle physics problems—achieving results eight times more quickly than the traditional exhaustive search of all model variants,' comments Andrey Shevelev, Research Assistant at the Laboratory of Methods for Big Data Analysis of the AI and Digital Science Institute.
The researchers emphasise that the algorithm is fully automated and does not require manual tuning. As a result, it can serve as the foundation for self-learning systems that operate robustly, regardless of fluctuations in the training data or inherent model limitations.
See also:
Team Success: Aligning Means with Objectives
In corporations, sports, and academia, people often face challenges they cannot handle alone. In such cases, selecting the right team is crucial. Tatiana Mayskaya, Associate Professor at the HSE Faculty of Economic Sciences and the International College of Economics and Finance, together with colleagues from foreign universities, examined team characteristics and found that less diverse teams are better suited to objectives where a high average performance is important, whereas more diverse teams are preferable when avoiding failure is critical. The paper has been published in Economic Theory.
HSE MIEM Students to Develop Two Satellites from Scratch for Orbital Experiments
The devices, created by student teams, will conduct space research on the properties of promising solar cells, on-board energy storage systems, and serial electronics for student satellites.
Economists Propose More Effective Approach to Reducing Smoking
Economists at HSE University have examined how smokers respond to changes in cigarette prices. When tobacco prices increase, cigarette consumption does not always decline. In fact, spending on tobacco may even rise: according to the researchers, a 1% decrease in cigarette affordability leads to a 0.28% increase in per capita tobacco expenditure. The findings suggest that to reduce smoking rates, tobacco prices must rise faster than household incomes. The study has been published in Voprosy Statistiki.
Biologists Discover Unique Properties of MiR-93-5p MicroRNA in Prostate Cancer
Researchers at the International Laboratory of Microphysiological Systems of the HSE Faculty of Biology and Biotechnology investigated how different isoforms of the same microRNA influence gene function in prostate adenocarcinoma. The study found that in some cases, microRNAs can reinforce each other’s effects by targeting and suppressing the same genes. This finding offers a fresh perspective on the molecular mechanisms underlying tumour development and on the search for disease biomarkers. The results have been published in PeerJ.
HSE Researchers Provide the World’s First Legal Definition of a Digital Ecosystem
Digital ecosystems have evolved from a technological innovation into a fundamental institution of the modern economy over the past few years. According to HSE University’s latest estimates, they account for 8.5% of Russia’s GDP. Previously, no jurisdiction had a statutory definition of what constitutes a digital ecosystem. HSE University researchers have addressed this gap by proposing the first legal concept of a digital ecosystem. Their article, ‘The Digital Ecosystem as a Novel Economic Phenomenon and Legal Concept,’ has been published in the BRICS Law Journal.
HSE Economists Use Search Queries to Forecast Birth Rates
Researchers from the HSE Faculty of Economic Sciences have shown that the accuracy of birth rate forecasts for Russia can be improved by almost 50% by incorporating the dynamics of online search queries related to pregnancy and childbirth into forecasting models. In the best-performing models, the forecasting error fell from 4.6% to 3.2%. The findings have been published in Populations and Economics.
When Looking at Their Own Faces, Men Forget Everything
In an experiment involving 15 healthy men, scientists at HSE University investigated how different phases of the cardiac cycle influence the excitability of the motor cortex when participants viewed either their own photograph or the faces of strangers. The researchers found that when participants looked at their own image, the brain’s response to signals from the heart was weaker, meaning that the influence of cardiac activity on the motor cortex decreased. This finding came contrary to expectations, as self-focused attention was thought to enhance the brain's sensitivity to internal bodily signals. The study has been published in Frontiers in Signal Processing.
HSE Researchers Discover Who Eats Out in Russia—And Why
Around one-third of Russians (31.3%) rarely eat out or buy ready-made meals. The core group of active consumers—those who eat out or purchase prepared food almost every day or several times a week—accounts for only about 9% of the population. These are the findings of a study conducted by the HSE Institute for Social Policy. According to the researchers eating out is no longer a marker of high social status in Russia.
Scientists Model How Interactions Between Societies Can Trigger Chaotic Behaviour
Scientists at HSE MIEM have proposed a mathematical model explaining how interactions between societies can influence their stability. Based on the classical theory of evolutionary games, the study reveals an unexpected effect: even a weak informational influence of one society on another can cause one society to remain stable while the other exhibits chaotic behaviour among its individual members. The study has been published in the International Journal of Bifurcation and Chaos.
Ancient Craniiform Brachiopod: A Newly Discovered Species with a Unique Shell Shape and Lifestyle
Scientists from HSE University, MSU, and Tallinn University of Technology have studied a fossil species of ancient brachiopods that lived in a warm sea in what is now northern Estonia more than 445 million years ago. These ancient brachiopods developed a cup-shaped shell with a protective 'cap' that shielded them from overgrowth by other marine organisms. The study has been published in Palaeogeography, Palaeoclimatology, Palaeoecology.