Energy and memory: a new paradigm of neural networks

Publié le 15 May 2025 à 09h22
modifié le 15 May 2025 à 09h22

The interaction between memory and energy constitutes a fascinating area of research, redefining our understanding of neural networks. Recent advancements reveal how external signals influence the retrieval of memories, offering an innovative perspective on human cognitive functioning. The transition from the old Hopfield model to the IDP approach will mark a turning point in the design of artificial intelligence systems.

A Revolution in the Neural Network Model

Research on the mechanisms of memory has undergone a significant turning point with the proposal of the Input-Driven Plasticity (IDP) model. This model offers a new angle of analysis on the memory retrieval processes by questioning previous conceptions of the classic Hopfield network. Researchers at the University of Padua, under the direction of Francesco Bullo, highlight the shortcomings of the traditional model regarding the role of external information.

Progress in Memory Tracking Models

The classic Hopfield model, designed by John Hopfield in 1982, established a solid theoretical foundation for understanding how memories are stored and retrieved. This model, celebrated with a Nobel Prize in 2024, facilitated the design of one of the first recurrent neural networks. However, researchers like Bullo and his collaborators find that this model does not sufficiently explain how new information influences memory retrieval.

The Role of External Stimuli

In a recent publication in the journal Science Advances, researchers underscored an often overlooked aspect: the impact of external stimuli during memory processes. The association between sensory input and memory selection remains an area of exploration. Bullo asserts that the memory association system should enable recalling relevant information from partial sensory signals.

A New Approach to Memory Retrieval

The central idea of the IDP model relies on a dynamic mechanism that gradually adapts and integrates new information. Bullo illustrates this concept by comparing memory retrieval to exploring an energy landscape. The valleys of this landscape symbolize memories, and the recognition process is triggered when an individual “falls” into one of these valleys.

Adaptability to Noise

The IDP stands out for its ability to process noisy inputs. An ambiguous or partially masked stimulus becomes an asset that allows filtering out less stable memories in favor of the more robust ones. This dynamic allows for continuity in the experience of memory, in harmony with the attention processes observed in human perception.

Potential in Artificial Intelligence

Research does not overlook the profound implications of the IDP model for artificial intelligence systems. Modern architectures, such as language models, still lack the cognitive richness that human memory presents. Attention, the driver of data exploitation, is essential to optimize the performance of systems based on neural networks. Bullo identifies parallels between the IDP model and emerging artificial intelligence systems, highlighting synchronous potential for the future.

Consequences for Research and Industry

The advancements proposed by IDP are not limited to theory. They open considerable perspectives for the development of innovative technologies in AI. Cognitive laboratories, such as those inaugurated by Ericsson, are dedicated to advancing research in artificial intelligence. This reflects the growing interest of the industry in integrating neuroscientific concepts to improve the performance of intelligent systems.

The work of Betteti et al., who propose a new paradigm of neural networks by integrating the experiences of external signals, is promising. This approach could resonate throughout the artificial intelligence sector while reaffirming the importance of a robust theoretical framework for modeling human memory.

Frequently Asked Questions

What is the classic Hopfield model?
The classic Hopfield model is a type of recurrent neural network that allows for the retrieval of complete patterns from noisy or incomplete inputs, relying on a dynamic structure similar to that of human associative memories.

What is the difference between the classic Hopfield model and the Input-Driven Plasticity (IDP) model?
The IDP model introduces a dynamic integration of past and new information, allowing for a smoother and more adaptive memory retrieval process in response to external stimuli, unlike the more static approach of the classic model.

How does the IDP model improve memory retrieval?
The IDP model adapts the underlying energy landscape during the reading of stimuli, thus simplifying the memory structure and facilitating access to the most stable memories, even in the presence of noise.

Why are associative memories important for information processing?
Associative memories enable linking elements of information, facilitating navigation through the world, learning, and problem-solving by anchoring memories within a dynamic network of neurons.

How do the mechanics of neuronal receptors influence our perception of the world?
Neuronal receptors contribute to our experience of the world by interpreting external stimuli, directly influencing how we recall and use information by integrating new signals and past contexts.

What are the practical advantages of the IDP model in neural networks?
The IDP model is designed to be robust against noisy inputs, making it useful in the design of machine learning systems capable of handling imprecise data and filtering out unreliable memories.

What does minimal energy consist of in the context of neural networks?
Minimal energy represents stable memory states in an energy landscape, where each valley symbolizes a memory, facilitating memory retrieval through dynamic neural biases.

What role does attention play in memory processes according to recent models?
Attention affects the selection of stimuli to focus on, modulating the dynamics of the network and allowing for better access to relevant memories during retrieval.

How can modern models in LLM benefit from human memory concepts?
Modern language models, such as large language models (LLMs), could benefit from the integration of memory retrieval mechanisms inspired by human processes, thereby linking artificial intelligence to more natural memorization principles.

actu.iaNon classéEnergy and memory: a new paradigm of neural networks

microsoft claims that its new artificial intelligence tool in healthcare far surpasses doctors in diagnostic accuracy

découvrez comment microsoft révolutionne le secteur de la santé avec un nouvel outil d'intelligence artificielle capable de surpasser les médecins en précision de diagnostic. un aperçu des avancées technologiques qui transforment les soins médicaux.

An unexpected experience: AI leading a store for a month

découvrez comment une intelligence artificielle prend les rênes d'un magasin pendant un mois, offrant une expérience client inédite et révélant les défis et succès d'une gestion automatisée. plongez dans cette aventure captivante où technologie et commerce se rencontrent de manière surprenante.
découvrez comment meta attire les talents d'openai, intensifiant ainsi la compétition pour l'innovation en intelligence artificielle. une course passionnante vers l'avenir de la tech où les esprits brillants se rencontrent pour repousser les limites de l'ia.

The government unveils its initiative ‘dare to AI’ to bridge the French gap in artificial intelligence

découvrez l'initiative 'osez l'ia' du gouvernement français, visant à réduire le fossé en intelligence artificielle. cette stratégie ambitieuse vise à encourager l'innovation, à soutenir la recherche et à renforcer la position de la france sur la scène mondiale de l'ia.

The Rise of the Chatbot Arena: the new must-have guide to AI

découvrez comment la chatbot arena révolutionne le monde de l'intelligence artificielle. ce guide incontournable vous plonge dans l'univers des chatbots, leurs applications, et leurs impacts sur notre quotidien. ne manquez pas cette ressource essentielle pour comprendre l'avenir de la communication automatisée.

A study from MIT reveals that the use of ChatGPT significantly reduces brain activity.

découvrez comment une étude récente du mit montre que l'utilisation de chatgpt entraîne une réduction significative de l'activité cérébrale. plongez dans les implications de cette recherche sur notre interaction avec les intelligences artificielles et les conséquences sur notre cognition.