Newswise — Ikoma, Japan – Scientists from the Nara Institute of Science and Technology (NAIST), Advanced Telecommunications Research Institute international, and Tamagawa University have demonstrated that obsessive-compulsive disorder (OCD) can be understood as a result of imbalanced learning between reinforcement and punishment. On the basis of empirical tests of their theoretical model, they showed that asymmetries in brain calculations that link current results to past actions can lead to disordered behavior. Specifically, this can happen when the memory trace signal for past actions decays differently for good and bad outcomes. In this case, “good” means the result was better than expected, and “bad” means that it was worse than expected. This work helps to explain how OCD develops.
OCD is a mental illness involving anxiety, characterized by intrusive and repetitious thoughts, called obsessions, coupled with certain repeated actions, known as compulsions. Patients with OCD often feel unable to change behavior even when they know that the obsessions or compulsions are not reasonable. In severe cases, these may render the person incapable of leading a normal life. Compulsive behaviors, such as washing hands excessively or repeatedly checking whether doors are locked before leaving the house, are attempts to temporarily relieve anxiety caused by obsessions. However, hitherto, the means by which the cycle of obsessions and compulsions becomes strengthened was not well understood.
Now, a team led by researchers at NAIST has used reinforcement learning theory to model the disordered cycle associated with OCD. In this framework, an outcome that is better than predicted becomes more likely (positive prediction error), while a result that is worse than expected is suppressed (negative prediction error). In implementation of reinforcement learning, it is also important to consider delays, as well as positive/negative prediction errors. In general, the outcome of a certain choice is available after a certain delay. Therefore, reinforcement and punishment should be assigned to recent choices within a certain time frame. This is called credit assignment, which is implemented as a memory trace in reinforcement learning theory. Ideally, memory trace signals for past actions decay at equal speed for both positive and negative prediction errors. However, this cannot be completely realized in discrete neural systems. Using simulations, NAIST scientists found that agents implicitly learn obsessive-compulsive behavior when the trace decay factor for memory traces of past actions related to negative prediction errors (
RSS