DOE News
    Doe Science news source
    The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
    • 2019-04-03 18:05:58
    • Article ID: 710752

    Berkeley Lab Team Uses Deep Learning to Help Veterans Administration Address Suicide Risks

    • Credit: Marilyn Chung/Berkeley Lab

      Computer scientists, mathematicians, and domain scientists from across Berkeley Lab are collaborating to turn burgeoning datasets into scientific insights through machine learning.

    Researchers in the Computational Research Division (CRD) at Lawrence Berkeley National Laboratory (Berkeley Lab) are applying deep learning and analytics to electronic health record (EHR) data to help the Veterans Administration (VA) address a host of medical and psychological challenges affecting many of the nation’s 700,000 military veterans. 

    The project is part of a collaboration between the U.S. Department of Energy (DOE) and the VA that combines the VA’s vast EHR system with DOE’s high performance computing, artificial intelligence, and data analytics resources. Through the Million Veteran Program-

    Computational Health Analytics for Medical Precision to Improve Outcomes Now (MVP-CHAMPION) partnership, announced in May 2017, the DOE and VA are working to apply supercomputing, networking, and software development resources at several national laboratories to medical data sets collected by the VA from some 700,000 veterans and EHR data from another 22 million veterans. The initial focus of this program is on suicide prevention, prostate cancer, and cardiovascular disease. 

    “The Energy Department is notably helping our veterans by using the world-class artificial intelligence and supercomputing capabilities at our National Labs to address suicide risks, traumatic brain injury, opioid addiction and a number of other critical areas,” said U.S. Secretary of Energy Rick Perry, “I am truly pleased that DOE is providing such strong support to President Trump’s “call to action” to “empower veterans and end the national tragedy of veteran suicide.” 

    Berkeley Lab’s Computing Sciences organization first became involved with the VA’s Million Veteran Program (MVP) Suicide Prevention Exemplar project in 2018 to help address an alarming statistic: Suicide is the 10th leading cause of death in the U.S., and it is significantly higher in the veteran population, with 20-22 deaths per day. The Berkeley Lab team’s goal is to improve identification of patients at risk for suicide through new patient-specific algorithms that can provide tailored and dynamic suicide risk scores — such as whether a person who has been in the hospital for a suicide attempt will attempt it again within 30 days — and make these resources available to VA caregivers and patients. 

    “The VA has been collecting medical records and genomic data from some 700,000 veterans, and they need help from DOE to interpret all of this information to improve healthcare for these individuals,” said Silvia Crivelli, a computational biologist in CRD who has been spearheading Berkeley Lab’s involvement in the suicide prevention project. 

    In 2018, five college students who spent their summer at the lab through the Computing Sciences (CS) summer internship program signed on to the project: Rafael Zamora-Resendiz (now a CS staff member), Shirley Wang, Shahzeb Khan, Cheng Ding, and Ryan Kingery, who is a U.S. veteran himself. For three months, working with Crivelli and Xinlian Liu — an associate professor of computer science at Hood College who also spent the summer at Berkeley Lab as part of the same program — the students developed algorithms to do statistical analysis of EHRs to look for key factors related to suicide risks and applying deep learning methods to these large and complex datasets. Working with a publicly available dataset (MIMIC-III) that contains medical record information on about 40,000 patients from one Boston hospital intensive care unit, they searched for patterns that might point to suicide risk. (Liu presented an overview of the group’s work at the recent SIAM-CCSE meeting, and their work was also featured in an article on the March 1, 2019 SIAM news blog.) 

    But EHR datasets are very noisy and contain both structured data (such as demographics, prescribed medications, lab work, and procedures) and unstructured data (such as handwritten doctors’ notes and discharge notes). As a result, some of the team’s early efforts focused primarily on finding patterns in this diverse and complex information; for example, Zamora-Resendiz initially focused on building a deep learning network that can distinguish and classify patients at high risk for suicide from discharge notes and physicians’ notes in these datasets. 

    “We first trained the neural network to classify between patients who are at high risk for suicide and those who are not to find patterns in the doctors’ language,” said Zamora-Resendiz. “We then applied some techniques on the trained network to find which words contributed most to the final prediction. The real challenge is figuring out a way of tracing how these words are combined internally within the network. This will help provide better insight on common motifs found between suicidal patients.” 

    Although the performance of these neural networks is impressive, they are hard to interpret. “We are aware that we need to gain the trust of the physicians, and that’s why are working on developing models that are interpretable,” said Crivelli. Incorporating the physician’s knowledge will improve the accuracy and defensibility of scientific deep learning models. Currently, interpretability is the focus of several efforts, including Berkeley Lab’s Machine Learning for Science strategic initiative, which is also tied to foundational work in learning described in the recent report, “Basic Research Needs Workshop for Scientific Machine Learning Core Technologies for Artificial Intelligence.” 

    Since last summer, the team has continued to work with the MIMIC dataset to fine-tune their understanding of how natural language processing can be used to sift through the structured and unstructured data collected in an EHR, and Liu is heading back to Berkeley Lab this summer with more students to focus again on this project. According to Crivelli, a few individuals are also about to gain approval to use the MVP dataset — which contains more data than the MIMIC dataset — to further extend this research, especially for suicide risk.

    “We believe that, for suicide prevention, the unstructured data will give us another side of the story that is extremely important for predicting risk — things like what the person is feeling, social isolation, homelessness, lack of sleep, pain, and incarceration,” she said. “This kind of data is more complicated and heterogeneous, and we plan to apply what we have learned about deep learning and natural language processing through our MIMIC III research to the MVP data to help VA doctors better decide who is at high risk and who they need to reach out to. They cannot do it alone because they do not have the tools we have at the DOE.” 

    Data-driven scientific discovery is poised to deliver breakthroughs across many disciplines, and the DOE, through its national laboratories, is well positioned to play a leadership role. Deep learning methods represent a promising approach for analytics in science for discovering subtle patterns in very complex scientific data of all kinds, although more work is needed gain to confidence in life-critical applications such as suicide prevention. The use of these methods for natural language processing are expected to have a significant impact on energy applications that involve human interaction, in addition to veterans’ healthcare. 

    ###

    Berkeley Lab addresses the world’s most urgent scientific challenges by advancing sustainable energy, protecting human health, creating new materials, and revealing the origin and fate of the universe. Founded in 1931, Berkeley Lab’s scientific expertise has been recognized with 13 Nobel prizes. The University of California manages Berkeley Lab for the DOE’s Office of Science.

    The DOE Office of Science is the United States’ single largest supporter of basic research in the physical sciences and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.

    • other-fb
    • other-tw
    X
    X
    X
    • Filters

    • × Clear Filters
    A Trojan Horse for Fusion Disruptions

    A Trojan Horse for Fusion Disruptions

    Thin-walled diamond shells carry payloads of boron dust; the dust mitigates destructive plasma disruptions in fusion confinement systems.

    Mineral Discovery Made Easier: X-Ray Technique Shines a New Light on Tiny, Rare Crystals

    Mineral Discovery Made Easier: X-Ray Technique Shines a New Light on Tiny, Rare Crystals

    Like a tiny needle in a sprawling hayfield, a single crystal grain measuring just tens of millionths of a meter - found in a borehole sample drilled in Central Siberia - had an unexpected chemical makeup. And a specialized X-ray technique in use at Berkeley Lab confirmed the sample's uniqueness and paved the way for its formal recognition as a newly discovered mineral: ognitite.

    Neutrons get a wider angle on DNA and RNA to advance 3D models

    Neutrons get a wider angle on DNA and RNA to advance 3D models

    Scientists from the National Institute of Standards and Technology (NIST) and the University of Maryland used neutrons at Oak Ridge National Laboratory (ORNL) to capture new information about DNA and RNA molecules and enable more accurate computer simulations of how they interact with everything from proteins to viruses.

    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Scientists discover an unexpected source of new materials, with potential for energy applications.

    A quick liquid flip helps explain how morphing materials store information

    A quick liquid flip helps explain how morphing materials store information

    Experiments at SLAC's X-ray laser reveal in atomic detail how two distinct liquid phases in these materials enable fast switching between glassy and crystalline states that represent 0s and 1s in memory devices.

    A New Manufacturing Process for Aluminum Alloys

    A New Manufacturing Process for Aluminum Alloys

    Using a novel Solid Phase Processing approach, a research team at Pacific Northwest National Laboratory eliminated several steps that are required during conventional extrusion processing of aluminum alloy powders, while also achieving a significant increase in product ductility. This is good news for sectors such as the automotive industry, where the high cost of manufacturing has historically limited the use of high-strength aluminum alloys made from powders.

    Flowing for Function

    Flowing for Function

    A flowing magnetically responsive liquid seamlessly regulates the shape and properties of solids, letting them perform an array of jobs.

    Science Snapshots: new nitrides, artificial photosynthesis, and TMDC semiconductors

    Science Snapshots: new nitrides, artificial photosynthesis, and TMDC semiconductors

    From Berkeley Lab: groundbreaking study maps out paths to new nitride materials; new framework for artificial photosynthesis; TMDCs don't have to be perfect to shine bright.

    Story Tips from the Department of Energy's Oak Ridge National Laboratory, June 17 2019

    Story Tips from the Department of Energy's Oak Ridge National Laboratory, June 17 2019

    ORNL story tips: New builders' tool by ORNL assesses design performance before construction begins; new pressure technique to manipulate magnetism in thin films could enhance electronic devices; ORNL outlines quantum sensing advances for better airport scanning, other applications.

    Superconducting Films for Particle Acceleration

    Superconducting Films for Particle Acceleration

    Researchers demonstrated record accelerating cavity performance using a technique that could lead to significant cost savings.


    • Filters

    • × Clear Filters

    Energy Department to Invest $32 Million in Computer Design of Materials

    The U.S. Department of Energy announced that it will invest $32 million over the next four years to accelerate the design of new materials through use of supercomputers.

    Demarteau to head ORNL Physics Division

    Demarteau to head ORNL Physics Division

    The Department of Energy's Oak Ridge National Laboratory has named Marcel Demarteau as Physics Division Director, effective June 17.

    PPPL and Oak Ridge manage new DOE program designed to speed development of fusion energy with private-public partnerships

    PPPL and Oak Ridge manage new DOE program designed to speed development of fusion energy with private-public partnerships

    Feature describes PPPL role in innovative DOE program to promote public-private partnerships to speed development of fusion energy.

    ORNL welcomes seven new research fellows to Innovation Crossroads

    ORNL welcomes seven new research fellows to Innovation Crossroads

    Oak Ridge National Laboratory welcomed seven technology innovators to join the third cohort of Innovation Crossroads, the Southeast's only entrepreneurial research and development program based at a U.S. Department of Energy national laboratory.

    New DOE program connects fusion companies with national labs, taps ORNL to lead

    New DOE program connects fusion companies with national labs, taps ORNL to lead

    The Department of Energy has established the Innovation Network for Fusion Energy program, or INFUSE, to encourage private-public research partnerships for overcoming challenges in fusion energy development.

    Department of Energy Announces $75 Million for High Energy Physics Research

    The U.S. Department of Energy (DOE) announced $75 million in funding for 66 university research awards on a range of topics in high energy physics to advance knowledge of how the universe works at its most fundamental level.

    Ames Laboratory names James Morris Chief Research Officer

    Ames Laboratory names James Morris Chief Research Officer

    Dr. James Morris has been named Chief Research Officer at the Department of Energy's (DOE) Ames Laboratory. His appointment follows an extensive search and will be effective June 17, 2019.

    Four scientists at PPPL awarded national and international honors

    Four scientists at PPPL awarded national and international honors

    Feature profiles four PPPL scientists who have received high honors.

    Brookhaven's Mircea Cotlet Named a Battelle "Inventor of the Year"

    Brookhaven's Mircea Cotlet Named a Battelle "Inventor of the Year"

    The global science and technology organization Battelle recognized materials scientist Mircea Cotlet of Brookhaven Lab's Center for Functional Nanomaterials for his research in applying self-assembly methods to control the interfaces between nanomaterials and other light-interacting components.

    Berkeley Lab Project to Pinpoint Methane 'Super Emitters'

    Berkeley Lab Project to Pinpoint Methane 'Super Emitters'

    Methane, a potent greenhouse gas that traps about 30 times more heat than carbon dioxide, is commonly released from rice fields, dairies, landfills, and oil and gas facilities - all of which are plentiful in California. Now Berkeley Lab has been awarded $6 million by the state to find "super emitters" of methane in an effort to quantify and potentially mitigate methane emissions.


    • Filters

    • × Clear Filters
    A Trojan Horse for Fusion Disruptions

    A Trojan Horse for Fusion Disruptions

    Thin-walled diamond shells carry payloads of boron dust; the dust mitigates destructive plasma disruptions in fusion confinement systems.

    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Scientists discover an unexpected source of new materials, with potential for energy applications.

    Flowing for Function

    Flowing for Function

    A flowing magnetically responsive liquid seamlessly regulates the shape and properties of solids, letting them perform an array of jobs.

    Superconducting Films for Particle Acceleration

    Superconducting Films for Particle Acceleration

    Researchers demonstrated record accelerating cavity performance using a technique that could lead to significant cost savings.

    Parceling Particle Beams

    Parceling Particle Beams

    Beam chopper cuts accelerator-generated ion beams under highly demanding conditions.

    An Interaction of Slipping Beams

    An Interaction of Slipping Beams

    Successful models of the fraught dynamics of two particle beams in close contact lead to smoother sailing in an area of particle acceleration.

    At DOE's Manufacturing Demonstration Facility, science drives next-gen creations

    At DOE's Manufacturing Demonstration Facility, science drives next-gen creations

    American ingenuity is providing radical productivity improvements from advanced materials and robotic systems developed at the Department of Energy's Manufacturing Demonstration Facility at Oak Ridge National Laboratory.

    Computer Simulation Shows Astrophysical Particle Acceleration

    Computer Simulation Shows Astrophysical Particle Acceleration

    Particles act in a way that justifies extrapolating simulation results to astrophysical scales.

    High-Fidelity Multiphysics Simulations to Improve Nuclear Reactor Safety and Economics

    High-Fidelity Multiphysics Simulations to Improve Nuclear Reactor Safety and Economics

    Engineers can model heat distribution in reactor designs with fewer or no approximations.

    Simulations Shed Light on Self-Healing Cement

    Simulations Shed Light on Self-Healing Cement

    A first-of-its-kind computer simulation reveals self-healing cement for geothermal and oil and gas wells performs better than originally thought.


    Spotlight

    ILSAMP Symposium showcases benefits for diverse students, STEM pipeline
    Monday May 20, 2019, 12:05 PM

    ILSAMP Symposium showcases benefits for diverse students, STEM pipeline

    Argonne National Laboratory

    Integrating Scientific Computing into Science Curricula
    Monday May 13, 2019, 11:05 AM

    Integrating Scientific Computing into Science Curricula

    Brookhaven National Laboratory

    Students from Minnesota and Massachusetts Win DOE's 29th National Science Bowl(r)
    Monday April 29, 2019, 02:05 PM

    Students from Minnesota and Massachusetts Win DOE's 29th National Science Bowl(r)

    Department of Energy, Office of Science

    DOE's Science Graduate Student Research Program Selects 70 Students to Pursue Research at DOE Laboratories
    Friday April 12, 2019, 03:05 PM

    DOE's Science Graduate Student Research Program Selects 70 Students to Pursue Research at DOE Laboratories

    Department of Energy, Office of Science

    Young Women's Conference in STEM seeks to change the statistics one girl at a time
    Thursday March 28, 2019, 03:05 PM

    Young Women's Conference in STEM seeks to change the statistics one girl at a time

    Princeton Plasma Physics Laboratory

    Students team with Argonne scientists and engineers to learn about STEM careers
    Tuesday March 12, 2019, 05:05 PM

    Students team with Argonne scientists and engineers to learn about STEM careers

    Argonne National Laboratory

    Lynbrook High wins 2019 SLAC Regional Science Bowl competition
    Wednesday February 13, 2019, 02:05 PM

    Lynbrook High wins 2019 SLAC Regional Science Bowl competition

    SLAC National Accelerator Laboratory

    Equipping the next generation for a technological revolution
    Thursday January 24, 2019, 01:05 PM

    Equipping the next generation for a technological revolution

    Argonne National Laboratory

    Chemistry intern inspired by Argonne's real-world science
    Friday January 18, 2019, 05:05 PM

    Chemistry intern inspired by Argonne's real-world science

    Argonne National Laboratory

    Chasing a supernova
    Friday January 18, 2019, 04:05 PM

    Chasing a supernova

    Argonne National Laboratory

    Argonne intern streamlines the beamline
    Tuesday January 08, 2019, 02:05 PM

    Argonne intern streamlines the beamline

    Argonne National Laboratory

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices
    Thursday October 11, 2018, 04:00 PM

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices

    Rensselaer Polytechnic Institute (RPI)

    Innovating Our Energy Future
    Wednesday October 03, 2018, 07:05 PM

    Innovating Our Energy Future

    Oregon State University, College of Engineering

    Physics graduate student takes her thesis research to a Department of Energy national lab
    Tuesday October 02, 2018, 03:05 PM

    Physics graduate student takes her thesis research to a Department of Energy national lab

    University of Alabama at Birmingham

    Friday September 21, 2018, 01:05 PM

    "Model" students enjoy Argonne campus life

    Argonne National Laboratory

    Writing Code for a More Skilled and Diverse STEM Workforce
    Thursday September 06, 2018, 01:05 PM

    Writing Code for a More Skilled and Diverse STEM Workforce

    Brookhaven National Laboratory

    New graduate student summer school launches at Princeton Plasma Physics Laboratory
    Tuesday September 04, 2018, 11:30 AM

    New graduate student summer school launches at Princeton Plasma Physics Laboratory

    Princeton Plasma Physics Laboratory

    The Gridlock State
    Friday August 31, 2018, 06:05 PM

    The Gridlock State

    California State University (CSU) Chancellor's Office

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson
    Friday August 31, 2018, 02:05 PM

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson

    Brookhaven National Laboratory

    Argonne hosts Modeling, Experimentation and Validation Summer School
    Friday August 24, 2018, 11:05 AM

    Argonne hosts Modeling, Experimentation and Validation Summer School

    Argonne National Laboratory

    Students affected by Hurricane Maria bring their research to SLAC
    Wednesday August 22, 2018, 01:05 PM

    Students affected by Hurricane Maria bring their research to SLAC

    SLAC National Accelerator Laboratory

    Brookhaven Lab Pays Tribute to 2018 Summer Interns
    Wednesday August 22, 2018, 10:05 AM

    Brookhaven Lab Pays Tribute to 2018 Summer Interns

    Brookhaven National Laboratory

    Changing How Buildings Are Made
    Monday August 20, 2018, 12:05 PM

    Changing How Buildings Are Made

    Washington University in St. Louis

    CSUMB Selected to Host Architecture at Zero Competition in 2019
    Thursday August 16, 2018, 12:05 PM

    CSUMB Selected to Host Architecture at Zero Competition in 2019

    California State University, Monterey Bay

    Department of Energy Invests $64 Million in Advanced Nuclear Technology
    Friday July 20, 2018, 03:00 PM

    Department of Energy Invests $64 Million in Advanced Nuclear Technology

    Rensselaer Polytechnic Institute (RPI)

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor
    Thursday July 19, 2018, 05:00 PM

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

    Rensselaer Polytechnic Institute (RPI)

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'
    Tuesday July 03, 2018, 11:05 AM

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

    Brookhaven National Laboratory

    Argonne welcomes <em>The Martian</em> author Andy Weir
    Friday June 29, 2018, 06:05 PM

    Argonne welcomes The Martian author Andy Weir

    Argonne National Laboratory

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy
    Monday June 18, 2018, 09:55 AM

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

    Illinois Mathematics and Science Academy (IMSA)

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research
    Friday June 15, 2018, 10:00 AM

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

    Rensselaer Polytechnic Institute (RPI)

    Celebrating 40 years of empowerment in science
    Thursday June 07, 2018, 03:05 PM

    Celebrating 40 years of empowerment in science

    Argonne National Laboratory

    Introducing Graduate Students Across the Globe to Photon Science
    Monday May 07, 2018, 10:30 AM

    Introducing Graduate Students Across the Globe to Photon Science

    Brookhaven National Laboratory

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)
    Wednesday May 02, 2018, 04:05 PM

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

    Department of Energy, Office of Science

    The Race for Young Scientific Minds
    Thursday April 12, 2018, 07:05 PM

    The Race for Young Scientific Minds

    Argonne National Laboratory

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond
    Wednesday March 14, 2018, 02:05 PM

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

    SLAC National Accelerator Laboratory

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week
    Thursday February 15, 2018, 12:05 PM

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

    University of Virginia Darden School of Business

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities
    Friday February 09, 2018, 11:05 AM

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

    California State University, Channel Islands

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018
    Wednesday January 17, 2018, 12:05 PM

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

    Fermi National Accelerator Laboratory (Fermilab)

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code
    Wednesday January 17, 2018, 12:05 PM

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

    Fermi National Accelerator Laboratory (Fermilab)

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom
    Wednesday December 20, 2017, 01:05 PM

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

    SLAC National Accelerator Laboratory

    The Future of Today's Electric Power Systems
    Monday December 18, 2017, 01:05 PM

    The Future of Today's Electric Power Systems

    Rensselaer Polytechnic Institute (RPI)

    Supporting the Development of Offshore Wind Power Plants
    Monday December 18, 2017, 12:05 PM

    Supporting the Development of Offshore Wind Power Plants

    Rensselaer Polytechnic Institute (RPI)

    Stairway to Science
    Tuesday October 03, 2017, 01:05 PM

    Stairway to Science

    Argonne National Laboratory

    After-School Energy Rush
    Thursday September 28, 2017, 12:05 PM

    After-School Energy Rush

    Argonne National Laboratory

    Bringing Diversity Into Computational Science Through Student Outreach
    Thursday September 28, 2017, 10:05 AM

    Bringing Diversity Into Computational Science Through Student Outreach

    Brookhaven National Laboratory

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM
    Thursday September 21, 2017, 03:05 PM

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

    SLAC National Accelerator Laboratory





    Showing results

    0-4 Of 2215