DOE News
    Doe Science news source
    The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
    • 2018-10-29 13:05:53
    • Article ID: 702956

    Machine Learning to Help Optimize Traffic and Reduce Pollution

    Berkeley Lab researchers use algorithms for smart and sustainable mobility solutions

    • Credit: Bayen Mobile Sensing Lab

      The Flow training and evaluation process.

    • Credit: iStock

    Applying artificial intelligence to self-driving cars to smooth traffic, reduce fuel consumption, and improve air quality predictions may sound like the stuff of science fiction, but researchers at the Department of Energy’s Lawrence Berkeley National Laboratory (Berkeley Lab) have launched two research projects to do just that.

    In collaboration with UC Berkeley, Berkeley Lab scientists are using deep reinforcement learning, a computational tool for training controllers, to make transportation more sustainable. One project uses deep reinforcement learning to train autonomous vehicles to drive in ways to simultaneously improve traffic flow and reduce energy consumption. A second uses deep learning algorithms to analyze satellite images combined with traffic information from cell phones and data already being collected by environmental sensors to improve air quality predictions.

    “Thirty percent of energy use in the U.S. is to transport people and goods, and this energy consumption contributes to air pollution, including approximately half of all nitrogen oxide emissions, a precursor to particular matter and ozone – and black carbon (soot) emissions,” said Tom Kirchstetter, director of Berkeley Lab’s Energy Analysis and Environmental Impacts Division, an adjunct professor at UC Berkeley, and a member of the research team. 

    “Applying machine learning technologies to transportation and the environment is a new frontier that could pay significant dividends – for energy as well as for human health.”

    Traffic smoothing with Flow

    The traffic-smoothing project, dubbed CIRCLES, or Congestion Impact Reduction via CAV-in-the-loop Lagrangian Energy Smoothing, is led by Berkeley Lab researcher Alexandre Bayen, who is also is a professor of electrical engineering and computer science at UC Berkeley and director of UC Berkeley’s Institute of Transportation Studies. CIRCLES is based on a software framework called Flow, developed by Bayen’s team of students and post-doctoral researchers. 

    Flow is a first-of-its-kind software framework allowing researchers to discover and benchmark schemes for optimizing traffic. Using a state-of-the-art open-source microsimulator, Flow can simulate hundreds of thousands of vehicles – some driven by humans, others autonomous – driving in custom traffic scenarios.

    “The potential for cities is enormous,” said Bayen. “Experiments have shown that the energy savings with just a small percentage of vehicles on the road being autonomous can be huge. And we can improve it even further with our algorithms.” 

    Flow was launched in 2017 and released to the public in September, and the benchmarks are being released this month. With funding from the Laboratory Directed Research and Development program, Bayen and his team will use Flow to design, test, and deploy the first connected and autonomous vehicle (CAV)-enabled system to actively reduce stop-and-go phantom traffic jams on freeways.

    How reinforcement learning can reduce congestion 

    Some of the current research into using autonomous vehicles to smooth traffic was inspired by a simple experiment done by Japanese researchers 10 years ago in which about 20 human drivers were instructed to drive in a ring at 20 mph. At first everyone is proceeding smoothly, but within 30 seconds, the traffic waves start and cars come to a standstill.

    “You have stop-and-go oscillation within less than a minute,” Bayen said. “This experiment led to hundreds if not thousands of research papers to try to explain what is happening.”

    A team of researchers led by Dan Work of Vanderbilt University repeated the same experiment last year but made one change: they added a single autonomous vehicle in the ring. As soon as the automation is turned on, the oscillations are immediately smoothed out.

    Why? “The automation essentially understands to not accelerate and catch up with the previous person – which would amplify the instability – but rather to behave as a flow pacifier, essentially smoothing down by restraining traffic so that it doesn’t amplify the instability,” Bayen said. 

    Deep reinforcement learning has been used to train computers to play chess and to teach a robot how to run an obstacle course. It trains by “taking observations of the system, and then iteratively trying out a bunch of actions, seeing if they’re good or bad, and then picking out which actions it should prioritize,” said Eugene Vinitsky, a graduate student working with Bayen and one of Flow’s developers.

    In the case of traffic, Flow trains vehicles to check what the cars directly in front of and behind them are doing. “It tries out different things – it can accelerate, decelerate, or change lanes, for example,” Vinitsky explained. “You give it a reward signal, like, was traffic stopped or flowing smoothly, and it tries to correlate what it was doing to the state of the traffic.”

    With the CIRCLES project, Bayen and his team plan to first run simulations to confirm that significant energy savings result from using the algorithms in autonomous vehicles. Next they will run a field test of the algorithm with human drivers responding to real-time commands.

    DeepAir

    The pollution project, named DeepAir (Deep Learning and Satellite Imaginary to Estimate Air Quality Impact at Scale), is led by Berkeley Lab researcher Marta Gonzalez, who is also a professor in UC Berkeley’s City & Regional Planning Department. In past research, she has used cell phone data to study how people move around cities and to recommend electric vehicle charging schemes to save energy and costs.

    For this project, she will take advantage of the power of deep learning algorithms to analyze satellite images combined with traffic information from cell phones and data already being collected by environmental monitoring stations. 

    “The novelty here is that while the environmental models, which show the interaction of pollutants with weather – such as wind speed, pressure, precipitation, and temperature – have been developed for years, there’s a missing piece,” Gonzalez said. “In order to be reliable, those models need to have good inventories of what’s entering the environment, such as emissions from vehicles and power plants.

    “We bring novel data sources such as mobile phones, integrated with satellite images. In order to process and interpret all this information, we use machine learning models applied to computer vision. The integration of information technologies to better understand complex natural system interactions at large scale is the innovative piece of DeepAir.” 

    The researchers anticipate that the resulting analysis will allow them to gain insights into the sources and distribution of pollutants, and ultimately allow for the design of more efficient and more timely interventions. For example, the Bay Area has “Spare the Air” days, in which traffic restrictions are voluntary, and other cities have schemes to restrict traffic or industry. 

    While the idea of using algorithms to control cars and traffic may sound incredible at the moment, Bayen believes technology is headed in that direction. “I do believe that within 10 years the things we’re coming up with here, like flow smoothing, will be standard practice, because there will be more automated vehicles on the road,” he said.

    # # #

    Lawrence Berkeley National Laboratory addresses the world’s most urgent scientific challenges by advancing sustainable energy, protecting human health, creating new materials, and revealing the origin and fate of the universe. Founded in 1931, Berkeley Lab’s scientific expertise has been recognized with 13 Nobel Prizes. The University of California manages Berkeley Lab for the U.S. Department of Energy’s Office of Science. For more, visit www.lbl.gov.

    DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov

    • other-fb
    • other-tw
    X
    X
    X
    • Filters

    • × Clear Filters
    Flowing for Function

    Flowing for Function

    A flowing magnetically responsive liquid seamlessly regulates the shape and properties of solids, letting them perform an array of jobs.

    Science Snapshots: new nitrides, artificial photosynthesis, and TMDC semiconductors

    Science Snapshots: new nitrides, artificial photosynthesis, and TMDC semiconductors

    From Berkeley Lab: groundbreaking study maps out paths to new nitride materials; new framework for artificial photosynthesis; TMDCs don't have to be perfect to shine bright.

    Story Tips from the Department of Energy's Oak Ridge National Laboratory, June 17 2019

    Story Tips from the Department of Energy's Oak Ridge National Laboratory, June 17 2019

    ORNL story tips: New builders' tool by ORNL assesses design performance before construction begins; new pressure technique to manipulate magnetism in thin films could enhance electronic devices; ORNL outlines quantum sensing advances for better airport scanning, other applications.

    Superconducting Films for Particle Acceleration

    Superconducting Films for Particle Acceleration

    Researchers demonstrated record accelerating cavity performance using a technique that could lead to significant cost savings.

    Electron (or 'Hole') Pairs May Survive Effort to Kill Superconductivity

    Electron (or 'Hole') Pairs May Survive Effort to Kill Superconductivity

    Scientists seeking to understand the mechanism underlying superconductivity in "stripe-ordered" cuprates--copper-oxide materials with alternating areas of electric charge and magnetism--discovered an unusual metallic state when attempting to turn superconductivity off. They found that under the conditions of their experiment, even after the material loses its ability to carry electrical current with no energy loss, it retains some conductivity--and possibly the electron (or hole) pairs required for its superconducting superpower.

    Parceling Particle Beams

    Parceling Particle Beams

    Beam chopper cuts accelerator-generated ion beams under highly demanding conditions.

    An Interaction of Slipping Beams

    An Interaction of Slipping Beams

    Successful models of the fraught dynamics of two particle beams in close contact lead to smoother sailing in an area of particle acceleration.

    Hybrid Nanostructure Steps Up Light-Harvesting Efficiency

    Hybrid Nanostructure Steps Up Light-Harvesting Efficiency

    Energy is transferred through the structure in a way that boosts its response to light, showing promise for solar cell applications.

    Pulsed Electron Beams Shed Light on Plastics Production

    Pulsed Electron Beams Shed Light on Plastics Production

    Researchers at Berkeley Lab have developed a pulsed electron beam technique that enables high-resolution imaging of magnesium chloride without damage. This approach could apply to a vast range of beam-sensitive materials, and help to create a path toward sustainable plastics.

    Tracking major sources of energy loss in compact fusion facilities

    Tracking major sources of energy loss in compact fusion facilities

    Analysis of energy loss in low-aspect ratio tokamaks opens a new chapter in the development of predictions of transport in such facilities.


    • Filters

    • × Clear Filters

    Energy Department to Invest $32 Million in Computer Design of Materials

    The U.S. Department of Energy announced that it will invest $32 million over the next four years to accelerate the design of new materials through use of supercomputers.

    Demarteau to head ORNL Physics Division

    Demarteau to head ORNL Physics Division

    The Department of Energy's Oak Ridge National Laboratory has named Marcel Demarteau as Physics Division Director, effective June 17.

    PPPL and Oak Ridge manage new DOE program designed to speed development of fusion energy with private-public partnerships

    PPPL and Oak Ridge manage new DOE program designed to speed development of fusion energy with private-public partnerships

    Feature describes PPPL role in innovative DOE program to promote public-private partnerships to speed development of fusion energy.

    ORNL welcomes seven new research fellows to Innovation Crossroads

    ORNL welcomes seven new research fellows to Innovation Crossroads

    Oak Ridge National Laboratory welcomed seven technology innovators to join the third cohort of Innovation Crossroads, the Southeast's only entrepreneurial research and development program based at a U.S. Department of Energy national laboratory.

    New DOE program connects fusion companies with national labs, taps ORNL to lead

    New DOE program connects fusion companies with national labs, taps ORNL to lead

    The Department of Energy has established the Innovation Network for Fusion Energy program, or INFUSE, to encourage private-public research partnerships for overcoming challenges in fusion energy development.

    Department of Energy Announces $75 Million for High Energy Physics Research

    The U.S. Department of Energy (DOE) announced $75 million in funding for 66 university research awards on a range of topics in high energy physics to advance knowledge of how the universe works at its most fundamental level.

    Ames Laboratory names James Morris Chief Research Officer

    Ames Laboratory names James Morris Chief Research Officer

    Dr. James Morris has been named Chief Research Officer at the Department of Energy's (DOE) Ames Laboratory. His appointment follows an extensive search and will be effective June 17, 2019.

    Four scientists at PPPL awarded national and international honors

    Four scientists at PPPL awarded national and international honors

    Feature profiles four PPPL scientists who have received high honors.

    Brookhaven's Mircea Cotlet Named a Battelle "Inventor of the Year"

    Brookhaven's Mircea Cotlet Named a Battelle "Inventor of the Year"

    The global science and technology organization Battelle recognized materials scientist Mircea Cotlet of Brookhaven Lab's Center for Functional Nanomaterials for his research in applying self-assembly methods to control the interfaces between nanomaterials and other light-interacting components.

    Berkeley Lab Project to Pinpoint Methane 'Super Emitters'

    Berkeley Lab Project to Pinpoint Methane 'Super Emitters'

    Methane, a potent greenhouse gas that traps about 30 times more heat than carbon dioxide, is commonly released from rice fields, dairies, landfills, and oil and gas facilities - all of which are plentiful in California. Now Berkeley Lab has been awarded $6 million by the state to find "super emitters" of methane in an effort to quantify and potentially mitigate methane emissions.


    • Filters

    • × Clear Filters
    Flowing for Function

    Flowing for Function

    A flowing magnetically responsive liquid seamlessly regulates the shape and properties of solids, letting them perform an array of jobs.

    Superconducting Films for Particle Acceleration

    Superconducting Films for Particle Acceleration

    Researchers demonstrated record accelerating cavity performance using a technique that could lead to significant cost savings.

    Parceling Particle Beams

    Parceling Particle Beams

    Beam chopper cuts accelerator-generated ion beams under highly demanding conditions.

    An Interaction of Slipping Beams

    An Interaction of Slipping Beams

    Successful models of the fraught dynamics of two particle beams in close contact lead to smoother sailing in an area of particle acceleration.

    At DOE's Manufacturing Demonstration Facility, science drives next-gen creations

    At DOE's Manufacturing Demonstration Facility, science drives next-gen creations

    American ingenuity is providing radical productivity improvements from advanced materials and robotic systems developed at the Department of Energy's Manufacturing Demonstration Facility at Oak Ridge National Laboratory.

    Computer Simulation Shows Astrophysical Particle Acceleration

    Computer Simulation Shows Astrophysical Particle Acceleration

    Particles act in a way that justifies extrapolating simulation results to astrophysical scales.

    High-Fidelity Multiphysics Simulations to Improve Nuclear Reactor Safety and Economics

    High-Fidelity Multiphysics Simulations to Improve Nuclear Reactor Safety and Economics

    Engineers can model heat distribution in reactor designs with fewer or no approximations.

    Simulations Shed Light on Self-Healing Cement

    Simulations Shed Light on Self-Healing Cement

    A first-of-its-kind computer simulation reveals self-healing cement for geothermal and oil and gas wells performs better than originally thought.

    Solving a Beta Decay Puzzle

    Solving a Beta Decay Puzzle

    Researchers use advanced nuclear models to explain 50-year mystery surrounding the process stars use to transform elements.

    Why Are These Extremely Light Calcium Isotopes So Small?

    Why Are These Extremely Light Calcium Isotopes So Small?

    The radii of three proton-rich calcium isotopes are smaller than previously predicted because models didn't account for two nuclear interactions.


    Spotlight

    ILSAMP Symposium showcases benefits for diverse students, STEM pipeline
    Monday May 20, 2019, 12:05 PM

    ILSAMP Symposium showcases benefits for diverse students, STEM pipeline

    Argonne National Laboratory

    Integrating Scientific Computing into Science Curricula
    Monday May 13, 2019, 11:05 AM

    Integrating Scientific Computing into Science Curricula

    Brookhaven National Laboratory

    Students from Minnesota and Massachusetts Win DOE's 29th National Science Bowl(r)
    Monday April 29, 2019, 02:05 PM

    Students from Minnesota and Massachusetts Win DOE's 29th National Science Bowl(r)

    Department of Energy, Office of Science

    DOE's Science Graduate Student Research Program Selects 70 Students to Pursue Research at DOE Laboratories
    Friday April 12, 2019, 03:05 PM

    DOE's Science Graduate Student Research Program Selects 70 Students to Pursue Research at DOE Laboratories

    Department of Energy, Office of Science

    Young Women's Conference in STEM seeks to change the statistics one girl at a time
    Thursday March 28, 2019, 03:05 PM

    Young Women's Conference in STEM seeks to change the statistics one girl at a time

    Princeton Plasma Physics Laboratory

    Students team with Argonne scientists and engineers to learn about STEM careers
    Tuesday March 12, 2019, 05:05 PM

    Students team with Argonne scientists and engineers to learn about STEM careers

    Argonne National Laboratory

    Lynbrook High wins 2019 SLAC Regional Science Bowl competition
    Wednesday February 13, 2019, 02:05 PM

    Lynbrook High wins 2019 SLAC Regional Science Bowl competition

    SLAC National Accelerator Laboratory

    Equipping the next generation for a technological revolution
    Thursday January 24, 2019, 01:05 PM

    Equipping the next generation for a technological revolution

    Argonne National Laboratory

    Chemistry intern inspired by Argonne's real-world science
    Friday January 18, 2019, 05:05 PM

    Chemistry intern inspired by Argonne's real-world science

    Argonne National Laboratory

    Chasing a supernova
    Friday January 18, 2019, 04:05 PM

    Chasing a supernova

    Argonne National Laboratory

    Argonne intern streamlines the beamline
    Tuesday January 08, 2019, 02:05 PM

    Argonne intern streamlines the beamline

    Argonne National Laboratory

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices
    Thursday October 11, 2018, 04:00 PM

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices

    Rensselaer Polytechnic Institute (RPI)

    Innovating Our Energy Future
    Wednesday October 03, 2018, 07:05 PM

    Innovating Our Energy Future

    Oregon State University, College of Engineering

    Physics graduate student takes her thesis research to a Department of Energy national lab
    Tuesday October 02, 2018, 03:05 PM

    Physics graduate student takes her thesis research to a Department of Energy national lab

    University of Alabama at Birmingham

    Friday September 21, 2018, 01:05 PM

    "Model" students enjoy Argonne campus life

    Argonne National Laboratory

    Writing Code for a More Skilled and Diverse STEM Workforce
    Thursday September 06, 2018, 01:05 PM

    Writing Code for a More Skilled and Diverse STEM Workforce

    Brookhaven National Laboratory

    New graduate student summer school launches at Princeton Plasma Physics Laboratory
    Tuesday September 04, 2018, 11:30 AM

    New graduate student summer school launches at Princeton Plasma Physics Laboratory

    Princeton Plasma Physics Laboratory

    The Gridlock State
    Friday August 31, 2018, 06:05 PM

    The Gridlock State

    California State University (CSU) Chancellor's Office

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson
    Friday August 31, 2018, 02:05 PM

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson

    Brookhaven National Laboratory

    Argonne hosts Modeling, Experimentation and Validation Summer School
    Friday August 24, 2018, 11:05 AM

    Argonne hosts Modeling, Experimentation and Validation Summer School

    Argonne National Laboratory

    Students affected by Hurricane Maria bring their research to SLAC
    Wednesday August 22, 2018, 01:05 PM

    Students affected by Hurricane Maria bring their research to SLAC

    SLAC National Accelerator Laboratory

    Brookhaven Lab Pays Tribute to 2018 Summer Interns
    Wednesday August 22, 2018, 10:05 AM

    Brookhaven Lab Pays Tribute to 2018 Summer Interns

    Brookhaven National Laboratory

    Changing How Buildings Are Made
    Monday August 20, 2018, 12:05 PM

    Changing How Buildings Are Made

    Washington University in St. Louis

    CSUMB Selected to Host Architecture at Zero Competition in 2019
    Thursday August 16, 2018, 12:05 PM

    CSUMB Selected to Host Architecture at Zero Competition in 2019

    California State University, Monterey Bay

    Department of Energy Invests $64 Million in Advanced Nuclear Technology
    Friday July 20, 2018, 03:00 PM

    Department of Energy Invests $64 Million in Advanced Nuclear Technology

    Rensselaer Polytechnic Institute (RPI)

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor
    Thursday July 19, 2018, 05:00 PM

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

    Rensselaer Polytechnic Institute (RPI)

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'
    Tuesday July 03, 2018, 11:05 AM

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

    Brookhaven National Laboratory

    Argonne welcomes <em>The Martian</em> author Andy Weir
    Friday June 29, 2018, 06:05 PM

    Argonne welcomes The Martian author Andy Weir

    Argonne National Laboratory

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy
    Monday June 18, 2018, 09:55 AM

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

    Illinois Mathematics and Science Academy (IMSA)

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research
    Friday June 15, 2018, 10:00 AM

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

    Rensselaer Polytechnic Institute (RPI)

    Celebrating 40 years of empowerment in science
    Thursday June 07, 2018, 03:05 PM

    Celebrating 40 years of empowerment in science

    Argonne National Laboratory

    Introducing Graduate Students Across the Globe to Photon Science
    Monday May 07, 2018, 10:30 AM

    Introducing Graduate Students Across the Globe to Photon Science

    Brookhaven National Laboratory

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)
    Wednesday May 02, 2018, 04:05 PM

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

    Department of Energy, Office of Science

    The Race for Young Scientific Minds
    Thursday April 12, 2018, 07:05 PM

    The Race for Young Scientific Minds

    Argonne National Laboratory

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond
    Wednesday March 14, 2018, 02:05 PM

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

    SLAC National Accelerator Laboratory

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week
    Thursday February 15, 2018, 12:05 PM

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

    University of Virginia Darden School of Business

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities
    Friday February 09, 2018, 11:05 AM

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

    California State University, Channel Islands

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018
    Wednesday January 17, 2018, 12:05 PM

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

    Fermi National Accelerator Laboratory (Fermilab)

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code
    Wednesday January 17, 2018, 12:05 PM

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

    Fermi National Accelerator Laboratory (Fermilab)

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom
    Wednesday December 20, 2017, 01:05 PM

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

    SLAC National Accelerator Laboratory

    The Future of Today's Electric Power Systems
    Monday December 18, 2017, 01:05 PM

    The Future of Today's Electric Power Systems

    Rensselaer Polytechnic Institute (RPI)

    Supporting the Development of Offshore Wind Power Plants
    Monday December 18, 2017, 12:05 PM

    Supporting the Development of Offshore Wind Power Plants

    Rensselaer Polytechnic Institute (RPI)

    Stairway to Science
    Tuesday October 03, 2017, 01:05 PM

    Stairway to Science

    Argonne National Laboratory

    After-School Energy Rush
    Thursday September 28, 2017, 12:05 PM

    After-School Energy Rush

    Argonne National Laboratory

    Bringing Diversity Into Computational Science Through Student Outreach
    Thursday September 28, 2017, 10:05 AM

    Bringing Diversity Into Computational Science Through Student Outreach

    Brookhaven National Laboratory

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM
    Thursday September 21, 2017, 03:05 PM

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

    SLAC National Accelerator Laboratory





    Showing results

    0-4 Of 2215