DOE News
    Doe Science news source
    The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
    • 2018-10-29 13:05:53
    • Article ID: 702956

    Machine Learning to Help Optimize Traffic and Reduce Pollution

    Berkeley Lab researchers use algorithms for smart and sustainable mobility solutions

    • Credit: Bayen Mobile Sensing Lab

      The Flow training and evaluation process.

    • Credit: iStock

    Applying artificial intelligence to self-driving cars to smooth traffic, reduce fuel consumption, and improve air quality predictions may sound like the stuff of science fiction, but researchers at the Department of Energy’s Lawrence Berkeley National Laboratory (Berkeley Lab) have launched two research projects to do just that.

    In collaboration with UC Berkeley, Berkeley Lab scientists are using deep reinforcement learning, a computational tool for training controllers, to make transportation more sustainable. One project uses deep reinforcement learning to train autonomous vehicles to drive in ways to simultaneously improve traffic flow and reduce energy consumption. A second uses deep learning algorithms to analyze satellite images combined with traffic information from cell phones and data already being collected by environmental sensors to improve air quality predictions.

    “Thirty percent of energy use in the U.S. is to transport people and goods, and this energy consumption contributes to air pollution, including approximately half of all nitrogen oxide emissions, a precursor to particular matter and ozone – and black carbon (soot) emissions,” said Tom Kirchstetter, director of Berkeley Lab’s Energy Analysis and Environmental Impacts Division, an adjunct professor at UC Berkeley, and a member of the research team. 

    “Applying machine learning technologies to transportation and the environment is a new frontier that could pay significant dividends – for energy as well as for human health.”

    Traffic smoothing with Flow

    The traffic-smoothing project, dubbed CIRCLES, or Congestion Impact Reduction via CAV-in-the-loop Lagrangian Energy Smoothing, is led by Berkeley Lab researcher Alexandre Bayen, who is also is a professor of electrical engineering and computer science at UC Berkeley and director of UC Berkeley’s Institute of Transportation Studies. CIRCLES is based on a software framework called Flow, developed by Bayen’s team of students and post-doctoral researchers. 

    Flow is a first-of-its-kind software framework allowing researchers to discover and benchmark schemes for optimizing traffic. Using a state-of-the-art open-source microsimulator, Flow can simulate hundreds of thousands of vehicles – some driven by humans, others autonomous – driving in custom traffic scenarios.

    “The potential for cities is enormous,” said Bayen. “Experiments have shown that the energy savings with just a small percentage of vehicles on the road being autonomous can be huge. And we can improve it even further with our algorithms.” 

    Flow was launched in 2017 and released to the public in September, and the benchmarks are being released this month. With funding from the Laboratory Directed Research and Development program, Bayen and his team will use Flow to design, test, and deploy the first connected and autonomous vehicle (CAV)-enabled system to actively reduce stop-and-go phantom traffic jams on freeways.

    How reinforcement learning can reduce congestion 

    Some of the current research into using autonomous vehicles to smooth traffic was inspired by a simple experiment done by Japanese researchers 10 years ago in which about 20 human drivers were instructed to drive in a ring at 20 mph. At first everyone is proceeding smoothly, but within 30 seconds, the traffic waves start and cars come to a standstill.

    “You have stop-and-go oscillation within less than a minute,” Bayen said. “This experiment led to hundreds if not thousands of research papers to try to explain what is happening.”

    A team of researchers led by Dan Work of Vanderbilt University repeated the same experiment last year but made one change: they added a single autonomous vehicle in the ring. As soon as the automation is turned on, the oscillations are immediately smoothed out.

    Why? “The automation essentially understands to not accelerate and catch up with the previous person – which would amplify the instability – but rather to behave as a flow pacifier, essentially smoothing down by restraining traffic so that it doesn’t amplify the instability,” Bayen said. 

    Deep reinforcement learning has been used to train computers to play chess and to teach a robot how to run an obstacle course. It trains by “taking observations of the system, and then iteratively trying out a bunch of actions, seeing if they’re good or bad, and then picking out which actions it should prioritize,” said Eugene Vinitsky, a graduate student working with Bayen and one of Flow’s developers.

    In the case of traffic, Flow trains vehicles to check what the cars directly in front of and behind them are doing. “It tries out different things – it can accelerate, decelerate, or change lanes, for example,” Vinitsky explained. “You give it a reward signal, like, was traffic stopped or flowing smoothly, and it tries to correlate what it was doing to the state of the traffic.”

    With the CIRCLES project, Bayen and his team plan to first run simulations to confirm that significant energy savings result from using the algorithms in autonomous vehicles. Next they will run a field test of the algorithm with human drivers responding to real-time commands.

    DeepAir

    The pollution project, named DeepAir (Deep Learning and Satellite Imaginary to Estimate Air Quality Impact at Scale), is led by Berkeley Lab researcher Marta Gonzalez, who is also a professor in UC Berkeley’s City & Regional Planning Department. In past research, she has used cell phone data to study how people move around cities and to recommend electric vehicle charging schemes to save energy and costs.

    For this project, she will take advantage of the power of deep learning algorithms to analyze satellite images combined with traffic information from cell phones and data already being collected by environmental monitoring stations. 

    “The novelty here is that while the environmental models, which show the interaction of pollutants with weather – such as wind speed, pressure, precipitation, and temperature – have been developed for years, there’s a missing piece,” Gonzalez said. “In order to be reliable, those models need to have good inventories of what’s entering the environment, such as emissions from vehicles and power plants.

    “We bring novel data sources such as mobile phones, integrated with satellite images. In order to process and interpret all this information, we use machine learning models applied to computer vision. The integration of information technologies to better understand complex natural system interactions at large scale is the innovative piece of DeepAir.” 

    The researchers anticipate that the resulting analysis will allow them to gain insights into the sources and distribution of pollutants, and ultimately allow for the design of more efficient and more timely interventions. For example, the Bay Area has “Spare the Air” days, in which traffic restrictions are voluntary, and other cities have schemes to restrict traffic or industry. 

    While the idea of using algorithms to control cars and traffic may sound incredible at the moment, Bayen believes technology is headed in that direction. “I do believe that within 10 years the things we’re coming up with here, like flow smoothing, will be standard practice, because there will be more automated vehicles on the road,” he said.

    # # #

    Lawrence Berkeley National Laboratory addresses the world’s most urgent scientific challenges by advancing sustainable energy, protecting human health, creating new materials, and revealing the origin and fate of the universe. Founded in 1931, Berkeley Lab’s scientific expertise has been recognized with 13 Nobel Prizes. The University of California manages Berkeley Lab for the U.S. Department of Energy’s Office of Science. For more, visit www.lbl.gov.

    DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov

    X
    X
    X
    • Filters

    • × Clear Filters

    Microbes Eat the Same in Labs and the Desert

    Analyses of natural communities forming soil crusts agree with laboratory studies of isolated microbe-metabolite relationships.

    Scientists Produce 3-D Chemical Maps of Single Bacteria

    Scientists at the National Synchrotron Light Source II (NSLS-II)--a U.S. Department of Energy (DOE) Office of Science User Facility at DOE's Brookhaven National Laboratory--have used ultrabright x-rays to image single bacteria with higher spatial resolution than ever before. Their work, published in Scientific Reports, demonstrates an x-ray imaging technique, called x-ray fluorescence microscopy (XRF), as an effective approach to produce 3-D images of small biological samples.

    Self-Sensing Materials Are Here

    Oak Ridge National Laboratory researchers invented a way to make a nanomaterial-embedded composite that is stronger than other fiber-reinforced composites and imbued with a new capability--the ability to monitor its own structural health.

    Diverse Biofeedstocks Have High Ethanol Yields and Offer Biorefineries Flexibility

    Evidence suggests that biorefineries can accept various feedstocks without negatively impacting the amount of ethanol produced per acre.

    Opening Access to Explore the Synthetic Chemistry of Neptunium

    New, easily prepared starting material opens access to learning more about a difficult-to-control element in nuclear waste.

    Symbiosis a Driver of Truffle Diversity

    Truffles are thought of as dining delicacies but they play an important role in soil ecosystem services as the fruiting bodies of the ectomycorrhizal (ECM) fungal symbionts residing on host plant roots. An international team sought insights into the ECM lifestyle of truffle-forming species through a comparative analysis of eight fungal genomes.

    Climate Simulations Project Wetter, Windier Hurricanes

    New supercomputer simulations by climate scientists at the Department of Energy's Lawrence Berkeley National Laboratory (Berkeley Lab) have shown that climate change intensified the amount of rainfall in recent hurricanes such as Katrina, Irma, and Maria by 5 to 10 percent. They further found that if those hurricanes were to occur in a future world that is warmer than present, those storms would have even more rainfall and stronger winds.

    Tiny Titanium Barrier Halts Big Problem in Fuel-Producing Solar Cells

    New design coats molecular components and dramatically improves stability under tough, oxidizing conditions.

    X-Rays Show How Periods of Stress Changed an Ice Age Hyena to the Bone

    An international team has unearthed what life might have been like for a now-extinct subspecies of spotted hyena. They found that despite their massive size, some cave hyenas experienced times of hardship that affected them to the bone, causing areas of arrested growth that appear as dark lines, like rings on a tree trunk.

    Turning Wood Scraps into Tape

    A new chemical process converts a component of wasted wood pulp and other biomass into high-value pressure-sensitive adhesives.


    • Filters

    • × Clear Filters

    Argonne's Min Si receives early career award from IEEE Computer Society

    Argonne's Min Si wins Award for Excellence for Early Career Researchers in High Performance Computing through the Institute of Electrical and Electronics Engineers.

    Jefferson Lab Director Appointed to Distinguished Professorship

    Stuart Henderson, director of the Department of Energy's Thomas Jefferson National Accelerator Facility, has been appointed the Governor's Distinguished CEBAF professor at Old Dominion University. The position is supported by the Commonwealth of Virginia and is named for the Continuous Electron Beam Accelerator Facility, which is the main research facility located at Jefferson Lab.

    DOE issues call for HPC for Energy Innovation proposals

    The U.S. Department of Energy's (DOE) High Performance Computing for Energy Innovation (HPC4EI) Initiative today issued its first joint solicitation for the High Performance Computing for Manufacturing Program (HPC4Mfg) and the High Performance Computing for Materials Program (HPC4Mtls).

    DOE funding advances project to turn captured CO2 into key chemicals

    The U.S. Department of Energy has selected Southern Research for an award of up to $1.5 million to advance technology for carbon dioxide utilization.

    Sierra Reaches Higher Altitudes, Takes Number Two Spot on List of Fastest Supercomputers

    Sierra, Lawrence Livermore National Laboratory's newest supercomputer, rose to second place on the list of the world's fastest computing systems, TOP500 List representatives announced Monday at the International Conference for High Performance Computing, Networking, Storage and Analysis conference (SC18) in Dallas.

    Green energy: Wind energy agreement will provide savings, 50 percent of electricity needs for Kansas State University Manhattan campus

    Kansas State University has signed an agreement with Westar Energy to provide approximately 50 percent of the energy needs for the university's main Manhattan campus from a wind farm in Nemaha County and save the university nearly $200,000 annually.

    INCITE grants awarded to 62 computational research projects

    The U.S. Department of Energy announced new projects for 2019 through its Innovative and Novel Computational Impact on Theory and Experiment (INCITE) program.

    Argonne's Raj Kettimuthu Named ACM Distinguished Member

    Argonne computer scientist Raj Kettimuthu recently was named a Distinguished Member of the Association for Computing Machinery for his development of tools to analyze and enhance end-to-end data transfer performance.

    Jefferson Lab-Affiliated Researchers Honored as APS Fellows

    The Department of Energy's Thomas Jefferson National Accelerator Facility now has a few more fellows on campus. The American Physical Society, a professional membership society that works on behalf of the physics community, recently announced its list of 2018 fellowships.

    Jefferson Lab Receives DOE Award for Energy Efficient Upgrade

    On Oct. 23, a team from the Department of Energy's Thomas Jefferson National Accelerator Facility was honored at the 2018 Federal Energy and Water Management Award Ceremony for upgrades made to the lab's data center, ultimately improving its energy efficiency.


    • Filters

    • × Clear Filters

    Microbes Eat the Same in Labs and the Desert

    Analyses of natural communities forming soil crusts agree with laboratory studies of isolated microbe-metabolite relationships.

    Diverse Biofeedstocks Have High Ethanol Yields and Offer Biorefineries Flexibility

    Evidence suggests that biorefineries can accept various feedstocks without negatively impacting the amount of ethanol produced per acre.

    Opening Access to Explore the Synthetic Chemistry of Neptunium

    New, easily prepared starting material opens access to learning more about a difficult-to-control element in nuclear waste.

    Tiny Titanium Barrier Halts Big Problem in Fuel-Producing Solar Cells

    New design coats molecular components and dramatically improves stability under tough, oxidizing conditions.

    Turning Wood Scraps into Tape

    A new chemical process converts a component of wasted wood pulp and other biomass into high-value pressure-sensitive adhesives.

    Very Heavy Elements Deliver More Electrons

    Scientists revise understanding of the limits of bonding for very electron-rich heavy elements.

    Probing Water's "No-Man's Land" Temperature Region

    Measuring the physical properties of water at previously unexplored temperatures offers insights into one of the world's essential liquids.

    Novel Soil Bacteria with Unusual Genes Synthesize Unique Antibiotic Precursors

    A large-scale soil project uncovered genetic information from bacteria with the capacity to make specialized molecules that could lead to new pharmaceuticals.

    Warmer Temperatures Lengthen Growing Season, Increase Plants' Vulnerability to Frost

    Experimental warming treatments show how peatland forests may respond to future environmental change.

    Rising Stars Seek to Learn from the Master: Mother Nature

    A trio of scientists was recognized for their early career successes in uncovering how microbes produce fuel, insights that could change our energy portfolio


    Spotlight

    Thursday October 11, 2018, 04:00 PM

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices

    Rensselaer Polytechnic Institute (RPI)

    Wednesday October 03, 2018, 07:05 PM

    Innovating Our Energy Future

    Oregon State University, College of Engineering

    Tuesday October 02, 2018, 03:05 PM

    Physics graduate student takes her thesis research to a Department of Energy national lab

    University of Alabama at Birmingham

    Friday September 21, 2018, 01:05 PM

    "Model" students enjoy Argonne campus life

    Argonne National Laboratory

    Thursday September 06, 2018, 01:05 PM

    Writing Code for a More Skilled and Diverse STEM Workforce

    Brookhaven National Laboratory

    Tuesday September 04, 2018, 11:30 AM

    New graduate student summer school launches at Princeton Plasma Physics Laboratory

    Princeton Plasma Physics Laboratory

    Friday August 31, 2018, 06:05 PM

    The Gridlock State

    California State University (CSU) Chancellor's Office

    Friday August 31, 2018, 02:05 PM

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson

    Brookhaven National Laboratory

    Friday August 24, 2018, 11:05 AM

    Argonne hosts Modeling, Experimentation and Validation Summer School

    Argonne National Laboratory

    Wednesday August 22, 2018, 01:05 PM

    Students affected by Hurricane Maria bring their research to SLAC

    SLAC National Accelerator Laboratory

    Wednesday August 22, 2018, 10:05 AM

    Brookhaven Lab Pays Tribute to 2018 Summer Interns

    Brookhaven National Laboratory

    Monday August 20, 2018, 12:05 PM

    Changing How Buildings Are Made

    Washington University in St. Louis

    Thursday August 16, 2018, 12:05 PM

    CSUMB Selected to Host Architecture at Zero Competition in 2019

    California State University, Monterey Bay

    Friday July 20, 2018, 03:00 PM

    Department of Energy Invests $64 Million in Advanced Nuclear Technology

    Rensselaer Polytechnic Institute (RPI)

    Thursday July 19, 2018, 05:00 PM

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

    Rensselaer Polytechnic Institute (RPI)

    Tuesday July 03, 2018, 11:05 AM

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

    Brookhaven National Laboratory

    Friday June 29, 2018, 06:05 PM

    Argonne welcomes The Martian author Andy Weir

    Argonne National Laboratory

    Monday June 18, 2018, 09:55 AM

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

    Illinois Mathematics and Science Academy (IMSA)

    Friday June 15, 2018, 10:00 AM

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

    Rensselaer Polytechnic Institute (RPI)

    Thursday June 07, 2018, 03:05 PM

    Celebrating 40 years of empowerment in science

    Argonne National Laboratory

    Monday May 07, 2018, 10:30 AM

    Introducing Graduate Students Across the Globe to Photon Science

    Brookhaven National Laboratory

    Wednesday May 02, 2018, 04:05 PM

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

    Department of Energy, Office of Science

    Thursday April 12, 2018, 07:05 PM

    The Race for Young Scientific Minds

    Argonne National Laboratory

    Wednesday March 14, 2018, 02:05 PM

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

    SLAC National Accelerator Laboratory

    Thursday February 15, 2018, 12:05 PM

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

    University of Virginia Darden School of Business

    Friday February 09, 2018, 11:05 AM

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

    California State University, Channel Islands

    Wednesday January 17, 2018, 12:05 PM

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

    Fermi National Accelerator Laboratory (Fermilab)

    Wednesday January 17, 2018, 12:05 PM

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

    Fermi National Accelerator Laboratory (Fermilab)

    Wednesday December 20, 2017, 01:05 PM

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

    SLAC National Accelerator Laboratory

    Monday December 18, 2017, 01:05 PM

    The Future of Today's Electric Power Systems

    Rensselaer Polytechnic Institute (RPI)

    Monday December 18, 2017, 12:05 PM

    Supporting the Development of Offshore Wind Power Plants

    Rensselaer Polytechnic Institute (RPI)

    Tuesday October 03, 2017, 01:05 PM

    Stairway to Science

    Argonne National Laboratory

    Thursday September 28, 2017, 12:05 PM

    After-School Energy Rush

    Argonne National Laboratory

    Thursday September 28, 2017, 10:05 AM

    Bringing Diversity Into Computational Science Through Student Outreach

    Brookhaven National Laboratory

    Thursday September 21, 2017, 03:05 PM

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

    SLAC National Accelerator Laboratory

    Thursday September 07, 2017, 02:05 PM

    Students Discuss 'Cosmic Opportunities' at 45th Annual SLAC Summer Institute

    SLAC National Accelerator Laboratory

    Thursday August 31, 2017, 05:05 PM

    Binghamton University Opens $70 Million Smart Energy Building

    Binghamton University, State University of New York

    Wednesday August 23, 2017, 05:05 PM

    Widening Horizons for High Schoolers with Code

    Argonne National Laboratory

    Saturday May 20, 2017, 12:05 PM

    Rensselaer Polytechnic Institute Graduates Urged to Embrace Change at 211th Commencement

    Rensselaer Polytechnic Institute (RPI)

    Monday May 15, 2017, 01:05 PM

    ORNL, University of Tennessee Launch New Doctoral Program in Data Science

    Oak Ridge National Laboratory

    Friday April 07, 2017, 11:05 AM

    Champions in Science: Profile of Jonathan Kirzner

    Department of Energy, Office of Science

    Wednesday April 05, 2017, 12:05 PM

    High-Schooler Solves College-Level Security Puzzle From Argonne, Sparks Interest in Career

    Argonne National Laboratory

    Tuesday March 28, 2017, 12:05 PM

    Champions in Science: Profile of Jenica Jacobi

    Department of Energy, Office of Science

    Friday March 24, 2017, 10:40 AM

    Great Neck South High School Wins Regional Science Bowl at Brookhaven Lab

    Brookhaven National Laboratory

    Wednesday February 15, 2017, 04:05 PM

    Middle Schoolers Test Their Knowledge at Science Bowl Competition

    Argonne National Laboratory





    Showing results

    0-4 Of 2215