DOE News
    Doe Science news source
    The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
    • 2019-02-08 13:40:36
    • Article ID: 707798

    Argonne's Innovative Community Software Is on Weather Scientists' Radar

    • Credit: Image courtesy of the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Research Facility, Jason Tomlinson

      The ARM Climate Research Facility

    • Credit: Argonne National Laboratory

      This image shows the Radar Reflectivity Factor (proportional to both the number and size of raindrops) from the ARM User Facility’s X-Band Radar in Northern Oklahoma.

    In 2015, the Python-ARM Radar Toolkit (Py-ART) made its open-source debut. After 4 years, and with contributions from 34 individual editors, it is now a staple in radar science. The toolkit helps scientists analyze radar data to improve models of the Earth’s systems; its growth illustrates the power of community software.

    Py-ART is an architecture for working with radar data in the Python programming language. It ingests data from a wide variety of atmospheric radars to produce visualizations that enable users to draw meaningful conclusions. Institutions across the world — including the National Weather Service, MeteoSwiss, IBM and the University of Illinois — use Py-ART to organize and analyze radar data.

    Atmospheric scientist Scott Collis originally developed the software to retrieve environmental information from the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility’s diverse radar network, which consists of radars that output data in a range of formats. In 2012, Collis, who works at DOE’s Argonne National Laboratory, attended the Scientific Computing with Python Conference and, inspired by the open-source software he saw there, uploaded Py-ART to the community development platform GitHub.

    “The old software lived and died with a few people developing it in silos rather than bringing in users to contribute. Now radar science isn’t limited to large institutions that have people dedicated to looking after software — we’ve democratized working with radar data.” —  Scott Collis, Argonne atmospheric scientist

    “I wanted to put my code out there so that it grew organically to suit the needs of the community,” said Collis. “I took my ideas to ARM and they gave us the support we needed to release Py-ART.”

    The toolkit quickly grew in popularity with a range of third parties, including universities, military organizations, the private sector, meteorological agencies and national laboratories. As the number of users grew, so did the number of developers, resulting in an ecosystem of applications built on top of Py-ART.

    “Open-source software is better software,” said Collis, “and we at the DOE benefit from our users contributing code back to Py-ART because we can use it to meet the nation’s need for improved earth system modeling capabilities.”

    Py-ART is also increasing the number of people working with radar data. Before Py-ART, many institutions were working with complicated, outdated software that required very specialized environments to function. Py-ART, however, is easy to learn and can work on virtually any computer.

    “The old software lived and died with a few people developing it in silos rather than bringing in users to contribute,” said Collis. “Now radar science isn’t limited to large institutions that have people dedicated to looking after software — we’ve democratized working with radar data.” 

    Although originally intended to work with ARM’s radars, Py-ART has collected a suite of application-based codes that have attracted users across many disciplines.

    An example of the software’s usefulness is RELAMPAGO-CACTI (Remote sensing of Electrification, Lightning, And Mesoscale/microscale Processes with Adaptive Ground Observations – Clouds, Aerosols, and Complex Terrain Interactions), a field campaign studying the development and effects of thunderstorms in Argentina, funded by the National Science Foundation and DOE’s ARM facility. From November 1 to December 15, scientists collected and analyzed extensive data from radar in the La Planta River basin, the site of some of the world’s most intense storms.

    With Py-ART, scientists can merge information — like moisture levels or elevation and direction of antennae — from many types of radar whose data all come in different formats. The software can then use this information to produce real-time operational displays and 3-D maps to track and forecast the storms.

    When scientists better understand what leads to these storms, they can improve models to help predict storms in Argentina and other parts of the world.

    “Having a complete radar toolkit that syncs with many other Python plotting and numerical toolkits makes Py-ART a go-to resource for our research group,” said Professor Steve Nesbitt, a scientist and principal investigator on the RELAMPAGO-CACTI team. “Gone are the days of using tools that take hours to set up on each machine. Now we can be up and running in minutes on our own machines, on clusters and in the cloud.”

    Nesbitt is also an associate professor at the University of Illinois Urbana-Champaign, where he uses Py-ART for educational and research purposes. “Our research group uses Py-ART in many different ways, from visualizing weather data to doing advanced comparison of aircraft and radar data,” said Nesbitt, “and I have used Py-ART to teach several radar training courses.”

    Because Py-ART is open source, and U.S. weather radar data is openly available on the Amazon cloud, students can solve realistic research problems using the software. “Py-ART is a conduit for radar-specific science to reach people who might not be radar experts,” said Collis.

    Inspired by Py-ART’s success, scientists have launched the OpenRadar Partnership, an informal collaboration across Europe, Canada and the United States on open-source radar software education and inter-compatibility.

    Although scientists primarily use Py-ART to study and predict the weather, its applications are vast. The American Meteor Society, for example, is using Py-ART to develop techniques for locating land-falling meteorites using weather radar. Scientists have also used it in machine learning algorithms that track birds using radar data.

    Py-ART currently has more than 35,000 downloads; more than 50 published papers and theses have cited the software. It already powers several web pages, and its popularity and contributor community is growing.

    Virtually anyone can contribute to Py-ART, and Collis and the other editors keep a website to show updates to the code. They also have a mailing list, Twitter and Facebook pages.

    Py-ART is funded by the DOE Office of Science. ARM is a DOE Office of Science user facility.

    Argonne National Laboratory seeks solutions to pressing national problems in science and technology. The nation’s first national laboratory, Argonne conducts leading-edge basic and applied scientific research in virtually every scientific discipline. Argonne researchers work closely with researchers from hundreds of companies, universities, and federal, state and municipal agencies to help them solve their specific problems, advance America’s scientific leadership and prepare the nation for a better future. With employees from more than 60 nations, Argonne is managed by UChicago Argonne, LLC for the U.S. Department of Energy’s Office of Science.

    The U.S. Department of Energy’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States and is working to address some of the most pressing challenges of our time. For more information, visit the Office of Science website.

    • other-fb
    • other-tw
    X
    X
    X
    • Filters

    • × Clear Filters
    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Scientists discover an unexpected source of new materials, with potential for energy applications.

    A quick liquid flip helps explain how morphing materials store information

    A quick liquid flip helps explain how morphing materials store information

    Experiments at SLAC's X-ray laser reveal in atomic detail how two distinct liquid phases in these materials enable fast switching between glassy and crystalline states that represent 0s and 1s in memory devices.

    A New Manufacturing Process for Aluminum Alloys

    A New Manufacturing Process for Aluminum Alloys

    Using a novel Solid Phase Processing approach, a research team at Pacific Northwest National Laboratory eliminated several steps that are required during conventional extrusion processing of aluminum alloy powders, while also achieving a significant increase in product ductility. This is good news for sectors such as the automotive industry, where the high cost of manufacturing has historically limited the use of high-strength aluminum alloys made from powders.

    Flowing for Function

    Flowing for Function

    A flowing magnetically responsive liquid seamlessly regulates the shape and properties of solids, letting them perform an array of jobs.

    Science Snapshots: new nitrides, artificial photosynthesis, and TMDC semiconductors

    Science Snapshots: new nitrides, artificial photosynthesis, and TMDC semiconductors

    From Berkeley Lab: groundbreaking study maps out paths to new nitride materials; new framework for artificial photosynthesis; TMDCs don't have to be perfect to shine bright.

    Story Tips from the Department of Energy's Oak Ridge National Laboratory, June 17 2019

    Story Tips from the Department of Energy's Oak Ridge National Laboratory, June 17 2019

    ORNL story tips: New builders' tool by ORNL assesses design performance before construction begins; new pressure technique to manipulate magnetism in thin films could enhance electronic devices; ORNL outlines quantum sensing advances for better airport scanning, other applications.

    Superconducting Films for Particle Acceleration

    Superconducting Films for Particle Acceleration

    Researchers demonstrated record accelerating cavity performance using a technique that could lead to significant cost savings.

    Electron (or 'Hole') Pairs May Survive Effort to Kill Superconductivity

    Electron (or 'Hole') Pairs May Survive Effort to Kill Superconductivity

    Scientists seeking to understand the mechanism underlying superconductivity in "stripe-ordered" cuprates--copper-oxide materials with alternating areas of electric charge and magnetism--discovered an unusual metallic state when attempting to turn superconductivity off. They found that under the conditions of their experiment, even after the material loses its ability to carry electrical current with no energy loss, it retains some conductivity--and possibly the electron (or hole) pairs required for its superconducting superpower.

    Parceling Particle Beams

    Parceling Particle Beams

    Beam chopper cuts accelerator-generated ion beams under highly demanding conditions.

    An Interaction of Slipping Beams

    An Interaction of Slipping Beams

    Successful models of the fraught dynamics of two particle beams in close contact lead to smoother sailing in an area of particle acceleration.


    • Filters

    • × Clear Filters

    Energy Department to Invest $32 Million in Computer Design of Materials

    The U.S. Department of Energy announced that it will invest $32 million over the next four years to accelerate the design of new materials through use of supercomputers.

    Demarteau to head ORNL Physics Division

    Demarteau to head ORNL Physics Division

    The Department of Energy's Oak Ridge National Laboratory has named Marcel Demarteau as Physics Division Director, effective June 17.

    PPPL and Oak Ridge manage new DOE program designed to speed development of fusion energy with private-public partnerships

    PPPL and Oak Ridge manage new DOE program designed to speed development of fusion energy with private-public partnerships

    Feature describes PPPL role in innovative DOE program to promote public-private partnerships to speed development of fusion energy.

    ORNL welcomes seven new research fellows to Innovation Crossroads

    ORNL welcomes seven new research fellows to Innovation Crossroads

    Oak Ridge National Laboratory welcomed seven technology innovators to join the third cohort of Innovation Crossroads, the Southeast's only entrepreneurial research and development program based at a U.S. Department of Energy national laboratory.

    New DOE program connects fusion companies with national labs, taps ORNL to lead

    New DOE program connects fusion companies with national labs, taps ORNL to lead

    The Department of Energy has established the Innovation Network for Fusion Energy program, or INFUSE, to encourage private-public research partnerships for overcoming challenges in fusion energy development.

    Department of Energy Announces $75 Million for High Energy Physics Research

    The U.S. Department of Energy (DOE) announced $75 million in funding for 66 university research awards on a range of topics in high energy physics to advance knowledge of how the universe works at its most fundamental level.

    Ames Laboratory names James Morris Chief Research Officer

    Ames Laboratory names James Morris Chief Research Officer

    Dr. James Morris has been named Chief Research Officer at the Department of Energy's (DOE) Ames Laboratory. His appointment follows an extensive search and will be effective June 17, 2019.

    Four scientists at PPPL awarded national and international honors

    Four scientists at PPPL awarded national and international honors

    Feature profiles four PPPL scientists who have received high honors.

    Brookhaven's Mircea Cotlet Named a Battelle "Inventor of the Year"

    Brookhaven's Mircea Cotlet Named a Battelle "Inventor of the Year"

    The global science and technology organization Battelle recognized materials scientist Mircea Cotlet of Brookhaven Lab's Center for Functional Nanomaterials for his research in applying self-assembly methods to control the interfaces between nanomaterials and other light-interacting components.

    Berkeley Lab Project to Pinpoint Methane 'Super Emitters'

    Berkeley Lab Project to Pinpoint Methane 'Super Emitters'

    Methane, a potent greenhouse gas that traps about 30 times more heat than carbon dioxide, is commonly released from rice fields, dairies, landfills, and oil and gas facilities - all of which are plentiful in California. Now Berkeley Lab has been awarded $6 million by the state to find "super emitters" of methane in an effort to quantify and potentially mitigate methane emissions.


    • Filters

    • × Clear Filters
    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Found: New Bismuth Compounds in Well-Known Systems of Two Elements

    Scientists discover an unexpected source of new materials, with potential for energy applications.

    Flowing for Function

    Flowing for Function

    A flowing magnetically responsive liquid seamlessly regulates the shape and properties of solids, letting them perform an array of jobs.

    Superconducting Films for Particle Acceleration

    Superconducting Films for Particle Acceleration

    Researchers demonstrated record accelerating cavity performance using a technique that could lead to significant cost savings.

    Parceling Particle Beams

    Parceling Particle Beams

    Beam chopper cuts accelerator-generated ion beams under highly demanding conditions.

    An Interaction of Slipping Beams

    An Interaction of Slipping Beams

    Successful models of the fraught dynamics of two particle beams in close contact lead to smoother sailing in an area of particle acceleration.

    At DOE's Manufacturing Demonstration Facility, science drives next-gen creations

    At DOE's Manufacturing Demonstration Facility, science drives next-gen creations

    American ingenuity is providing radical productivity improvements from advanced materials and robotic systems developed at the Department of Energy's Manufacturing Demonstration Facility at Oak Ridge National Laboratory.

    Computer Simulation Shows Astrophysical Particle Acceleration

    Computer Simulation Shows Astrophysical Particle Acceleration

    Particles act in a way that justifies extrapolating simulation results to astrophysical scales.

    High-Fidelity Multiphysics Simulations to Improve Nuclear Reactor Safety and Economics

    High-Fidelity Multiphysics Simulations to Improve Nuclear Reactor Safety and Economics

    Engineers can model heat distribution in reactor designs with fewer or no approximations.

    Simulations Shed Light on Self-Healing Cement

    Simulations Shed Light on Self-Healing Cement

    A first-of-its-kind computer simulation reveals self-healing cement for geothermal and oil and gas wells performs better than originally thought.

    Solving a Beta Decay Puzzle

    Solving a Beta Decay Puzzle

    Researchers use advanced nuclear models to explain 50-year mystery surrounding the process stars use to transform elements.


    Spotlight

    ILSAMP Symposium showcases benefits for diverse students, STEM pipeline
    Monday May 20, 2019, 12:05 PM

    ILSAMP Symposium showcases benefits for diverse students, STEM pipeline

    Argonne National Laboratory

    Integrating Scientific Computing into Science Curricula
    Monday May 13, 2019, 11:05 AM

    Integrating Scientific Computing into Science Curricula

    Brookhaven National Laboratory

    Students from Minnesota and Massachusetts Win DOE's 29th National Science Bowl(r)
    Monday April 29, 2019, 02:05 PM

    Students from Minnesota and Massachusetts Win DOE's 29th National Science Bowl(r)

    Department of Energy, Office of Science

    DOE's Science Graduate Student Research Program Selects 70 Students to Pursue Research at DOE Laboratories
    Friday April 12, 2019, 03:05 PM

    DOE's Science Graduate Student Research Program Selects 70 Students to Pursue Research at DOE Laboratories

    Department of Energy, Office of Science

    Young Women's Conference in STEM seeks to change the statistics one girl at a time
    Thursday March 28, 2019, 03:05 PM

    Young Women's Conference in STEM seeks to change the statistics one girl at a time

    Princeton Plasma Physics Laboratory

    Students team with Argonne scientists and engineers to learn about STEM careers
    Tuesday March 12, 2019, 05:05 PM

    Students team with Argonne scientists and engineers to learn about STEM careers

    Argonne National Laboratory

    Lynbrook High wins 2019 SLAC Regional Science Bowl competition
    Wednesday February 13, 2019, 02:05 PM

    Lynbrook High wins 2019 SLAC Regional Science Bowl competition

    SLAC National Accelerator Laboratory

    Equipping the next generation for a technological revolution
    Thursday January 24, 2019, 01:05 PM

    Equipping the next generation for a technological revolution

    Argonne National Laboratory

    Chemistry intern inspired by Argonne's real-world science
    Friday January 18, 2019, 05:05 PM

    Chemistry intern inspired by Argonne's real-world science

    Argonne National Laboratory

    Chasing a supernova
    Friday January 18, 2019, 04:05 PM

    Chasing a supernova

    Argonne National Laboratory

    Argonne intern streamlines the beamline
    Tuesday January 08, 2019, 02:05 PM

    Argonne intern streamlines the beamline

    Argonne National Laboratory

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices
    Thursday October 11, 2018, 04:00 PM

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices

    Rensselaer Polytechnic Institute (RPI)

    Innovating Our Energy Future
    Wednesday October 03, 2018, 07:05 PM

    Innovating Our Energy Future

    Oregon State University, College of Engineering

    Physics graduate student takes her thesis research to a Department of Energy national lab
    Tuesday October 02, 2018, 03:05 PM

    Physics graduate student takes her thesis research to a Department of Energy national lab

    University of Alabama at Birmingham

    Friday September 21, 2018, 01:05 PM

    "Model" students enjoy Argonne campus life

    Argonne National Laboratory

    Writing Code for a More Skilled and Diverse STEM Workforce
    Thursday September 06, 2018, 01:05 PM

    Writing Code for a More Skilled and Diverse STEM Workforce

    Brookhaven National Laboratory

    New graduate student summer school launches at Princeton Plasma Physics Laboratory
    Tuesday September 04, 2018, 11:30 AM

    New graduate student summer school launches at Princeton Plasma Physics Laboratory

    Princeton Plasma Physics Laboratory

    The Gridlock State
    Friday August 31, 2018, 06:05 PM

    The Gridlock State

    California State University (CSU) Chancellor's Office

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson
    Friday August 31, 2018, 02:05 PM

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson

    Brookhaven National Laboratory

    Argonne hosts Modeling, Experimentation and Validation Summer School
    Friday August 24, 2018, 11:05 AM

    Argonne hosts Modeling, Experimentation and Validation Summer School

    Argonne National Laboratory

    Students affected by Hurricane Maria bring their research to SLAC
    Wednesday August 22, 2018, 01:05 PM

    Students affected by Hurricane Maria bring their research to SLAC

    SLAC National Accelerator Laboratory

    Brookhaven Lab Pays Tribute to 2018 Summer Interns
    Wednesday August 22, 2018, 10:05 AM

    Brookhaven Lab Pays Tribute to 2018 Summer Interns

    Brookhaven National Laboratory

    Changing How Buildings Are Made
    Monday August 20, 2018, 12:05 PM

    Changing How Buildings Are Made

    Washington University in St. Louis

    CSUMB Selected to Host Architecture at Zero Competition in 2019
    Thursday August 16, 2018, 12:05 PM

    CSUMB Selected to Host Architecture at Zero Competition in 2019

    California State University, Monterey Bay

    Department of Energy Invests $64 Million in Advanced Nuclear Technology
    Friday July 20, 2018, 03:00 PM

    Department of Energy Invests $64 Million in Advanced Nuclear Technology

    Rensselaer Polytechnic Institute (RPI)

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor
    Thursday July 19, 2018, 05:00 PM

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

    Rensselaer Polytechnic Institute (RPI)

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'
    Tuesday July 03, 2018, 11:05 AM

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

    Brookhaven National Laboratory

    Argonne welcomes <em>The Martian</em> author Andy Weir
    Friday June 29, 2018, 06:05 PM

    Argonne welcomes The Martian author Andy Weir

    Argonne National Laboratory

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy
    Monday June 18, 2018, 09:55 AM

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

    Illinois Mathematics and Science Academy (IMSA)

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research
    Friday June 15, 2018, 10:00 AM

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

    Rensselaer Polytechnic Institute (RPI)

    Celebrating 40 years of empowerment in science
    Thursday June 07, 2018, 03:05 PM

    Celebrating 40 years of empowerment in science

    Argonne National Laboratory

    Introducing Graduate Students Across the Globe to Photon Science
    Monday May 07, 2018, 10:30 AM

    Introducing Graduate Students Across the Globe to Photon Science

    Brookhaven National Laboratory

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)
    Wednesday May 02, 2018, 04:05 PM

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

    Department of Energy, Office of Science

    The Race for Young Scientific Minds
    Thursday April 12, 2018, 07:05 PM

    The Race for Young Scientific Minds

    Argonne National Laboratory

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond
    Wednesday March 14, 2018, 02:05 PM

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

    SLAC National Accelerator Laboratory

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week
    Thursday February 15, 2018, 12:05 PM

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

    University of Virginia Darden School of Business

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities
    Friday February 09, 2018, 11:05 AM

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

    California State University, Channel Islands

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018
    Wednesday January 17, 2018, 12:05 PM

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

    Fermi National Accelerator Laboratory (Fermilab)

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code
    Wednesday January 17, 2018, 12:05 PM

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

    Fermi National Accelerator Laboratory (Fermilab)

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom
    Wednesday December 20, 2017, 01:05 PM

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

    SLAC National Accelerator Laboratory

    The Future of Today's Electric Power Systems
    Monday December 18, 2017, 01:05 PM

    The Future of Today's Electric Power Systems

    Rensselaer Polytechnic Institute (RPI)

    Supporting the Development of Offshore Wind Power Plants
    Monday December 18, 2017, 12:05 PM

    Supporting the Development of Offshore Wind Power Plants

    Rensselaer Polytechnic Institute (RPI)

    Stairway to Science
    Tuesday October 03, 2017, 01:05 PM

    Stairway to Science

    Argonne National Laboratory

    After-School Energy Rush
    Thursday September 28, 2017, 12:05 PM

    After-School Energy Rush

    Argonne National Laboratory

    Bringing Diversity Into Computational Science Through Student Outreach
    Thursday September 28, 2017, 10:05 AM

    Bringing Diversity Into Computational Science Through Student Outreach

    Brookhaven National Laboratory

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM
    Thursday September 21, 2017, 03:05 PM

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

    SLAC National Accelerator Laboratory





    Showing results

    0-4 Of 2215