Doe Science news source
The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
  • 2018-01-10 15:30:53
  • Article ID: 687793

ORNL Researchers Use Titan to Accelerate Design, Training of Deep Learning Networks

  • Credit: Image courtesy of Oak Ridge National Laboratory, U.S. Department of Energy. Photographed by Jason Richards

    ORNL’s Steven Young (left) and Travis Johnston used Titan to prove the design and training of deep learning networks could be greatly accelerated with a capable computing system.

OAK RIDGE, Tenn., Jan. 10, 2018 – A team of researchers from the Department of Energy’s Oak Ridge National Laboratory has married artificial intelligence and high-performance computing to achieve a peak speed of 20 petaflops in the generation and training of deep learning networks on the laboratory’s Titan supercomputer.

Deep learning is a burgeoning field of artificial intelligence that uses networks modeled after the human brain to “learn” how to distinguish features and patterns in vast datasets. Such networks hold great promise in the realization of numerous technologies, from self-driving cars to intelligent robots.

Due to its ability to make sense of massive amounts of data, researchers across the scientific spectrum are eager to refine deep learning and apply it to some of today’s most challenging science problems. One such effort is ORNL’s Advances in Machine Learning to Improve Scientific Discovery at Exascale and Beyond (ASCEND) project, which aims to use deep learning to make sense of the massive datasets produced by the world’s most sophisticated scientific experiments, such as those located at ORNL.

Analysis of such datasets generally requires existing neural networks to be modified, or novel networks designed and then “trained” so that they know precisely what to look for and can produce valid results.

This is a time-consuming and difficult task, but one that an ORNL team led by Robert Patton and including Steven Young and Travis Johnston recently demonstrated can be dramatically expedited with a capable computing system such as ORNL’s Titan, the nation’s fastest supercomputer for science.

To efficiently design neural networks capable of tackling scientific datasets and expediting breakthroughs, Patton’s team developed two codes for evolving (MENNDL) and fine-tuning (RAvENNA) deep neural network architectures.

Both codes can generate and train as many as 18,600 neural networks simultaneously. Peak performance can be estimated by randomly sampling, and then carefully profiling, several hundred of these independently trained networks.

Both codes achieved a peak performance of 20 petaflops, or 20 thousand trillion calculations per second, on Titan (or just under half of Titan’s single precision total peak performance). In practical terms, that translates to training 40-50,000 networks per hour.

“The real measure of success in the deep learning community is time-to-solution,” said Johnston. “And with a machine like Titan we are able to train an unparalleled number of highly accurate networks.”

Titan is a Cray hybrid system, meaning that it uses both traditional CPUs and graphics processing units (GPUs) to tackle complex calculations for big science problems efficiently; the GPUs also happen to be the processor of choice for training deep learning networks.

The team’s work demonstrates that with the right high-performance computing system researchers can efficiently train large numbers of networks, which can then be used to help them tackle today’s increasingly data-heavy experiments and simulations.

This efficient design of deep neural networks will enable researchers to deploy highly accurate, custom-designed models, saving both time and money by freeing the scientist from the task of designing a network from the ground up.

And because the OLCF’s next leadership computing system, Summit, features a deep-learning friendly architecture with enhanced GPUs and complementary Tensor cores, the team is confident both codes will only get faster.

“Out of the box, without tuning to Summit’s unique architecture, we are expecting an increase in performance up to 50 times,” said Johnston.

With that sort of network training capability, Summit could be indispensable to researchers across the scientific spectrum looking to deep learning to help them tackle some of science’s most immense challenges.

Patton’s team is not waiting for the improved hardware to start tackling current scientific data challenges; they have already deployed their codes to assist domain scientists at the Department of Energy’s Fermilab in Batavia, Illinois.

Researchers at Fermilab used MENNDL to better understand how neutrinos interact with ordinary matter by producing a classification network to support their Main Injector Experiment for v-A (MINERvA), a neutrino scattering experiment. The task, known as vertex reconstruction, required a network to analyze images and precisely identify the location where neutrinos interact with one of many targets—a task akin to finding the aerial source of a starburst of fireworks.

In only 24 hours, MENNDL produced optimized networks that outperformed any previously handcrafted network—an achievement that could easily have taken scientists months to accomplish. To identify the high-performing network, MENNDL evaluated approximately 500,000 neural networks, training them on a data set consisting of 800,000 images of neutrino events, steadily using 18,000 of Titan’s nodes.

“You need something like MENNDL to explore this effectively infinite space of possible networks, but you want to do it efficiently,” Young said. “What Titan does is bring the time to solution down to something practical.”

And with Summit to come online this year, the future of deep learning in big science looks bright indeed.

The ASCEND project is funded by DOE’s Office of Science and led by ORNL’s Thomas Potok, group lead for the Computational Data Analytics (CDA) group. Titan is part of the Oak Ridge Leadership Computing Facility, a DOE Office of Science User Facility.

UT-Battelle manages ORNL for DOE’s Office of Science. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit http://science.energy.gov/.

X
X
X
  • Filters

  • × Clear Filters

Columbia Researchers Squeeze Light into Nanoscale Devices and Circuits

Columbia investigators have made a major breakthrough in nanophotonics research, with their invention of a novel "home-built" cryogenic near-field optical microscope that has enabled them to directly image, for the first time, the propagation and dynamics of graphene plasmons at variable temperatures down to negative 250 degrees Celsius. If researchers can harness this nanolight, they will be able to improve sensing, subwavelength waveguiding, and optical transmission of signals.

Self-Assembling 3D Battery Would Charge in Seconds

A cross-campus collaboration led by Ulrich Wiesner, professor of engineering at Cornell University, has resulted in a novel energy storage device architecture that has the potential for lightning-quick charges for electronic devices.

Understanding the Generation of Light-Induced Electrical Current in Atomically Thin Nanomaterials

Scientists added an imaging capability to Brookhaven Lab's Center for Functional Nanomaterials that could provide the optoelectronic information needed to improve the performance of devices for power generation, communications, data storage, and lighting.

Diamond 'Spin-Off' Tech Could Lead to Low-Cost Medical Imaging and Drug Discovery Tools

An international team led by scientists at Berkeley Lab and UC Berkeley discovered how to exploit defects in nanoscale and microscale diamonds and potentially enhance the sensitivity of magnetic resonance imaging and nuclear magnetic resonance systems while eliminating the need for their costly and bulky superconducting magnets.

PROSPECTing For Antineutrinos

The Precision Reactor Oscillation and Spectrum Experiment (PROSPECT) has completed installation of a novel antineutrino detector that will probe the possible existence of a new form of matter - sterile neutrinos.

How to Cope with Cases of Mistaken Identity: MINERvA's Tale of Pions and Neutrinos

Neutral pion production is a major character in a story of mistaken identity worthy of an Agatha Christie novel.

Perfecting the Noise-Canceling Neutrino Detector

MicroBooNE neutrino experiment cuts through the noise, clearing the way for signals made by the hard-to-detect particle.

Supersonic Waves May Help Electronics Beat the Heat

Researchers at the Department of Energy's Oak Ridge National Laboratory made the first observations of waves of atomic rearrangements, known as phasons, propagating supersonically through a vibrating crystal lattice--a discovery that may dramatically improve heat transport in insulators and enable new strategies for heat management in future electronics devices.

Riding Bacterium to the Bank

Jet fuel, pantyhose and plastic soda bottles are all products currently derived from petroleum. Sandia National Laboratories scientists have demonstrated a new technology based on bioengineered bacteria that makes it feasible to produce all three from renewable plant sources.

Flexible, Highly Efficient Multimodal Energy Harvesting

A piezoelectric ceramic foam supported by a flexible polymer support provides a 10-fold increase in the ability to harvest mechanical and thermal energy over standard piezo composites, according to Penn State researchers.


  • Filters

  • × Clear Filters

Power to the People

The University of Utah College of Engineering has received a $2 million grant to create a laboratory and develop new technology for communities with backup power sources, known as microgrids, so they can quickly and more securely operate in the event of a massive power outage due to a natural disaster or cyberattack.

The U. S. Department of Energy Announces $34 Million for Small Business Research and Development Grants

U.S. Energy Secretary Rick Perry announced that the Department of Energy will award 219 grants totaling $34 million to 183 small businesses in 41 states. Funded through DOE's Small Business Innovation Research (SBIR) and Small Business Technology Transfer (STTR) programs, today's selections are for Phase I research and development.

Raising the Heat to Lower the Cost of Solar Energy

Sandia National Laboratories will receive $10.5 million from the Department of Energy to research and design a cheaper and more efficient solar energy system.The work focuses on refining a specific type of utility-scale solar energy technology that uses mirrors to reflect and concentrate sunlight onto a receiver on a tower.

Solar Turbines, Inc. Selects Penn State to Establish Center of Excellence in Gas Turbines

After completing an extensive evaluation of institutions of higher learning in the United States and Europe, Solar Turbines Incorporated has chosen Penn State as a university partner to establish a center of excellence in gas turbines. The center involves numerous faculty across Penn State's College of Engineering.

ORNL Facility Receives American Nuclear Society's Historic Landmark Designation

The American Nuclear Society has designated the Radiochemical Engineering Development Center at the Department of Energy's Oak Ridge National Laboratory an ANS Nuclear Historic Landmark, recognizing more than 50 years of isotope production and nuclear fuel cycle research.

Steven Cowley named director of DOE's Princeton Plasma Physics Laboratory

Steven Cowley, a theoretical physicist and international authority on fusion energy, has been named director of the U.S. Department of Energy's (DOE) Princeton Plasma Physics Laboratory (PPPL), effective July 1.

Scientists Turn X-ray Laser Into World's Fastest Water Heater

Scientists have used a powerful X-ray laser at the Department of Energy's SLAC National Accelerator Laboratory to heat water from room temperature to 100,000 degrees Celsius in less than a tenth of a picosecond, or millionth of a millionth of a second.

PNNL Part of a New National Center for Near-Atomic Resolution of Biological Molecules

A collaboration between the Pacific Northwest National Laboratory and Oregon Health & Science University has been chosen as a national center for a Nobel Prize-winning method of imaging, cryo-electron microscopy, that is revolutionizing structural biology.

SLAC Will Open One of Three NIH National Service Centers for Cryo-Electron Microscopy

The National Institutes of Health announced today that it will establish a national service and training center for cryogenic electron microscopy research at the Department of Energy's SLAC National Accelerator Laboratory.

Planck Collaboration Wins 2018 Gruber Cosmology Prize

The Planck Team--including researchers in Lawrence Berkeley National Laboratory's (Berkeley Lab's) Computational Research and Physics divisions--have been awarded the 2018 Gruber Cosmology Prize.


  • Filters

  • × Clear Filters

The Secret to Measuring an Antineutrino's Energy

Scientists are developing better models that describe both neutrino and antineutrino data, which can offer insights into the nature of the universe.

How to Cope with Cases of Mistaken Identity: MINERvA's Tale of Pions and Neutrinos

Neutral pion production is a major character in a story of mistaken identity worthy of an Agatha Christie novel.

Perfecting the Noise-Canceling Neutrino Detector

MicroBooNE neutrino experiment cuts through the noise, clearing the way for signals made by the hard-to-detect particle.

Keeping Tabs on Polysulfides in Batteries

Optimizing lithium-sulfur battery electrolytes for long life.

Huge "Thermometer" Takes Temperatures of Tiny Samples

New spectroscopic technique measures heat in itty-bitty volumes that could reveal insights for electronics and energy technology.

Water, Water, Everywhere, but How Does It Flow?

Scientists use new X-ray technique to see how water moves at the molecular level.

Magnetized Plasmas That "Twist Light" Can Produce Powerful Microscopes and More

A non-twisting laser beam moving through magnetized plasma turns into an optical vortex that traps, rotates, and controls microscopic particles, opening new frontiers in imaging.

Whistling While You Work: Fusion Scientists Find Inspiration in Atmospheric Whistles

Just like lightning, fusion plasmas contain odd electromagnetic whistler waves that could control destructive electrons in fusion reactors.

Zero Tolerance in Tokamaks: Eliminating Small Instabilities Before They Become Disruptions

Energetic ions and beam heating cause or calm instabilities, depending on the tokamak's magnetic field.

MURR Becomes First Reactor Facility to Join DOE's Isotope Program

DOE and MURR partner to ensure scientists have access to essential research isotopes.


Spotlight

Monday May 07, 2018, 10:30 AM

Introducing Graduate Students Across the Globe to Photon Science

Brookhaven National Laboratory

Wednesday May 02, 2018, 04:05 PM

Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

Department of Energy, Office of Science

Thursday April 12, 2018, 07:05 PM

The Race for Young Scientific Minds

Argonne National Laboratory

Wednesday March 14, 2018, 02:05 PM

Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

SLAC National Accelerator Laboratory

Thursday February 15, 2018, 12:05 PM

Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

University of Virginia Darden School of Business

Friday February 09, 2018, 11:05 AM

Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

California State University, Channel Islands

Wednesday January 17, 2018, 12:05 PM

Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

Fermi National Accelerator Laboratory (Fermilab)

Wednesday January 17, 2018, 12:05 PM

Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

Fermi National Accelerator Laboratory (Fermilab)

Wednesday December 20, 2017, 01:05 PM

Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

SLAC National Accelerator Laboratory

Monday December 18, 2017, 01:05 PM

The Future of Today's Electric Power Systems

Rensselaer Polytechnic Institute (RPI)

Monday December 18, 2017, 12:05 PM

Supporting the Development of Offshore Wind Power Plants

Rensselaer Polytechnic Institute (RPI)

Tuesday October 03, 2017, 01:05 PM

Stairway to Science

Argonne National Laboratory

Thursday September 28, 2017, 12:05 PM

After-School Energy Rush

Argonne National Laboratory

Thursday September 28, 2017, 10:05 AM

Bringing Diversity Into Computational Science Through Student Outreach

Brookhaven National Laboratory

Thursday September 21, 2017, 03:05 PM

From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

SLAC National Accelerator Laboratory

Thursday September 07, 2017, 02:05 PM

Students Discuss 'Cosmic Opportunities' at 45th Annual SLAC Summer Institute

SLAC National Accelerator Laboratory

Thursday August 31, 2017, 05:05 PM

Binghamton University Opens $70 Million Smart Energy Building

Binghamton University, State University of New York

Wednesday August 23, 2017, 05:05 PM

Widening Horizons for High Schoolers with Code

Argonne National Laboratory

Saturday May 20, 2017, 12:05 PM

Rensselaer Polytechnic Institute Graduates Urged to Embrace Change at 211th Commencement

Rensselaer Polytechnic Institute (RPI)

Monday May 15, 2017, 01:05 PM

ORNL, University of Tennessee Launch New Doctoral Program in Data Science

Oak Ridge National Laboratory

Friday April 07, 2017, 11:05 AM

Champions in Science: Profile of Jonathan Kirzner

Department of Energy, Office of Science

Wednesday April 05, 2017, 12:05 PM

High-Schooler Solves College-Level Security Puzzle From Argonne, Sparks Interest in Career

Argonne National Laboratory

Tuesday March 28, 2017, 12:05 PM

Champions in Science: Profile of Jenica Jacobi

Department of Energy, Office of Science

Friday March 24, 2017, 10:40 AM

Great Neck South High School Wins Regional Science Bowl at Brookhaven Lab

Brookhaven National Laboratory

Wednesday February 15, 2017, 04:05 PM

Middle Schoolers Test Their Knowledge at Science Bowl Competition

Argonne National Laboratory

Friday January 27, 2017, 04:00 PM

Haslam Visits ORNL to Highlight State's Role in Discovering Tennessine

Oak Ridge National Laboratory

Tuesday November 08, 2016, 12:05 PM

Internship Program Helps Foster Development of Future Nuclear Scientists

Oak Ridge National Laboratory

Friday May 13, 2016, 04:05 PM

More Than 12,000 Explore Jefferson Lab During April 30 Open House

Thomas Jefferson National Accelerator Facility

Monday April 25, 2016, 05:05 PM

Giving Back to National Science Bowl

Ames Laboratory

Friday March 25, 2016, 12:05 PM

NMSU Undergrad Tackles 3D Particle Scattering Animations After Receiving JSA Research Assistantship

Thomas Jefferson National Accelerator Facility

Tuesday February 02, 2016, 10:05 AM

Shannon Greco: A Self-Described "STEM Education Zealot"

Princeton Plasma Physics Laboratory

Monday November 16, 2015, 04:05 PM

Rare Earths for Life: An 85th Birthday Visit with Mr. Rare Earth

Ames Laboratory

Tuesday October 20, 2015, 01:05 PM

Meet Robert Palomino: 'Give Everything a Shot!'

Brookhaven National Laboratory

Tuesday April 22, 2014, 11:30 AM

University of Utah Makes Solar Accessible

University of Utah

Wednesday March 06, 2013, 03:40 PM

Student Innovator at Rensselaer Polytechnic Institute Seeks Brighter, Smarter, and More Efficient LEDs

Rensselaer Polytechnic Institute (RPI)

Friday November 16, 2012, 10:00 AM

Texas Tech Energy Commerce Students, Community Light up Tent City

Texas Tech University

Wednesday November 23, 2011, 10:45 AM

Don't Get 'Frosted' Over Heating Your Home This Winter

Temple University

Wednesday July 06, 2011, 06:00 PM

New Research Center To Tackle Critical Challenges Related to Aircraft Design, Wind Energy, Smart Buildings

Rensselaer Polytechnic Institute (RPI)

Friday April 22, 2011, 09:00 AM

First Polymer Solar-Thermal Device Heats Home, Saves Money

Wake Forest University

Friday April 15, 2011, 12:25 PM

Like Superman, American University Will Get Its Energy from the Sun

American University

Thursday February 10, 2011, 05:00 PM

ARRA Grant to Help Fund Seminary Building Green Roof

University of Chicago

Tuesday December 07, 2010, 05:00 PM

UC San Diego Installing 2.8 Megawatt Fuel Cell to Anchor Energy Innovation Park

University of California San Diego

Monday November 01, 2010, 12:50 PM

Rensselaer Smart Lighting Engineering Research Center Announces First Deployment of New Technology on Campus

Rensselaer Polytechnic Institute (RPI)

Friday September 10, 2010, 12:40 PM

Ithaca College Will Host Regional Clean Energy Summit

Ithaca College

Tuesday July 27, 2010, 10:30 AM

Texas Governor Announces $8.4 Million Award to Create Renewable Energy Institute

Texas Tech University

Friday May 07, 2010, 04:20 PM

Creighton University to Offer New Alternative Energy Program

Creighton University

Wednesday May 05, 2010, 09:30 AM

National Engineering Program Seeks Subject Matter Experts in Energy

JETS Junior Engineering Technical Society

Wednesday April 21, 2010, 12:30 PM

Students Using Solar Power To Create Sustainable Solutions for Haiti, Peru

Rensselaer Polytechnic Institute (RPI)





Showing results

0-4 Of 2215