Doe Science news source
The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
  • 2018-04-06 10:05:58
  • Article ID: 692364

Accelerating Scientific Discovery Through Code Optimization on Many-Core Processors

Brookhaven Lab hosted a hackathon for research and computational scientists, code developers, and computing hardware experts to optimize scientific application codes for high-performance computing

  • Credit: Brookhaven National Laboratory

    At the Brookhaven Lab-hosted Xeon Phi hackathon, (left to right) mentor Bei Wang, a high-performance-computing software engineer at Princeton University; mentor Hideki Saito, a principal engineer at Intel; and participant Han Aung, a graduate student in the Department of Physics at Yale University, optimize an application code that simulates the formation of structures in the universe. Aung and his fellow team members sought to increase the numerical resolution of their simulations so they can more realistically model the astrophysical processes in galaxy clusters.

  • Credit: NERSC

    Cori is a supercomputer that is named after Gerty Cori, the first American woman to win a Nobel Prize in science. Credit: NERSC.

  • Credit: Brookhaven National Laboratory

    Xinmin Tian, a senior principal engineer at Intel, gives a presentation on vector programming to help the teams optimize their scientific codes for the Xeon Phi processors.

  • Credit: Sergey Madaminov, Stony Brook University

    One hackathon team worked on taking advantage of the high-bandwidth memory in Xeon Phi processors to optimize their code to more quickly sort datasets of increasing size. The team members applied smart algorithms that split the original data into "blocks" (equally sized chunks), which are moved into "buckets" (sets of elements) that can fit inside high-bandwidth memory for sorting, as shown in the illustration.

  • Credit: Intel

    The Intel Xeon Phi processor is patterned using a 14-nanometer (nm) lithography process. The 14 nm refers to the size of the transistors on the chip—only 14 times wider than DNA molecules.

Supercomputers are enabling scientists to study problems they could not otherwise tackle—from understanding what happens when two black holes collide and figuring out how to make tiny carbon nanotubes that clean up oil spills to determining the binding sites of proteins associated with cancer. Such problems involve datasets that are too large or complex for human analysis.

In 2016, Intel released the second generation of its many-integrated-core architecture targeting high-performance-computing (HPC): the Intel Xeon Phi processor (formerly code-named “Knights Landing”). With up to 72 processing units, or cores, per chip, Xeon Phi is designed to carry out multiple calculations at the same time (in parallel). This architecture is ideal for handling the large, complex computations that are characteristic of scientific applications.

Other features that make Xeon Phi appealing for such applications include its fast memory access; its ability to simultaneously execute multiple processes, or threads, that follow the same instructions while sharing some computing resources (multithreading); and its support of efficient vectorization, a form of parallel programming in which the processor performs the same operation on multiple elements (vectors) of independent data in a single processing cycle. All of these features can greatly enhance performance, enabling scientists to solve problems more quickly and with greater efficiency than ever before.

Making the most out of Xeon Phi 

Currently, several supercomputers in the United States are based on Intel’s Xeon Phi processors, including Cori at the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy (DOE) Office of Science User Facility at Lawrence Berkeley National Laboratory; Theta at Argonne Leadership Computing Facility, another DOE Office of Science User Facility; and Stampede2 at the University of Texas at Austin’s Texas Advanced Computing Center. Smaller-scale systems, such as the computing cluster at DOE’s Brookhaven National Laboratory, also rely on this architecture. But in order to take full advantage of its capabilities, users need to adapt and optimize their applications accordingly.

To facilitate that process, Brookhaven Lab’s Computational Science Initiative (CSI) hosted a five-day coding marathon, or hackathon, in partnership with the High-Energy Physics (HEP) Center for Computational Excellence—which Brookhaven joined last July—and collaborators from the SOLLVE software development project funded by DOE’s Exascale Computing Project.

“The goal of this hands-on workshop was to help participants optimize their application codes to exploit the different levels of parallelism and memory hierarchies in the Xeon Phi architecture,” said CSI computational scientist Meifeng Lin, who co-organized the hackathon with CSI Director Kerstin Kleese van Dam, CSI Computer Science and Mathematics Department Head Barbara Chapman, and CSI computational scientist Martin Kong. “By the end of the hackathon, the participants had not only made their codes run more efficiently on Xeon Phi–based systems, but also learned about strategies that could be applied to other CPU [central processing unit]-based systems to improve code performance.”

Last year, Lin was part of the committee that organized Brookhaven’s first hackathon, at which teams learned how to program their scientific applications on computing devices called graphics processing units (GPUs). As was the case for that hackathon, this one was open to any current or potential user of the hardware. In the end, five teams of three to four members each—representing Brookhaven Lab, the Institute for Mathematical Sciences in India, McGill University, Stony Brook University, University of Miami, University of Washington, and Yale University—were accepted to participate in the Intel Xeon Phi hackathon. 

Expanding the possibilities for scientific breakthroughs

From February 26 through March 2, nearly 20 users of Xeon Phi–based supercomputers came together at Brookhaven Lab to be mentored by computing experts from Brookhaven and Lawrence Berkeley national labs, Indiana University, Princeton University, University of Bielefeld in Germany, and University of California–Berkeley. The hackathon organizing committee selected the mentors based on their experience in Xeon Phi optimization and shared-memory parallel programming with the OpenMP (for Multi-Processing) industry standard.

Participants did not need to have prior Xeon Phi experience to attend. Several weeks prior to the hackathon, the teams were assigned to mentors with scientific backgrounds relevant to the respective application codes. The mentors and teams then held a series of meetings to discuss the limitations of their existing codes and goals at the hackathon. In addition to their specific mentors, the teams had access to four Intel technical experts with backgrounds in programming and scientific domains. These Intel experts served as floating mentors during the event to provide expertise in hardware architecture and performance optimization. 

“The hackathon provided an excellent opportunity for application developers to talk and work with Intel experts directly,” said mentor Bei Wang, a HPC software engineer at Princeton University. “The result was a significant speed up in the time it takes to optimize code, thus helping application teams achieve their science goals at a faster pace. Events like this hackathon are of great value to both scientists and vendors.”

The five codes that were optimized cover a wide variety of applications:

  • A code for tracking particle-device and particle-particle interactions that has the potential to be used as the design platform for future particle accelerators
  • A code for simulating the evolution of the quark-gluon plasma (a hot, dense state of matter thought to have been present for a few millionths of a second after the Big Bang) produced through high-energy collisions at Brookhaven’s Relativistic Heavy Ion Collider (RHIC)—a DOE Office of Science User Facility
  • An algorithm for sorting records from databases, such as DNA sequences to identify inherited genetic variations and disorders
  • A code for simulating the formation of structures in the universe, particularly galaxy clusters
  • A code for simulating the interactions between quarks and gluons in real time 

“Large-scale numerical simulations are required to describe the matter created at the earliest times after the collision of two heavy ions,” said team member Mark Mace, a PhD candidate in the Nuclear Theory Group in the Physics and Astronomy Department at Stony Brook University and the Nuclear Theory Group in the Physics Department at Brookhaven Lab. “My team had a really successful week—we were able to make our code run much faster (20x), and this improvement is a game changer as far as the physics we can study with the resources we have. We will now be able to more accurately describe the matter created after heavy-ion collisions, study a larger array of macroscopic phenomena observed in such collisions, and make quantitative predictions for experiments at RHIC and the Large Hadron Collider in Europe.”

“With the new memory subsystem recently released by Intel, we can order a huge number of elements faster than with conventional memory because more data can be transferred at a time,” said team member Sergey Madaminov, who is pursuing his PhD in computer science in the Computer Architecture at Stony Brook (COMPAS) Lab at Stony Brook University. “However, this high-bandwidth memory is physically located close to the processor, limiting its capacity. To mitigate this limitation, we apply smart algorithms that split data into smaller chunks that can then fit into high-bandwidth memory and be sorted inside it. At the hackathon, our goal was to demonstrate our theoretical results—our algorithms speed up sorting—in practice. We ended up finding many weak places in our code and were able to fix them with the help of our mentor and experts from Intel, improving our initial code more than 40x. With this improvement, we expect to sort much larger datasets faster.”

According to Lin, the hackathon was highly successful—all five teams improved the performance of their codes, achieving from 2x to 40x speedups.

“It is expected that Intel Xeon Phi–based computing resources will continue operating until the next-generation exascale computers come online,” said Lin. “It is important that users can make these systems work to their full potential for their specific applications.”

Brookhaven National Laboratory is supported by the Office of Science of the U.S. Department of Energy. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.

Follow @BrookhavenLab on Twitter or find us on Facebook.

X
X
X
  • Filters

  • × Clear Filters

Light-Emitting Nanoparticles Could Provide a Safer Way to Image Living Cells

A research team has demonstrated how light-emitting nanoparticles, developed at Berkeley Lab, can be used to see deep in living tissue. Researchers hope they can be made to attach to specific components of cells to serve in an advanced imaging system that can pinpoint even single cancer cells.

Demonstrated Natural Refrigerant Replacements Could Reduce Energy Costs and Conserve the Environment

The 1987 Montreal Protocol and the 1997 Kyoto Protocol called for countries around the world to phase out substances that deplete the ozone layer and cause global warming, but many HVAC systems still use synthetic refrigerants that violate those international agreements and inflict environmental damage. Recently, Iranian researchers investigated how natural refrigerants could be used in geothermal heat pumps to reduce energy consumption and operating costs. They report their findings in the Journal of Renewable and Sustainable Energy.

The Behavior of Water: Scientists Find New Properties of H2O

A team of scientists has uncovered new molecular properties of water--a discovery of a phenomenon that had previously gone unnoticed.

Algorithm Provides Early Warning System for Tracking Groundwater Contamination

Scientists at the Department of Energy's Lawrence Berkeley National Laboratory (Berkeley Lab) and Savannah River National Laboratory have developed a low-cost method for real-time monitoring of pollutants using commonly available sensors.

Protons Get Zippier in Neutron-Rich Nuclei

A new study carried out at the Department of Energy's Thomas Jefferson National Accelerator Facility has confirmed that increasing the number of neutrons as compared to protons in the atom's nucleus also increases the average momentum of its protons. The nuclear physics result, which has implications for the dynamics of neutron stars, has been published in the journal Nature.

Sight Unseen: Novel Method Detects Evidence of Unmarked Human Graves

A new approach to find unmarked gravesites could help narrow the scope and potentially speed up the search for clues during crime scene investigations. Geospatial researchers with the Department of Energy's Oak Ridge National Laboratory and forensic scientists at University of Tennessee used LIDAR to detect telltale signs of recently buried human remains.

UT-ORNL team makes first particle accelerator beam measurement in six dimensions

The first full characterization measurement of an accelerator beam in six dimensions will advance the understanding and performance of current and planned accelerators around the world.

For UW Physicists, the 2-D Form of Tungsten Ditelluride Is Full of Surprises

In a paper published online July 23 in Nature, a UW-led research team reports that the 2-D form of tungsten ditelluride can undergo "ferroelectric switching" -- a first for a exfoliated 2-D material. Ferroelectric materials can have applications in memory storage, capacitors, RFID card technologies and even medical sensors.

Scientists Discover How to Protect Yeast From Damage in Biofuel Production

Some chemicals used to speed up the breakdown of plants for production of biofuels like ethanol are poison to the yeasts that turn the plant sugars into fuel. Researchers from the University of Wisconsin-Madison and several Department of Energy laboratories have identified two changes to a single gene that can make the yeast tolerate the pretreatment chemicals.

Lining Up the Surprising Behaviors of a Superconductor with One of the World's Strongest Magnets

Scientists have discovered that the electrical resistance of this material changes in an unusual way under very high magnetic fields--a finding that could help direct the search for materials that can perfectly conduct electricity at room temperature.


  • Filters

  • × Clear Filters

DOE funds 13 projects under fifth round of HPC4Manufacturing Progaram

Lawrence Livermore National Laboratory (LLNL), which manages the High Performance Computing for Manufacturing (HPC4Mfg) Program to use supercomputers to advance U.S. manufacturing, today announced the U.S. Department of Energy (DOE) has awarded nearly $3.8 million for 13 industry projects under the program.

Four Argonne transportation and fuel experts collect Dept. of Energy honors

Four researchers at the U.S. Department of Energy's (DOE) Argonne National Laboratory have earned Distinguished Achievement awards for helping to reimagine transportation, sustainability and mobility.

From Hurricane Katrina Victim to Presidential Awardee: A SUNO Professor's Award-Winning Mentoring Efforts

Undergraduate students of Southern University at New Orleans (SUNO) biology professor Murty Kambhampati come to Brookhaven Lab during the summer to conduct research in natural resource management.

SNS completes full neutron production cycle at record power level

The Spallation Neutron Source at Oak Ridge National Laboratory has reached a new milestone by operating a complete neutron production run cycle at 1.3 megawatts. Achieving the record power level with a remarkable 94 percent accelerator beam availability establishes a new baseline of operation as well as a path to operate reliably at higher powers. Increased power offers researchers the ability to conduct faster scientific analyses using neutrons on more types of materials.

Milsmann earns prestigious NSF CAREER Award

Carsten Milsmann, assistant professor in the C. Eugene Bennett Department of Chemistry at West Virginia University, has earned the National Science Foundation's prestigious CAREER Award for research that could help develop solar energy applications that are more efficient and cheaper to produce.

46th annual SLAC Summer Institute celebrates Standard Model at 50

The event attracted 124 participants and explores the successes and challenges of the theory that describes subatomic particles and fundamental forces.

UW, PNNL to host energy research center focusing on bio-inspired design and assembly

The U.S. Department of Energy has awarded an expected $10.75 million, four-year grant to the University of Washington, the Pacific Northwest National Laboratory and other partner institutions for a new interdisciplinary research center to define the enigmatic rules governing how molecular-scale building blocks assemble into ordered structures & hierarchical materials.

Argonne among 10 recipients of competitive grant for ultrafast science

Argonne has been awarded U.S. Department of Energy funds to probe materials and chemical processes on time scales of a quadrillionth of a second or less.

One cool camera: LSST's cryostat assembly completed

Work on the camera for the future Large Synoptic Survey Telescope (LSST) has reached a major milestone with the completion and delivery of the camera's fully integrated cryostat. With 3.2 gigapixels, the LSST camera will be the largest digital camera ever built for ground-based astronomy. It's being assembled at the Department of Energy's SLAC National Accelerator Laboratory.

Risa Wechsler named director of KIPAC

Risa Wechsler has been appointed director of the Kavli Institute for Particle Astrophysics and Cosmology (KIPAC), a joint institute of the Department of Energy's SLAC National Accelerator Laboratory and Stanford University. On Sept. 15, she'll take over from Tom Abel, whose five-year term at the helm of the institute is coming to an end.


  • Filters

  • × Clear Filters

Deep Learning Stretches Up to Scientific Supercomputers

Collaboration powers machine learning software that performs data analytics on petabyte-sized data sets in series of successful test runs.

Complex Networks Identify Genes for Biofuel Crops

Systems biology leads the way to exascale computing on Summit supercomputer.

Quantum Computing of an Atomic Nucleus

The first-ever computation of an atomic nucleus, the deuteron, on a quantum chip demonstrates that even today's rudimentary quantum computers can solve nuclear physics questions.

New Approach Yields High-Purity Radium for Medical Applications

Proton-irradiated thorium targets are successfully mined for therapeutic radium isotopes.

Steering Light with Dynamic Lens-on-MEMS

Scientists add active control to design capabilities for new lightweight flat optical devices.

Sugar-Coated Sheets Selectively Target Pathogens

Researchers design self-assembling nanosheets that mimic the surface of cells.

Tracking Down Helium-4's Quarks and Gluons

Scientists obtain the first exclusive measurement of deeply virtual Compton scattering of electrons off helium-4, vital to obtaining an unambiguous 3-D view of quarks and gluons within nuclei.

Predicting Magnetic Explosions: From Plasma Current Sheet Disruption to Fast Magnetic Reconnection

Supercomputer simulations and theoretical analysis shed new light on when and how fast reconnection occurs.

Is Nature Exclusively Left Handed? Using Chilled Atoms to Find Out

Elegant techniques of trapping and polarizing atoms open vistas for beta-decay tests of fundamental symmetries, key to understanding the most basic forces and particles constituting our universe.

As Future Batteries, Hybrid Supercapacitors Are Super-Charged

A new supercapacitor could be a competitive alternative to lithium-ion batteries.


Spotlight

Friday July 20, 2018, 03:00 PM

Department of Energy Invests $64 Million in Advanced Nuclear Technology

Rensselaer Polytechnic Institute (RPI)

Thursday July 19, 2018, 05:00 PM

Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

Rensselaer Polytechnic Institute (RPI)

Tuesday July 03, 2018, 11:05 AM

2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

Brookhaven National Laboratory

Friday June 29, 2018, 06:05 PM

Argonne welcomes The Martian author Andy Weir

Argonne National Laboratory

Monday June 18, 2018, 09:55 AM

Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

Illinois Mathematics and Science Academy (IMSA)

Friday June 15, 2018, 10:00 AM

Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

Rensselaer Polytechnic Institute (RPI)

Thursday June 07, 2018, 03:05 PM

Celebrating 40 years of empowerment in science

Argonne National Laboratory

Monday May 07, 2018, 10:30 AM

Introducing Graduate Students Across the Globe to Photon Science

Brookhaven National Laboratory

Wednesday May 02, 2018, 04:05 PM

Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

Department of Energy, Office of Science

Thursday April 12, 2018, 07:05 PM

The Race for Young Scientific Minds

Argonne National Laboratory

Wednesday March 14, 2018, 02:05 PM

Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

SLAC National Accelerator Laboratory

Thursday February 15, 2018, 12:05 PM

Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

University of Virginia Darden School of Business

Friday February 09, 2018, 11:05 AM

Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

California State University, Channel Islands

Wednesday January 17, 2018, 12:05 PM

Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

Fermi National Accelerator Laboratory (Fermilab)

Wednesday January 17, 2018, 12:05 PM

Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

Fermi National Accelerator Laboratory (Fermilab)

Wednesday December 20, 2017, 01:05 PM

Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

SLAC National Accelerator Laboratory

Monday December 18, 2017, 01:05 PM

The Future of Today's Electric Power Systems

Rensselaer Polytechnic Institute (RPI)

Monday December 18, 2017, 12:05 PM

Supporting the Development of Offshore Wind Power Plants

Rensselaer Polytechnic Institute (RPI)

Tuesday October 03, 2017, 01:05 PM

Stairway to Science

Argonne National Laboratory

Thursday September 28, 2017, 12:05 PM

After-School Energy Rush

Argonne National Laboratory

Thursday September 28, 2017, 10:05 AM

Bringing Diversity Into Computational Science Through Student Outreach

Brookhaven National Laboratory

Thursday September 21, 2017, 03:05 PM

From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

SLAC National Accelerator Laboratory

Thursday September 07, 2017, 02:05 PM

Students Discuss 'Cosmic Opportunities' at 45th Annual SLAC Summer Institute

SLAC National Accelerator Laboratory

Thursday August 31, 2017, 05:05 PM

Binghamton University Opens $70 Million Smart Energy Building

Binghamton University, State University of New York

Wednesday August 23, 2017, 05:05 PM

Widening Horizons for High Schoolers with Code

Argonne National Laboratory

Saturday May 20, 2017, 12:05 PM

Rensselaer Polytechnic Institute Graduates Urged to Embrace Change at 211th Commencement

Rensselaer Polytechnic Institute (RPI)

Monday May 15, 2017, 01:05 PM

ORNL, University of Tennessee Launch New Doctoral Program in Data Science

Oak Ridge National Laboratory

Friday April 07, 2017, 11:05 AM

Champions in Science: Profile of Jonathan Kirzner

Department of Energy, Office of Science

Wednesday April 05, 2017, 12:05 PM

High-Schooler Solves College-Level Security Puzzle From Argonne, Sparks Interest in Career

Argonne National Laboratory

Tuesday March 28, 2017, 12:05 PM

Champions in Science: Profile of Jenica Jacobi

Department of Energy, Office of Science

Friday March 24, 2017, 10:40 AM

Great Neck South High School Wins Regional Science Bowl at Brookhaven Lab

Brookhaven National Laboratory

Wednesday February 15, 2017, 04:05 PM

Middle Schoolers Test Their Knowledge at Science Bowl Competition

Argonne National Laboratory

Friday January 27, 2017, 04:00 PM

Haslam Visits ORNL to Highlight State's Role in Discovering Tennessine

Oak Ridge National Laboratory

Tuesday November 08, 2016, 12:05 PM

Internship Program Helps Foster Development of Future Nuclear Scientists

Oak Ridge National Laboratory

Friday May 13, 2016, 04:05 PM

More Than 12,000 Explore Jefferson Lab During April 30 Open House

Thomas Jefferson National Accelerator Facility

Monday April 25, 2016, 05:05 PM

Giving Back to National Science Bowl

Ames Laboratory

Friday March 25, 2016, 12:05 PM

NMSU Undergrad Tackles 3D Particle Scattering Animations After Receiving JSA Research Assistantship

Thomas Jefferson National Accelerator Facility

Tuesday February 02, 2016, 10:05 AM

Shannon Greco: A Self-Described "STEM Education Zealot"

Princeton Plasma Physics Laboratory

Monday November 16, 2015, 04:05 PM

Rare Earths for Life: An 85th Birthday Visit with Mr. Rare Earth

Ames Laboratory

Tuesday October 20, 2015, 01:05 PM

Meet Robert Palomino: 'Give Everything a Shot!'

Brookhaven National Laboratory

Tuesday April 22, 2014, 11:30 AM

University of Utah Makes Solar Accessible

University of Utah

Wednesday March 06, 2013, 03:40 PM

Student Innovator at Rensselaer Polytechnic Institute Seeks Brighter, Smarter, and More Efficient LEDs

Rensselaer Polytechnic Institute (RPI)

Friday November 16, 2012, 10:00 AM

Texas Tech Energy Commerce Students, Community Light up Tent City

Texas Tech University

Wednesday November 23, 2011, 10:45 AM

Don't Get 'Frosted' Over Heating Your Home This Winter

Temple University

Wednesday July 06, 2011, 06:00 PM

New Research Center To Tackle Critical Challenges Related to Aircraft Design, Wind Energy, Smart Buildings

Rensselaer Polytechnic Institute (RPI)

Friday April 22, 2011, 09:00 AM

First Polymer Solar-Thermal Device Heats Home, Saves Money

Wake Forest University





Showing results

0-4 Of 2215