Doe Science news source
The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
  • 2018-06-05 12:05:14
  • Article ID: 695590

Berkeley Lab Paves the Way for Real-time Ptychographic Data Streaming

  • Credit: Berkeley Lab

    In scientific experiments, ptychographic imaging combines scanning microscopy with diffraction measurements to characterize the structure and properties of matter and materials. Advances in detectors and x-ray microscopes at light sources have made it possible to measure a ptychographic dataset in seconds.

What began nearly a decade ago as a Berkeley Lab Laboratory-Directed Research and Development (LDRD) proposal is now a reality, and it is already changing the way scientists run experiments at the Advanced Light Source (ALS)—and, eventually, other light sources across the Department of Energy (DOE) complex—by enabling real-time streaming of ptychographic image data in a production environment.

In scientific experiments, ptychographic imaging combines scanning microscopy with diffraction measurements to characterize the structure and properties of matter and materials. While the method has been around for some 50 years, broad utilization has been hampered by the fact that the experimental process was slow and the computational processing of the data to produce a reconstructed image was expensive. But in recent years advances in detectors and x-ray microscopes at light sources such as the ALS have made it possible to measure a ptychographic dataset in seconds.

Reconstructing ptychographic datasets, however, is no trivial matter; the process involves solving a difficult phase-retrieval problem, calibrating optical elements and dealing with experimental outliers and “noise.” Enter SHARP (scalable heterogeneous adaptive real-time ptychography), an algorithmic framework and computer software that enables the reconstruction of millions of phases of ptychographic image data per second. Developed at Berkeley Lab through an international collaboration and rolled out in 2016, SHARP has had a demonstrable impact on productivity for scientists working at the ALS and other light sources across the Department of Energy complex.

Now an inter-government agency funded collaboration of scientists from Berkeley Lab’s DOE-funded Center for Advanced Mathematics for Energy Research Applications (CAMERA), the ALS and STROBE, the National Science Foundation’s Science and Technology Center, has yielded another first-of-its-kind advance for ptychographic imaging: a software/algorithmic pipeline that enables real-time streaming of ptychographic image data during a beamline experiment, providing throughput, compression and resolution as well as rapid feedback to the user while the experiment is still running.

Integrated, Modular, Scalable

A successor of the Nanosurveyor concept first introduced in a 2010 LDRD proposal, the modular, scalable Nanosurveyor II system—now up and running at the ALS—employs a two-sided infrastructure that integrates the ptychographic image data acquisition, preprocessing, transmission and visualization processes. The front-end component at the beamline comprises the detector, frame-grabber, a scalable preprocessor and graphical user interface (GUI), while the back-end component at the compute cluster contains SHARP for high-resolution image reconstruction combined with communication channels for data flow, instructions and synchronization. In operation, once a new scan has been triggered by the experiment control, the frame-grabber continuously receives raw data packets from the camera, assembles them to a frame and, in parallel, preprocesses a set of raw frames into a clean and reduced block for the computational back end. Incoming blocks are distributed among the SHARP workers in the computation back end, and reduced data are sent back to the front end and visualized in a GUI. The new streaming software system is being rolled out at the ALS for active use in experiments on the beamlines, such as the COSMIC x-ray microscopy platform that recently came online.

“What we have succeeded in doing is making very complex computation and data workflow as transparent as possible,” said David Shapiro, a staff scientist in the Experimental Systems Group at the ALS who has been instrumental in facilitating the implementation and testing of the new system. “Once the software is going, microscope operators have no idea they are generating gigabytes of data and it’s going through this pipeline and then coming back to them.”

ALS users typically are able to use the beamlines for about two days, during which they may study about a dozen samples, Shapiro noted. This means they only have a few hours per sample, and they need to make a number of decisions about the data within those hours. The pytchographic real-time streaming capability gives them real-time feedback and helps them to make more accurate decisions.

“The fact that SHARP can now take data in real time and process it immediately, even if the experiment is not complete, makes it high-performance and operational for science in a production environment,” said Stefano Marchesini, a CAMERA scientist and the PI on the original LDRD proposal.

Production-ready Environment

Integrating all of the components was one of the biggest challenges in implementing Nanosurveyor II, as was getting it ready to function in a production-ready environment versus a testbed, according to Hari Krishnan, a computer systems engineer at CAMERA who was responsible for developing the pipeline’s communication engine. It took a multiyear effort to bring the real-time data-processing capabilities to fruition, with contributions from mathematicians, computer scientists, software engineers, physicists and beamline scientists. In addition to Marchesini and Krishnan, CAMERA scientists Pablo Enfedaque and Huibin Chang were involved in developing the SHARP interface and the communication engine. In addition, Filipe Maia and Benedict Daurer of Uppsala University, which has a collaboration with CAMERA, played an integral in the development of the streaming software. Meanwhile, physicist Bjoern Enders of Berkeley’s Physics Department and STROBE was focused on the detector and preprocessor, and Berkeley Physics Ph.D. student Kasra Nowrouzi was involved with pipeline implementation.

“It was important to separate the system’s responsibilities and tasks and then find a common interface to communicate over,” Enders said of the team effort. “This put part of the responsibility back into the beamline. All of us worked together to cleanly separate the streaming algorithm from the preprocessing part so we can ensure that the beamline actually works."

Looking ahead, Nanosurveyor II’s scalability will be critical as the next generation of light sources and detectors come online. The pipeline’s data rates mirror that of the detector; the current detector operates at a rate of up to 400 megabytes per second and can generate a few terabytes of data per day. Next-generation detectors will produce data 100 to 1,000 times faster.

“The streaming solution works as fast as the data acquisition at this point,” Enfedaque said. “You can reconstruct the ptychographic image at the speed that the data is being captured and pre-processed.”

In addition, the team is looking to enhance the pipeline’s capabilities by incorporating machine-learning algorithms that can further automate the data analysis process.

“The goal is to make it seamless,” Krishnan said. “Right now what the users look at is a coarse image to make quick decisions and a finer image to make more complex decisions. Eventually we want to get away from the raw frames and data altogether and end up in this realm where all decisions and all points are just a single reconstructed image. All these other intermediate things disappear.”

“The data-streaming capability brings analysis into the time scale of human decision making for operators, but it also facilitates the future, which would be machines making decisions and guiding the measurements,” Shapiro added.

CAMERA is supported by the DOE Office of Science.  The ALS is a DOE Office of Science User Facility.

X
X
X
  • Filters

  • × Clear Filters

How a Molecular Signal Helps Plant Cells Decide When to Make Oil

Scientists identify new details of how a sugar-signaling molecule helps regulate oil production in plant cells. The work could point to new ways to engineer plants to produce substantial amounts of oil for use as biofuels or in the production of other oil-based products.

Neutrons Produce First Direct 3D Maps of Water During Cell Membrane Fusion

New 3D maps of water distribution during cellular membrane fusion could lead to new treatments for diseases associated with cell fusion. Using neutron diffraction at Oak Ridge National Laboratory, scientists made the first direct observations of water in lipid bilayers modeling cell membrane fusion.

Chemists Demonstrate Sustainable Approach to Carbon Dioxide Capture From Air

Chemists at Oak Ridge National Laboratory have demonstrated a practical, energy-efficient method of capturing carbon dioxide directly from air. If deployed at large scale and coupled to geologic storage, the technique may bolster the portfolio of responses to global climate change.

Nucleation a boon to sustainable nanomanufacturing

Young-Shin Jun, professor of energy, environmental & chemical engineering in the School of Engineering & Applied Science, and Quingun Li, a former doctoral student in her lab, are the first to measure the activation energy and kinetic factors of calcium carbonate's nucleation, both key to predicting and controlling the process.

Breaking the Symmetry Between Fundamental Forces

Scientists improve our understanding of the relationship between fundamental forces by re-creating the earliest moments of the universe.

Greater Than the Sum of Its Parts

Argonne scientists and their collaborators have developed a new model that merges basic electrochemical theory with theories used in different contexts, such as the study of photoelectrochemistry and semiconductor physics, to describe phenomena that occur in any electrode.

A prize-winning measurement device could aid a wide range of industries

Companies dealing with liquids ranging from wastewater to molten metals could benefit from a prize-winning device developed by researchers at the U.S. Department of Energy's (DOE) Princeton Plasma Physics Laboratory (PPPL) and Princeton University.

After 150 years, a Breakthrough in Understanding the Conversion of CO2 to Electrofuels

Using surface-enhanced Raman spectroscopy, Columbia Engineers are first to observe how CO2 is activated at the electrode-electrolyte interface; their finding shifts the catalyst design from trial-and-error paradigm to a rational approach and could lead to alternative, cheaper, and safer renewable energy storage.

Water Plays Unexpected Role in Forming Minerals

Water molecules line up tiny particles to attach and form minerals; understanding how this happens impacts energy extraction and storage along with waste disposal.

X-Rays Uncover a Hidden Property That Leads to Failure in a Lithium-Ion Battery Material

X-ray experiments at the Department of Energy's SLAC National Accelerator Laboratory and Lawrence Berkeley National Laboratory have revealed that the pathways lithium ions take through a common battery material are more complex than previously thought.


  • Filters

  • × Clear Filters

Berkeley Lab to Build an Advanced Quantum Computing Testbed

Lawrence Berkeley National Laboratory (Berkeley Lab) will receive $30 million over five years from the U.S. Department of Energy to build and operate an Advanced Quantum Testbed (AQT) allowing researchers to explore superconducting quantum processors to advance scientific research

Cheng wins Midwest Energy News' 40 Under 40 Award

Lei Cheng, an assistant chemist in the Materials Science division at the U.S. Department of Energy's (DOE) Argonne National Laboratory, has received a Midwest Energy News 40 Under 40 Award.

JCESR renewed for another five years

The U.S. Department of Energy (DOE) today announced its decision to renew the Joint Center for Energy Storage Research (JCESR), a DOE Energy Innovation Hub led by Argonne National Laboratory and focused on advancing battery science and technology.

Binghamton designated as NextFlex New York Node for flexible hybrid electronics initiative

NextFlex has designated Binghamton University to be the New York "Node" for its flexible hybrid electronics (FHE) initiative. As the NextFlex New York Node, Binghamton will design, develop and manufacture tools; process materials and products for flexible hybrid electronics; and attract, train and employ an advanced manufacturing workforce, building on the region's existing electronics manufacturing base.

First Particle Tracks Seen in Prototype for International Neutrino Experiment

The largest liquid-argon neutrino detector in the world has just recorded its first particle tracks, signaling the start of a new chapter in the story of the international Deep Underground Neutrino Experiment (DUNE). DUNE's scientific mission is dedicated to unlocking the mysteries of neutrinos, the most abundant (and most mysterious) matter particles in the universe.

Tais Gorkhover Wins LCLS Young Investigator Award for Pioneering Novel X-ray Imaging Methods

Tais Gorkhover, a principal investigator with the Stanford PULSE Institute, will receive the 2018 LCLS Young Investigator Award, granted to early-career scientists in recognition of exceptional research using the Linac Coherent Light Source (LCLS) X-ray free-electron laser at the Department of Energy's SLAC National Accelerator Laboratory.

ORNL, United Kingdom Lab Partner on Nuclear Energy Research

The United Kingdom's National Nuclear Laboratory and the U.S. Department of Energy's Oak Ridge National Laboratory have agreed to cooperate on a wide range of nuclear energy research and development efforts that leverage both organizations' unique expertise and capabilities.

Nat Fisch receives Fusion Power Associates' Distinguished Career Award

Feature describes lifetime career award for PPPL physicist and professor Nat Fisch.

Wells Fargo Innovation Incubator Expands Focus to Include the Food-Water-Energy Interconnection

The Wells Fargo Innovation Incubator (IN2), a technology incubator and platform funded by the Wells Fargo Foundation and administered by the National Renewable Energy Laboratory (NREL), is expanding its program to advance technologies that address the interconnection of food, water and energy.

Graham George receives Lytle Award for contributions to X-ray absorption spectroscopy

Graham Neil George, professor and Canada Research Chair in X-ray Absorption Spectroscopy (XAS) at the University of Saskatchewan, has been chosen to receive the 2018 Farrel W. Lytle Award for his outstanding contributions to synchrotron science at the Department of Energy's SLAC National Accelerator Laboratory.


  • Filters

  • × Clear Filters

Breaking the Symmetry Between Fundamental Forces

Scientists improve our understanding of the relationship between fundamental forces by re-creating the earliest moments of the universe.

Water Plays Unexpected Role in Forming Minerals

Water molecules line up tiny particles to attach and form minerals; understanding how this happens impacts energy extraction and storage along with waste disposal.

Heavy Particles Get Caught Up in the Flow

First direct measurement show how heavy particles containing a charm quark get caught up in the flow of early universe particle soup.

Seeing Between the Atoms

New detector enables electron microscope imaging at record-breaking resolution.

Scaling Up Single-Crystal Graphene

New method can make films of atomically thin carbon that are over a foot long.

Discovered: Optimal Magnetic Fields Suppress Instabilities in Tokamak Plasmas

U.S. and Korean scientists show how to find and use beneficial 3-D field perturbations to stabilize dangerous edge-localized modes in plasma.

New Electron Glasses Sharpen Our View of Atomic-Scale Features

A new approach to atom probe tomography promises more precise and accurate measurements vital to semiconductors used in computers, lasers, detectors, and more.

Getting an Up-Close, 3-D View of Gold Nanostars

Scientists can now measure 3-D structures of tiny particles with properties that hold promise for advanced sensors and diagnostics.

Small, Short-Lived Drops of Early Universe Matter

Particle flow patterns suggest even small-scale collisions create drops of early universe quark-gluon plasma.

Tuning Terahertz Beams with Nanoparticles

Scientists uncover a way to control terahertz radiation using tiny engineered particles in a magnetic field, potentially opening the doors for better medical and environmental sensors.


Spotlight

Friday September 21, 2018, 01:05 PM

"Model" students enjoy Argonne campus life

Argonne National Laboratory

Thursday September 06, 2018, 01:05 PM

Writing Code for a More Skilled and Diverse STEM Workforce

Brookhaven National Laboratory

Tuesday September 04, 2018, 11:30 AM

New graduate student summer school launches at Princeton Plasma Physics Laboratory

Princeton Plasma Physics Laboratory

Friday August 31, 2018, 06:05 PM

The Gridlock State

California State University (CSU) Chancellor's Office

Friday August 31, 2018, 02:05 PM

Meet Jasmine Hatcher and Trishelle Copeland-Johnson

Brookhaven National Laboratory

Friday August 24, 2018, 11:05 AM

Argonne hosts Modeling, Experimentation and Validation Summer School

Argonne National Laboratory

Wednesday August 22, 2018, 01:05 PM

Students affected by Hurricane Maria bring their research to SLAC

SLAC National Accelerator Laboratory

Wednesday August 22, 2018, 10:05 AM

Brookhaven Lab Pays Tribute to 2018 Summer Interns

Brookhaven National Laboratory

Monday August 20, 2018, 12:05 PM

Changing How Buildings Are Made

Washington University in St. Louis

Thursday August 16, 2018, 12:05 PM

CSUMB Selected to Host Architecture at Zero Competition in 2019

California State University, Monterey Bay

Friday July 20, 2018, 03:00 PM

Department of Energy Invests $64 Million in Advanced Nuclear Technology

Rensselaer Polytechnic Institute (RPI)

Thursday July 19, 2018, 05:00 PM

Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

Rensselaer Polytechnic Institute (RPI)

Tuesday July 03, 2018, 11:05 AM

2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

Brookhaven National Laboratory

Friday June 29, 2018, 06:05 PM

Argonne welcomes The Martian author Andy Weir

Argonne National Laboratory

Monday June 18, 2018, 09:55 AM

Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

Illinois Mathematics and Science Academy (IMSA)

Friday June 15, 2018, 10:00 AM

Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

Rensselaer Polytechnic Institute (RPI)

Thursday June 07, 2018, 03:05 PM

Celebrating 40 years of empowerment in science

Argonne National Laboratory

Monday May 07, 2018, 10:30 AM

Introducing Graduate Students Across the Globe to Photon Science

Brookhaven National Laboratory

Wednesday May 02, 2018, 04:05 PM

Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

Department of Energy, Office of Science

Thursday April 12, 2018, 07:05 PM

The Race for Young Scientific Minds

Argonne National Laboratory

Wednesday March 14, 2018, 02:05 PM

Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

SLAC National Accelerator Laboratory

Thursday February 15, 2018, 12:05 PM

Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

University of Virginia Darden School of Business

Friday February 09, 2018, 11:05 AM

Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

California State University, Channel Islands

Wednesday January 17, 2018, 12:05 PM

Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

Fermi National Accelerator Laboratory (Fermilab)

Wednesday January 17, 2018, 12:05 PM

Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

Fermi National Accelerator Laboratory (Fermilab)

Wednesday December 20, 2017, 01:05 PM

Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

SLAC National Accelerator Laboratory

Monday December 18, 2017, 01:05 PM

The Future of Today's Electric Power Systems

Rensselaer Polytechnic Institute (RPI)

Monday December 18, 2017, 12:05 PM

Supporting the Development of Offshore Wind Power Plants

Rensselaer Polytechnic Institute (RPI)

Tuesday October 03, 2017, 01:05 PM

Stairway to Science

Argonne National Laboratory

Thursday September 28, 2017, 12:05 PM

After-School Energy Rush

Argonne National Laboratory

Thursday September 28, 2017, 10:05 AM

Bringing Diversity Into Computational Science Through Student Outreach

Brookhaven National Laboratory

Thursday September 21, 2017, 03:05 PM

From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

SLAC National Accelerator Laboratory

Thursday September 07, 2017, 02:05 PM

Students Discuss 'Cosmic Opportunities' at 45th Annual SLAC Summer Institute

SLAC National Accelerator Laboratory

Thursday August 31, 2017, 05:05 PM

Binghamton University Opens $70 Million Smart Energy Building

Binghamton University, State University of New York

Wednesday August 23, 2017, 05:05 PM

Widening Horizons for High Schoolers with Code

Argonne National Laboratory

Saturday May 20, 2017, 12:05 PM

Rensselaer Polytechnic Institute Graduates Urged to Embrace Change at 211th Commencement

Rensselaer Polytechnic Institute (RPI)

Monday May 15, 2017, 01:05 PM

ORNL, University of Tennessee Launch New Doctoral Program in Data Science

Oak Ridge National Laboratory

Friday April 07, 2017, 11:05 AM

Champions in Science: Profile of Jonathan Kirzner

Department of Energy, Office of Science

Wednesday April 05, 2017, 12:05 PM

High-Schooler Solves College-Level Security Puzzle From Argonne, Sparks Interest in Career

Argonne National Laboratory

Tuesday March 28, 2017, 12:05 PM

Champions in Science: Profile of Jenica Jacobi

Department of Energy, Office of Science

Friday March 24, 2017, 10:40 AM

Great Neck South High School Wins Regional Science Bowl at Brookhaven Lab

Brookhaven National Laboratory

Wednesday February 15, 2017, 04:05 PM

Middle Schoolers Test Their Knowledge at Science Bowl Competition

Argonne National Laboratory

Friday January 27, 2017, 04:00 PM

Haslam Visits ORNL to Highlight State's Role in Discovering Tennessine

Oak Ridge National Laboratory

Tuesday November 08, 2016, 12:05 PM

Internship Program Helps Foster Development of Future Nuclear Scientists

Oak Ridge National Laboratory

Friday May 13, 2016, 04:05 PM

More Than 12,000 Explore Jefferson Lab During April 30 Open House

Thomas Jefferson National Accelerator Facility





Showing results

0-4 Of 2215