Doe Science news source
The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
  • 2018-06-05 12:05:14
  • Article ID: 695590

Berkeley Lab Paves the Way for Real-time Ptychographic Data Streaming

  • Credit: Berkeley Lab

    In scientific experiments, ptychographic imaging combines scanning microscopy with diffraction measurements to characterize the structure and properties of matter and materials. Advances in detectors and x-ray microscopes at light sources have made it possible to measure a ptychographic dataset in seconds.

What began nearly a decade ago as a Berkeley Lab Laboratory-Directed Research and Development (LDRD) proposal is now a reality, and it is already changing the way scientists run experiments at the Advanced Light Source (ALS)—and, eventually, other light sources across the Department of Energy (DOE) complex—by enabling real-time streaming of ptychographic image data in a production environment.

In scientific experiments, ptychographic imaging combines scanning microscopy with diffraction measurements to characterize the structure and properties of matter and materials. While the method has been around for some 50 years, broad utilization has been hampered by the fact that the experimental process was slow and the computational processing of the data to produce a reconstructed image was expensive. But in recent years advances in detectors and x-ray microscopes at light sources such as the ALS have made it possible to measure a ptychographic dataset in seconds.

Reconstructing ptychographic datasets, however, is no trivial matter; the process involves solving a difficult phase-retrieval problem, calibrating optical elements and dealing with experimental outliers and “noise.” Enter SHARP (scalable heterogeneous adaptive real-time ptychography), an algorithmic framework and computer software that enables the reconstruction of millions of phases of ptychographic image data per second. Developed at Berkeley Lab through an international collaboration and rolled out in 2016, SHARP has had a demonstrable impact on productivity for scientists working at the ALS and other light sources across the Department of Energy complex.

Now an inter-government agency funded collaboration of scientists from Berkeley Lab’s DOE-funded Center for Advanced Mathematics for Energy Research Applications (CAMERA), the ALS and STROBE, the National Science Foundation’s Science and Technology Center, has yielded another first-of-its-kind advance for ptychographic imaging: a software/algorithmic pipeline that enables real-time streaming of ptychographic image data during a beamline experiment, providing throughput, compression and resolution as well as rapid feedback to the user while the experiment is still running.

Integrated, Modular, Scalable

A successor of the Nanosurveyor concept first introduced in a 2010 LDRD proposal, the modular, scalable Nanosurveyor II system—now up and running at the ALS—employs a two-sided infrastructure that integrates the ptychographic image data acquisition, preprocessing, transmission and visualization processes. The front-end component at the beamline comprises the detector, frame-grabber, a scalable preprocessor and graphical user interface (GUI), while the back-end component at the compute cluster contains SHARP for high-resolution image reconstruction combined with communication channels for data flow, instructions and synchronization. In operation, once a new scan has been triggered by the experiment control, the frame-grabber continuously receives raw data packets from the camera, assembles them to a frame and, in parallel, preprocesses a set of raw frames into a clean and reduced block for the computational back end. Incoming blocks are distributed among the SHARP workers in the computation back end, and reduced data are sent back to the front end and visualized in a GUI. The new streaming software system is being rolled out at the ALS for active use in experiments on the beamlines, such as the COSMIC x-ray microscopy platform that recently came online.

“What we have succeeded in doing is making very complex computation and data workflow as transparent as possible,” said David Shapiro, a staff scientist in the Experimental Systems Group at the ALS who has been instrumental in facilitating the implementation and testing of the new system. “Once the software is going, microscope operators have no idea they are generating gigabytes of data and it’s going through this pipeline and then coming back to them.”

ALS users typically are able to use the beamlines for about two days, during which they may study about a dozen samples, Shapiro noted. This means they only have a few hours per sample, and they need to make a number of decisions about the data within those hours. The pytchographic real-time streaming capability gives them real-time feedback and helps them to make more accurate decisions.

“The fact that SHARP can now take data in real time and process it immediately, even if the experiment is not complete, makes it high-performance and operational for science in a production environment,” said Stefano Marchesini, a CAMERA scientist and the PI on the original LDRD proposal.

Production-ready Environment

Integrating all of the components was one of the biggest challenges in implementing Nanosurveyor II, as was getting it ready to function in a production-ready environment versus a testbed, according to Hari Krishnan, a computer systems engineer at CAMERA who was responsible for developing the pipeline’s communication engine. It took a multiyear effort to bring the real-time data-processing capabilities to fruition, with contributions from mathematicians, computer scientists, software engineers, physicists and beamline scientists. In addition to Marchesini and Krishnan, CAMERA scientists Pablo Enfedaque and Huibin Chang were involved in developing the SHARP interface and the communication engine. In addition, Filipe Maia and Benedict Daurer of Uppsala University, which has a collaboration with CAMERA, played an integral in the development of the streaming software. Meanwhile, physicist Bjoern Enders of Berkeley’s Physics Department and STROBE was focused on the detector and preprocessor, and Berkeley Physics Ph.D. student Kasra Nowrouzi was involved with pipeline implementation.

“It was important to separate the system’s responsibilities and tasks and then find a common interface to communicate over,” Enders said of the team effort. “This put part of the responsibility back into the beamline. All of us worked together to cleanly separate the streaming algorithm from the preprocessing part so we can ensure that the beamline actually works."

Looking ahead, Nanosurveyor II’s scalability will be critical as the next generation of light sources and detectors come online. The pipeline’s data rates mirror that of the detector; the current detector operates at a rate of up to 400 megabytes per second and can generate a few terabytes of data per day. Next-generation detectors will produce data 100 to 1,000 times faster.

“The streaming solution works as fast as the data acquisition at this point,” Enfedaque said. “You can reconstruct the ptychographic image at the speed that the data is being captured and pre-processed.”

In addition, the team is looking to enhance the pipeline’s capabilities by incorporating machine-learning algorithms that can further automate the data analysis process.

“The goal is to make it seamless,” Krishnan said. “Right now what the users look at is a coarse image to make quick decisions and a finer image to make more complex decisions. Eventually we want to get away from the raw frames and data altogether and end up in this realm where all decisions and all points are just a single reconstructed image. All these other intermediate things disappear.”

“The data-streaming capability brings analysis into the time scale of human decision making for operators, but it also facilitates the future, which would be machines making decisions and guiding the measurements,” Shapiro added.

CAMERA is supported by the DOE Office of Science.  The ALS is a DOE Office of Science User Facility.

X
X
X
  • Filters

  • × Clear Filters

Forever Young Catalyst Reduces Diesel Emissions

Atom probe tomography reveals key explanations for stable performance over a cutting-edge diesel-exhaust catalyst's lifetime.

Sense Like a Shark: Saltwater-Submersible Films

A nickelate thin film senses electric field changes analogous to the electroreception sensing organ in sharks, which detects the bioelectric fields of prey.

Enhanced Detection of Nuclear Events, Thanks to Deep Learning

Scientists at Pacific Northwest National Laboratory are exploring deep learning to interpret data related to national security, the environment, the cosmos, and breast cancer. In one project a deep neural network is interpreting data about nuclear events as well as - sometimes better than - today's best automated methods or human experts.

A Bit of Quantum Logic--What Did the Atom Say to the Quantum Dot?

Let's talk! Scientists demonstrate coherent coupling between a quantum dot and a donor atom in silicon, vital for moving information inside quantum computers.

Sodium- and Potassium-based Batteries Hold Promise for Cheap Energy Storage

Researchers at the Georgia Institute of Technology have found new evidence suggesting that batteries based on sodium and potassium hold promise as a potential alternative to lithium-based batteries.

ORNL researchers use AI to improve mammogram interpretation

In an effort to reduce errors in the analyses of diagnostic images by health professionals, a team of researchers from Oak Ridge National Laboratory has improved understanding of the cognitive processes involved in image interpretation, work that has enormous potential to improve health outcomes for the hundreds of thousands of American women affected by breast cancer each year. The ORNL-led team found that analyses of mammograms by radiologists were significantly influenced by context bias, or the radiologist's previous diagnostic experiences.

Scientists Make the First Molecular Movie of One of Nature's Most Widely Used Light Sensors

Scientists have made the first molecular movie of the instant when light hits a sensor that's widely used in nature for probing the environment and harvesting energy from light. The sensor, a form of vitamin A known as retinal, is central to a number of important light-driven processes in people, animals, microbes and algae, including human vision and some forms of photosynthesis, and the movie shows it changing shape in a trillionth of an eye blink.

Scientists isolate protein data from the tiniest of caches - single human cells

Scientists have captured the most information yet about proteins within a single human cell, giving scientists one of their clearest looks yet at the molecular happenings inside a human cell. The team detected on average more than 650 proteins in each cell - many times more than conventional techniques capture from single cells.

Researchers Generate Electricity and Hydrogen from Live Bacteria

Using a family of photosynthetic bacteria that commonly live in lakes and seas, researchers at the Technion have developed a technology to generate electricity and hydrogen energy. The researchers believe their technology can serve as a promising source of clean, environment-friendly energy that will not emit pollutants during production or use (hydrogen fuel).

Carbon Nanotube Optics Poised to Provide Pathway to Optical-Based Quantum Cryptography and Quantum Computing

Researchers at Los Alamos and partners in France and Germany are exploring the enhanced potential of carbon nanotubes as single-photon emitters for quantum information processing. Their analysis of progress in the field is published in this week's edition of the journal Nature Materials.


  • Filters

  • × Clear Filters

Department of Energy Selects 84 Scientists to Receive Early Career Research Program Funding

The Department of Energy (DOE) has selected 84 scientists from across the nation - including 30 from DOE's national laboratories and 54 from U.S. universities - to receive significant funding for research as part of the DOE Office of Science's Early Career Research Program.

Three Argonne Scientists Receive DOE Early Career Awards

Three Argonne researchers have earned the DOE's 2018 Early Career Research Program awards.

Four SLAC Scientists Awarded Prestigious DOE Early Career Research Grants

Four scientists at the Department of Energy's SLAC National Accelerator Laboratory will receive Early Career Research Program awards for research that's developing new ways to study fundamental particles with machine learning and study nanoscale objects and quantum materials with powerful X-ray laser beams.

PPPL Physicists Aim to Unlock Mysteries of Fusion with Early Career Research Awards

Article describes PPPL winner of DOE Early Career Awards.

Ames Laboratory's Ke Earns DOE Early Career Research Award

Ames Laboratory scientist Liqin Ke is one of 30 scientists from the U.S. Department of Energy's (DOE) national laboratories to be selected for funding as part of the DOE's Early Career Research Program.

6 Berkeley Lab Researchers Receive DOE Early Career Research Awards

Six scientists at Lawrence Berkeley National Laboratory (Berkeley Lab) have been selected by the U.S. Department of Energy's (DOE's) Office of Science to receive significant funding for research through its Early Career Research Program.

´╗┐Stony Brook's AERTC Selected for Leadership Role in Nationwide Consortium on Offshore Wind Industry

Stony Brook's Advanced Energy Research and Technology Center (AERTC) will play a key role in a nationwide research and development consortium for the offshore wind industry. The New York State Energy Research and Development Authority was awarded a $18.5 million U.S. Department of Energy grant to establish the National Offshore Wind Research and Development Consortium, Governor Andrew M. Cuomo announced last week. New York State, through NYSERDA, has committed an additional $20.5 million to fund the consortium supporting Gov. Cuomo's initiative Reforming the Energy Vision (REV).

Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

Li (Emily) Liu, associate professor of nuclear engineering and engineering physics in the Department of Mechanical, Aerospace, and Nuclear Engineering at Rensselaer Polytechnic Institute, has been selected by the U.S. Department of Energy Solar Energy Technologies Office (SETO) to receive a $1.8 million award to study high-temperature molten-salt properties and corrosion mechanisms.

Vasilis Fthenakis Receives IEEE's William R. Cherry Award

UPTON, NY; Vasilis Fthenakis, a Senior Scientist Emeritus at the U.S. Department of Energy's (DOE) Brookhaven National Laboratory and Founder and Director of the Center for Life Cycle Analysis at Columbia University, will receive the 2018 William R. Cherry Award from the Institute of Electrical & Electronics Engineers (IEEE).

New PPPL director Steve Cowley is honored with knighthood by Queen Elizabeth II

Steven Cowley, newly named director of the U.S. Department of Energy's (DOE) Princeton Plasma Physics Laboratory (PPPL) effective July 1, has received a knighthood from Queen Elizabeth "for services to science and the development of nuclear fusion."


  • Filters

  • × Clear Filters

As Future Batteries, Hybrid Supercapacitors Are Super-Charged

A new supercapacitor could be a competitive alternative to lithium-ion batteries.

Forever Young Catalyst Reduces Diesel Emissions

Atom probe tomography reveals key explanations for stable performance over a cutting-edge diesel-exhaust catalyst's lifetime.

Sense Like a Shark: Saltwater-Submersible Films

A nickelate thin film senses electric field changes analogous to the electroreception sensing organ in sharks, which detects the bioelectric fields of prey.

A Bit of Quantum Logic--What Did the Atom Say to the Quantum Dot?

Let's talk! Scientists demonstrate coherent coupling between a quantum dot and a donor atom in silicon, vital for moving information inside quantum computers.

New Tech Uses Isomeric Beams to Study How and Where the Galaxy Makes One of Its Most Common Elements

A new measurement using a beam of aluminum-26 prepared in a metastable state allows researchers to better understand the creation of the elements in our galaxy.

Simulations of Magnetically Confined Plasmas Reveal a Self-Regulating Stabilizing Mechanism

A mysterious mechanism that prevents instabilities may be similar to the process that maintains the Earth's magnetic field.

Seeing All the Colors of the Plasma Wind

2-D velocity imaging helps fusion researchers understand the role of ion winds (aka flows) in the boundary of tokamak plasmas.

Renewable Solvents Derived From Lignin Lowers Waste in Biofuel Production

New class of solvents breaks down plant biomass into sugars for biofuels and bioproducts in a closed-loop biorefinery concept.

Scientists Studying Nuclear Spin Make a Surprising Discovery

The size of a nucleus appears to influence the direction of certain particles emitted from collisions with spinning protons.

Simulating Turbulent Bubbly Flows in Nuclear Reactors

With a better understanding of bubbly flows, researchers can improve the safety and operation of our nuclear reactors.


Spotlight

Monday June 18, 2018, 09:55 AM

Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

Illinois Mathematics and Science Academy (IMSA)

Friday June 15, 2018, 10:00 AM

Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

Rensselaer Polytechnic Institute (RPI)

Thursday June 07, 2018, 03:05 PM

Celebrating 40 years of empowerment in science

Argonne National Laboratory

Monday May 07, 2018, 10:30 AM

Introducing Graduate Students Across the Globe to Photon Science

Brookhaven National Laboratory

Wednesday May 02, 2018, 04:05 PM

Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

Department of Energy, Office of Science

Thursday April 12, 2018, 07:05 PM

The Race for Young Scientific Minds

Argonne National Laboratory

Wednesday March 14, 2018, 02:05 PM

Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

SLAC National Accelerator Laboratory

Thursday February 15, 2018, 12:05 PM

Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

University of Virginia Darden School of Business

Friday February 09, 2018, 11:05 AM

Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

California State University, Channel Islands

Wednesday January 17, 2018, 12:05 PM

Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

Fermi National Accelerator Laboratory (Fermilab)

Wednesday January 17, 2018, 12:05 PM

Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

Fermi National Accelerator Laboratory (Fermilab)

Wednesday December 20, 2017, 01:05 PM

Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

SLAC National Accelerator Laboratory

Monday December 18, 2017, 01:05 PM

The Future of Today's Electric Power Systems

Rensselaer Polytechnic Institute (RPI)

Monday December 18, 2017, 12:05 PM

Supporting the Development of Offshore Wind Power Plants

Rensselaer Polytechnic Institute (RPI)

Tuesday October 03, 2017, 01:05 PM

Stairway to Science

Argonne National Laboratory

Thursday September 28, 2017, 12:05 PM

After-School Energy Rush

Argonne National Laboratory

Thursday September 28, 2017, 10:05 AM

Bringing Diversity Into Computational Science Through Student Outreach

Brookhaven National Laboratory

Thursday September 21, 2017, 03:05 PM

From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

SLAC National Accelerator Laboratory

Thursday September 07, 2017, 02:05 PM

Students Discuss 'Cosmic Opportunities' at 45th Annual SLAC Summer Institute

SLAC National Accelerator Laboratory

Thursday August 31, 2017, 05:05 PM

Binghamton University Opens $70 Million Smart Energy Building

Binghamton University, State University of New York

Wednesday August 23, 2017, 05:05 PM

Widening Horizons for High Schoolers with Code

Argonne National Laboratory

Saturday May 20, 2017, 12:05 PM

Rensselaer Polytechnic Institute Graduates Urged to Embrace Change at 211th Commencement

Rensselaer Polytechnic Institute (RPI)

Monday May 15, 2017, 01:05 PM

ORNL, University of Tennessee Launch New Doctoral Program in Data Science

Oak Ridge National Laboratory

Friday April 07, 2017, 11:05 AM

Champions in Science: Profile of Jonathan Kirzner

Department of Energy, Office of Science

Wednesday April 05, 2017, 12:05 PM

High-Schooler Solves College-Level Security Puzzle From Argonne, Sparks Interest in Career

Argonne National Laboratory

Tuesday March 28, 2017, 12:05 PM

Champions in Science: Profile of Jenica Jacobi

Department of Energy, Office of Science

Friday March 24, 2017, 10:40 AM

Great Neck South High School Wins Regional Science Bowl at Brookhaven Lab

Brookhaven National Laboratory

Wednesday February 15, 2017, 04:05 PM

Middle Schoolers Test Their Knowledge at Science Bowl Competition

Argonne National Laboratory

Friday January 27, 2017, 04:00 PM

Haslam Visits ORNL to Highlight State's Role in Discovering Tennessine

Oak Ridge National Laboratory

Tuesday November 08, 2016, 12:05 PM

Internship Program Helps Foster Development of Future Nuclear Scientists

Oak Ridge National Laboratory

Friday May 13, 2016, 04:05 PM

More Than 12,000 Explore Jefferson Lab During April 30 Open House

Thomas Jefferson National Accelerator Facility

Monday April 25, 2016, 05:05 PM

Giving Back to National Science Bowl

Ames Laboratory

Friday March 25, 2016, 12:05 PM

NMSU Undergrad Tackles 3D Particle Scattering Animations After Receiving JSA Research Assistantship

Thomas Jefferson National Accelerator Facility

Tuesday February 02, 2016, 10:05 AM

Shannon Greco: A Self-Described "STEM Education Zealot"

Princeton Plasma Physics Laboratory

Monday November 16, 2015, 04:05 PM

Rare Earths for Life: An 85th Birthday Visit with Mr. Rare Earth

Ames Laboratory

Tuesday October 20, 2015, 01:05 PM

Meet Robert Palomino: 'Give Everything a Shot!'

Brookhaven National Laboratory

Tuesday April 22, 2014, 11:30 AM

University of Utah Makes Solar Accessible

University of Utah

Wednesday March 06, 2013, 03:40 PM

Student Innovator at Rensselaer Polytechnic Institute Seeks Brighter, Smarter, and More Efficient LEDs

Rensselaer Polytechnic Institute (RPI)

Friday November 16, 2012, 10:00 AM

Texas Tech Energy Commerce Students, Community Light up Tent City

Texas Tech University

Wednesday November 23, 2011, 10:45 AM

Don't Get 'Frosted' Over Heating Your Home This Winter

Temple University

Wednesday July 06, 2011, 06:00 PM

New Research Center To Tackle Critical Challenges Related to Aircraft Design, Wind Energy, Smart Buildings

Rensselaer Polytechnic Institute (RPI)

Friday April 22, 2011, 09:00 AM

First Polymer Solar-Thermal Device Heats Home, Saves Money

Wake Forest University

Friday April 15, 2011, 12:25 PM

Like Superman, American University Will Get Its Energy from the Sun

American University

Thursday February 10, 2011, 05:00 PM

ARRA Grant to Help Fund Seminary Building Green Roof

University of Chicago

Tuesday December 07, 2010, 05:00 PM

UC San Diego Installing 2.8 Megawatt Fuel Cell to Anchor Energy Innovation Park

University of California San Diego

Monday November 01, 2010, 12:50 PM

Rensselaer Smart Lighting Engineering Research Center Announces First Deployment of New Technology on Campus

Rensselaer Polytechnic Institute (RPI)

Friday September 10, 2010, 12:40 PM

Ithaca College Will Host Regional Clean Energy Summit

Ithaca College

Tuesday July 27, 2010, 10:30 AM

Texas Governor Announces $8.4 Million Award to Create Renewable Energy Institute

Texas Tech University





Showing results

0-4 Of 2215