DOE News
    Doe Science news source
    The DOE Science News Source is a Newswise initiative to promote research news from the Office of Science of the DOE to the public and news media.
    • 2017-11-20 14:05:06
    • Article ID: 685518

    GraphBLAS: Building Blocks For High Performance Graph Analytics

    Berkeley Lab Researchers Contribute to GraphBLAS and Will Leverage it for Exascale Applications

    • Left to Right: Aydín Buluç (Berkeley Lab), Tim Mattson (Intel) and Jeremy Kepner (MIT).

    Many of us thought linear algebra and graph structures were concepts we’d never again have to deal with after high school. However, these concepts underpin a variety of transactions, from Internet searches to cryptography, artificial intelligence and even operation of the power grid. They are also vital to many computational science and parallel computing applications. 

    Now after nearly five years of collaboration between researchers in academia, industry and national research laboratories—including Aydın Buluç, a scientist in Lawrence Berkeley National Laboratory’s (Berkeley Lab’s) Computational Research Division (CRD)—GraphBLAS, a collection of standardized building blocks for graph algorithms in the language of linear algebra, is publicly available.

    “When people talk about artificial intelligence, big data and data analytics, significant pieces of those come down to graph structures, which is a way of representing relationships between items,” says Tim Mattson, an Intel Senior Principal Engineer and a member of the GraphBLAS collaboration.

    In the era of big data, Mattson notes that there is an increasing interest in finding patterns and connections in this information by building graphs and exploring their properties.

    “This is a newish application area for scalable supercomputing. Graph problems are fairly straightforward to write down mathematically; however, getting them to work on petabytes of data, on a highly distributed system and in a reasonable amount of time, is actually very difficult,” he adds. “But if we can view graphs as linear algebra problems—which have been central to science and engineering applications in high performance computing for decades—then we can immediately apply everything that we’ve learned from parallel supercomputing over the last 35 years to graphs.” 

    This is where Buluç’s experience proved to be extremely useful. Buluç began applying linear algebra to high performance graph analysis nearly a decade ago when he was a graduate student at the University of California Santa Barbra (UCSB). For his Ph.D. thesis, he created Combinational BLAS, an extensible distributed-memory parallel graph library offering a small but powerful set of linear algebra primitives specifically targeting graph analytics. This library later partly inspired the bigger GraphBLAS effort.  Another CRD Scientist, Ariful Azad, is a major contributor to the Combinatorial BLAS library and graph applications that use Combinatorial BLAS for scalability.

    After earning his doctorate, Buluç continued this work at Berkeley Lab as a Luis Alvarez fellow and then as a research scientist. Along the way he also began collaborating with Jeremy Kepner, a Lincoln Laboratory Fellow at the Massachusetts Institute of Technology (MIT). Mattson notes that Buluç and Kepner were driving forces in the modern resurgence to get the community to think about graphs as linear algebra. He connected with both researchers via Buluç’s thesis advisor, UCSB Professor John Gilbert. 

    “Aydin Buluç was a leader in demonstrating highly scalable implementations of matrix based graph algorithms, his work inspired others to try similar approaches,” says Kepner. “Tim Mattson then championed the idea that a GraphBLAS standard would allow hardware people and software people to work together and magnify our collective efforts.”

    According to Mattson, the impetus to create a standard BLAS (Basic Linear Algebra Subprograms) for graph analytics came in 2012 when Intel launched a Science and Technology Center for Big Data at MIT to produce new data management systems and compute architectures for Big Data. As one of the center’s principal investigators, Mattson began building a team of researchers from academic and research institutions across the country with experience in high performance graph analysis, including Buluç, Gilbert and Kepner.

    Over the next several years, the collaboration worked to define the mathematical concepts that would go into GraphBLAS. Because this software library was going to be publicly available, it couldn’t be overwhelming for users. So the team aimed to identify the smallest number of linear algebra functions to get the job done. Once the team agreed on the mathematical concepts, a subset of the researchers spent a couple of more years to bind GraphBLAS to the C programming language.

    “GraphBLAS is an elegantly small number of functions that are feasible to implement in hardware, as we have demonstrated in the Lincoln Laboratory Graph Processor,” says Kepner. “It allows us to explore graphs with powerful mathematical properties such as associativity, commutativity and distributivity.  More recently, GraphBLAS has begun to be of interest to people beyond the graph community, including machine learning, databases, and simulations.”

    Thanks to the efforts of Texas A&M Professor Timothy Davis, the GraphBLAS will soon be in many major Linux distributions and in many of the most popular mathematical programming environments in the world. Additionally, hardware manufacturers are starting to build computers specifically designed to accelerate these operations. Kepner notes that the confluence of these efforts will allow millions to enjoy the benefits of GraphBLAS. 

    As a member of the ExaGraph: Combinatorial Methods for Enabling Exascale Application Co-Design Center, which is a Department of Energy Exascale Computing Project (ECP), Buluç and Azad plan to use GraphBLAS to develop graph and combinatorial algorithms for exascale systems. 

    “As science problems get bigger, more computing power will be necessary to address these challenges,” says Buluç. “These large-scale applications have many computational components that we call motifs; that’s the whole idea of co-design. Exascale applications are a patchwork of different motifs, and if we optimize all other motifs for exascale and ignore the graph and combinatorics motifs, we’ll hit a performance bottleneck. That’s why this work is so important.”

    Basics of BLAS

    Many people are familiar with programming languages—like Python, C, C++, Java, and thousands of others—that are used to create a variety of software and applications. These high-level languages make coding relatively easy for humans but make little sense to computer hardware, which only comprehends low-level binary language of ones and zeros. Low-level programs essentially allow the programmer to have more control over how the computer hardware will perform, which means the developer will be able to ensure optimal software performance on a particular machine. 

    It turns out that only a small number of low-level routines are required to perform most common linear algebra computing operations. So in 1979, researchers at NASA’s Jet Propulsion Laboratory, Sandia National Laboratories and the University of Texas at Austin publicly released Basic Linear Algebra Subprograms (BLAS), a library of these low-level routines for performing linear algebra operations such as vector addition, scalar multiplication, dot products, linear combinations and matrix multiplication. 

    “When BLAS entered the scene in the late 1970s and early 1980s, it was transformative,” says Mattson. “Instead of handcrafting linear algebra algorithms from scratch, I could build them off of these common building blocks. And if a vendor would optimize those common building blocks just for their hardware, I could gain the benefits of that optimization pretty much for free.”

    In subsequent years, various research collaborations created a variety of BLAS libraries for different tasks. Realizing the benefits to users, vendors also worked with researchers to optimize these building blocks to run on their hardware. GraphBLAS is essentially a continuation of this BLAS heritage.

    “My hope is that GraphBLAS will be just as remarkable for those doing high performance graph analytics,” adds Mattson.

    In addition to Buluç, Gilbert, Kepner and Mattson, other members of the GraphBLAS steering committee include David Bader of Georgia Tech and Henning Meyerhenke Karlsruhe Institute of Technology.

    The Department of Energy’s Office of Science partially funded the development of GraphBLAS through the Office of Advanced Scientific Computing Research’s Applied Math Early Career program. Buluç was also awarded a DOE Office of Science Early Career Research Program award in 2013.

    Download GraphBLAS specification and reference implementations here: 

    • Filters

    • × Clear Filters

    Hidden Giants in Forest Soils

    Viruses can infect the microbes residing in, on and around soils, impacting their ability to regulate these global cycles. In Nature Communications, giant virus genomes have been discovered for the first time in a forest soil ecosystem by researchers from the DOE Joint Genome Institute and the University of Massachusetts-Amherst.

    Scientists Produce 3-D Chemical Maps of Single Bacteria

    Scientists at the National Synchrotron Light Source II (NSLS-II)--a U.S. Department of Energy (DOE) Office of Science User Facility at DOE's Brookhaven National Laboratory--have used ultrabright x-rays to image single bacteria with higher spatial resolution than ever before. Their work, published in Scientific Reports, demonstrates an x-ray imaging technique, called x-ray fluorescence microscopy (XRF), as an effective approach to produce 3-D images of small biological samples.

    Making X-ray Microscopy 10 Times Faster

    Microscopes make the invisible visible. And compared to conventional light microscopes, transmission x-ray microscopes (TXM) can see into samples with much higher resolution, revealing extraordinary details. Researchers across a wide range of scientific fields use TXM to see the structural and chemical makeup of their samples--everything from biological cells to energy storage materials.

    Microbes Eat the Same in Labs and the Desert

    Analyses of natural communities forming soil crusts agree with laboratory studies of isolated microbe-metabolite relationships.

    Self-Sensing Materials Are Here

    Oak Ridge National Laboratory researchers invented a way to make a nanomaterial-embedded composite that is stronger than other fiber-reinforced composites and imbued with a new capability--the ability to monitor its own structural health.

    Diverse Biofeedstocks Have High Ethanol Yields and Offer Biorefineries Flexibility

    Evidence suggests that biorefineries can accept various feedstocks without negatively impacting the amount of ethanol produced per acre.

    Opening Access to Explore the Synthetic Chemistry of Neptunium

    New, easily prepared starting material opens access to learning more about a difficult-to-control element in nuclear waste.

    Symbiosis a Driver of Truffle Diversity

    Truffles are thought of as dining delicacies but they play an important role in soil ecosystem services as the fruiting bodies of the ectomycorrhizal (ECM) fungal symbionts residing on host plant roots. An international team sought insights into the ECM lifestyle of truffle-forming species through a comparative analysis of eight fungal genomes.

    Climate Simulations Project Wetter, Windier Hurricanes

    New supercomputer simulations by climate scientists at the Department of Energy's Lawrence Berkeley National Laboratory (Berkeley Lab) have shown that climate change intensified the amount of rainfall in recent hurricanes such as Katrina, Irma, and Maria by 5 to 10 percent. They further found that if those hurricanes were to occur in a future world that is warmer than present, those storms would have even more rainfall and stronger winds.

    Tiny Titanium Barrier Halts Big Problem in Fuel-Producing Solar Cells

    New design coats molecular components and dramatically improves stability under tough, oxidizing conditions.

    • Filters

    • × Clear Filters

    Four Argonne Technologies Receive 2018 R&D 100 Awards

    Four Argonne research projects have earned R&D 100 Awards, long considered the "Oscars" of scientific innovation.

    Argonne's Min Si receives early career award from IEEE Computer Society

    Argonne's Min Si wins Award for Excellence for Early Career Researchers in High Performance Computing through the Institute of Electrical and Electronics Engineers.

    Jefferson Lab Director Appointed to Distinguished Professorship

    Stuart Henderson, director of the Department of Energy's Thomas Jefferson National Accelerator Facility, has been appointed the Governor's Distinguished CEBAF professor at Old Dominion University. The position is supported by the Commonwealth of Virginia and is named for the Continuous Electron Beam Accelerator Facility, which is the main research facility located at Jefferson Lab.

    DOE issues call for HPC for Energy Innovation proposals

    The U.S. Department of Energy's (DOE) High Performance Computing for Energy Innovation (HPC4EI) Initiative today issued its first joint solicitation for the High Performance Computing for Manufacturing Program (HPC4Mfg) and the High Performance Computing for Materials Program (HPC4Mtls).

    DOE funding advances project to turn captured CO2 into key chemicals

    The U.S. Department of Energy has selected Southern Research for an award of up to $1.5 million to advance technology for carbon dioxide utilization.

    Sierra Reaches Higher Altitudes, Takes Number Two Spot on List of Fastest Supercomputers

    Sierra, Lawrence Livermore National Laboratory's newest supercomputer, rose to second place on the list of the world's fastest computing systems, TOP500 List representatives announced Monday at the International Conference for High Performance Computing, Networking, Storage and Analysis conference (SC18) in Dallas.

    Green energy: Wind energy agreement will provide savings, 50 percent of electricity needs for Kansas State University Manhattan campus

    Kansas State University has signed an agreement with Westar Energy to provide approximately 50 percent of the energy needs for the university's main Manhattan campus from a wind farm in Nemaha County and save the university nearly $200,000 annually.

    INCITE grants awarded to 62 computational research projects

    The U.S. Department of Energy announced new projects for 2019 through its Innovative and Novel Computational Impact on Theory and Experiment (INCITE) program.

    Argonne's Raj Kettimuthu Named ACM Distinguished Member

    Argonne computer scientist Raj Kettimuthu recently was named a Distinguished Member of the Association for Computing Machinery for his development of tools to analyze and enhance end-to-end data transfer performance.

    Jefferson Lab-Affiliated Researchers Honored as APS Fellows

    The Department of Energy's Thomas Jefferson National Accelerator Facility now has a few more fellows on campus. The American Physical Society, a professional membership society that works on behalf of the physics community, recently announced its list of 2018 fellowships.

    • Filters

    • × Clear Filters

    Microbes Eat the Same in Labs and the Desert

    Analyses of natural communities forming soil crusts agree with laboratory studies of isolated microbe-metabolite relationships.

    Diverse Biofeedstocks Have High Ethanol Yields and Offer Biorefineries Flexibility

    Evidence suggests that biorefineries can accept various feedstocks without negatively impacting the amount of ethanol produced per acre.

    Opening Access to Explore the Synthetic Chemistry of Neptunium

    New, easily prepared starting material opens access to learning more about a difficult-to-control element in nuclear waste.

    Tiny Titanium Barrier Halts Big Problem in Fuel-Producing Solar Cells

    New design coats molecular components and dramatically improves stability under tough, oxidizing conditions.

    Turning Wood Scraps into Tape

    A new chemical process converts a component of wasted wood pulp and other biomass into high-value pressure-sensitive adhesives.

    Very Heavy Elements Deliver More Electrons

    Scientists revise understanding of the limits of bonding for very electron-rich heavy elements.

    Probing Water's "No-Man's Land" Temperature Region

    Measuring the physical properties of water at previously unexplored temperatures offers insights into one of the world's essential liquids.

    Novel Soil Bacteria with Unusual Genes Synthesize Unique Antibiotic Precursors

    A large-scale soil project uncovered genetic information from bacteria with the capacity to make specialized molecules that could lead to new pharmaceuticals.

    Warmer Temperatures Lengthen Growing Season, Increase Plants' Vulnerability to Frost

    Experimental warming treatments show how peatland forests may respond to future environmental change.

    Rising Stars Seek to Learn from the Master: Mother Nature

    A trio of scientists was recognized for their early career successes in uncovering how microbes produce fuel, insights that could change our energy portfolio


    Thursday October 11, 2018, 04:00 PM

    Research on Light-Matter Interaction Could Lead to Improved Electronic and Optoelectronic Devices

    Rensselaer Polytechnic Institute (RPI)

    Wednesday October 03, 2018, 07:05 PM

    Innovating Our Energy Future

    Oregon State University, College of Engineering

    Tuesday October 02, 2018, 03:05 PM

    Physics graduate student takes her thesis research to a Department of Energy national lab

    University of Alabama at Birmingham

    Friday September 21, 2018, 01:05 PM

    "Model" students enjoy Argonne campus life

    Argonne National Laboratory

    Thursday September 06, 2018, 01:05 PM

    Writing Code for a More Skilled and Diverse STEM Workforce

    Brookhaven National Laboratory

    Tuesday September 04, 2018, 11:30 AM

    New graduate student summer school launches at Princeton Plasma Physics Laboratory

    Princeton Plasma Physics Laboratory

    Friday August 31, 2018, 06:05 PM

    The Gridlock State

    California State University (CSU) Chancellor's Office

    Friday August 31, 2018, 02:05 PM

    Meet Jasmine Hatcher and Trishelle Copeland-Johnson

    Brookhaven National Laboratory

    Friday August 24, 2018, 11:05 AM

    Argonne hosts Modeling, Experimentation and Validation Summer School

    Argonne National Laboratory

    Wednesday August 22, 2018, 01:05 PM

    Students affected by Hurricane Maria bring their research to SLAC

    SLAC National Accelerator Laboratory

    Wednesday August 22, 2018, 10:05 AM

    Brookhaven Lab Pays Tribute to 2018 Summer Interns

    Brookhaven National Laboratory

    Monday August 20, 2018, 12:05 PM

    Changing How Buildings Are Made

    Washington University in St. Louis

    Thursday August 16, 2018, 12:05 PM

    CSUMB Selected to Host Architecture at Zero Competition in 2019

    California State University, Monterey Bay

    Friday July 20, 2018, 03:00 PM

    Department of Energy Invests $64 Million in Advanced Nuclear Technology

    Rensselaer Polytechnic Institute (RPI)

    Thursday July 19, 2018, 05:00 PM

    Professor Miao Yu Named the Priti and Mukesh Chatter '82 Career Development Professor

    Rensselaer Polytechnic Institute (RPI)

    Tuesday July 03, 2018, 11:05 AM

    2018 RHIC & AGS Annual Users' Meeting: 'Illuminating the QCD Landscape'

    Brookhaven National Laboratory

    Friday June 29, 2018, 06:05 PM

    Argonne welcomes The Martian author Andy Weir

    Argonne National Laboratory

    Monday June 18, 2018, 09:55 AM

    Creating STEM Knowledge and Innovations to Solve Global Issues Like Water, Food, and Energy

    Illinois Mathematics and Science Academy (IMSA)

    Friday June 15, 2018, 10:00 AM

    Professor Emily Liu Receives $1.8 Million DoE Award for Solar Power Systems Research

    Rensselaer Polytechnic Institute (RPI)

    Thursday June 07, 2018, 03:05 PM

    Celebrating 40 years of empowerment in science

    Argonne National Laboratory

    Monday May 07, 2018, 10:30 AM

    Introducing Graduate Students Across the Globe to Photon Science

    Brookhaven National Laboratory

    Wednesday May 02, 2018, 04:05 PM

    Students from Massachusetts and Washington Win DOE's 28th National Science Bowl(r)

    Department of Energy, Office of Science

    Thursday April 12, 2018, 07:05 PM

    The Race for Young Scientific Minds

    Argonne National Laboratory

    Wednesday March 14, 2018, 02:05 PM

    Q&A: Al Ashley Reflects on His Efforts to Diversify SLAC and Beyond

    SLAC National Accelerator Laboratory

    Thursday February 15, 2018, 12:05 PM

    Insights on Innovation in Energy, Humanitarian Aid Highlight UVA Darden's Net Impact Week

    University of Virginia Darden School of Business

    Friday February 09, 2018, 11:05 AM

    Ivy League Graduate, Writer and Activist with Dyslexia Visits CSUCI to Reframe the Concept of Learning Disabilities

    California State University, Channel Islands

    Wednesday January 17, 2018, 12:05 PM

    Photographer Adam Nadel Selected as Fermilab's New Artist-in-Residence for 2018

    Fermi National Accelerator Laboratory (Fermilab)

    Wednesday January 17, 2018, 12:05 PM

    Fermilab Computing Partners with Argonne, Local Schools for Hour of Code

    Fermi National Accelerator Laboratory (Fermilab)

    Wednesday December 20, 2017, 01:05 PM

    Q&A: Sam Webb Teaches X-Ray Science from a Remote Classroom

    SLAC National Accelerator Laboratory

    Monday December 18, 2017, 01:05 PM

    The Future of Today's Electric Power Systems

    Rensselaer Polytechnic Institute (RPI)

    Monday December 18, 2017, 12:05 PM

    Supporting the Development of Offshore Wind Power Plants

    Rensselaer Polytechnic Institute (RPI)

    Tuesday October 03, 2017, 01:05 PM

    Stairway to Science

    Argonne National Laboratory

    Thursday September 28, 2017, 12:05 PM

    After-School Energy Rush

    Argonne National Laboratory

    Thursday September 28, 2017, 10:05 AM

    Bringing Diversity Into Computational Science Through Student Outreach

    Brookhaven National Laboratory

    Thursday September 21, 2017, 03:05 PM

    From Science to Finance: SLAC Summer Interns Forge New Paths in STEM

    SLAC National Accelerator Laboratory

    Thursday September 07, 2017, 02:05 PM

    Students Discuss 'Cosmic Opportunities' at 45th Annual SLAC Summer Institute

    SLAC National Accelerator Laboratory

    Thursday August 31, 2017, 05:05 PM

    Binghamton University Opens $70 Million Smart Energy Building

    Binghamton University, State University of New York

    Wednesday August 23, 2017, 05:05 PM

    Widening Horizons for High Schoolers with Code

    Argonne National Laboratory

    Saturday May 20, 2017, 12:05 PM

    Rensselaer Polytechnic Institute Graduates Urged to Embrace Change at 211th Commencement

    Rensselaer Polytechnic Institute (RPI)

    Monday May 15, 2017, 01:05 PM

    ORNL, University of Tennessee Launch New Doctoral Program in Data Science

    Oak Ridge National Laboratory

    Friday April 07, 2017, 11:05 AM

    Champions in Science: Profile of Jonathan Kirzner

    Department of Energy, Office of Science

    Wednesday April 05, 2017, 12:05 PM

    High-Schooler Solves College-Level Security Puzzle From Argonne, Sparks Interest in Career

    Argonne National Laboratory

    Tuesday March 28, 2017, 12:05 PM

    Champions in Science: Profile of Jenica Jacobi

    Department of Energy, Office of Science

    Friday March 24, 2017, 10:40 AM

    Great Neck South High School Wins Regional Science Bowl at Brookhaven Lab

    Brookhaven National Laboratory

    Wednesday February 15, 2017, 04:05 PM

    Middle Schoolers Test Their Knowledge at Science Bowl Competition

    Argonne National Laboratory

    Showing results

    0-4 Of 2215