Fujitsu, AIST, and RIKEN Achieve Unparalleled Speed on the MLPerf HPC Machine Learning Processing Benchmark Leveraging Leading Japanese Supercomputer Systems

Nov 19, 2020 15:29 JST

Source: Fujitsu Ltd

TOKYO, Nov 19, 2020 - (JCN Newswire) - Fujitsu, the National Institute of Advanced Industrial Science and Technology (AIST), and RIKEN today announced a performance milestone in supercomputing, achieving the highest performance and claiming the ranking positions on the MLPerf HPC benchmark(1). The MLPerf HPC benchmark measures large-scale machine learning processing on a level requiring supercomputers and the parties achieved these outcomes leveraging approximately half of the "AI-Bridging Cloud Infrastructure" ("ABCI") supercomputer system, operated by AIST, and about 1/10 of the resources of the supercomputer Fugaku, which is currently under joint development by RIKEN and Fujitsu.

Utilizing about half the computing resources of its system, ABCI achieved processing speeds 20 times faster than other GPU-type systems. That is the highest performance among supercomputers based on GPUs, computing devices specialized in deep learning. Similarly, about 1/10 of Fugaku was utilized to set a record for CPU-type supercomputers consisting of general-purpose computing devices only, achieving a processing speed 14 times faster than that of other CPU-type systems.

The results were presented as MLPerf HPC v0.7 on November 18th (November 19th Japan Time) at the 2020 International Conference for High Performance Computing, Networking, Storage, and Analysis (SC20) event, which is currently being held online.

Background

MLPerf HPC is a performance competition in two benchmark programs: "CosmoFlow"(2), which predicts cosmological parameters, and "DeepCAM"(3), which identifies abnormal weather phenomena. The ABCI ranked first in metrics of all registered systems in the "CosmoFlow" benchmark program, with about half of the whole ABCI system(4), and Fugaku ranked second with measurement of about 1/10 of the whole system(5). The ABCI system delivered 20 times the performance of the other GPU types, while Fugaku delivered 14 times the performance of the other CPU types. ABCI achieved first place amongst all registered systems in the "DeepCAM" benchmark program as well, also with about half of the system. In this way, ABCI and Fugaku overwhelmingly dominated the top positions, demonstrating the superior technological capabilities of Japanese supercomputers in the field of machine learning.

Fujitsu, AIST, RIKEN and Fujitsu Laboratories Limited will release the software stacks including the library and the AI framework which accelerate the large-scale machine learning process developed for this measurement to the public. This move will make it easier to use large-scale machine learning with supercomputers, while its use in analyzing simulation results is anticipated to contribute to the detection of abnormal weather phenomena and to new discoveries in astrophysics. As a core platform for building Society 5.0, it will also contribute to solve social and scientific issues, as it is expected to expand to applications such as the creation of general-purpose language models that require enormous computational performance.

About MLPerf HPC

MLPerf is a machine learning benchmark community established in May 2018 for the purpose of creating a performance list of systems running machine learning applications. MLPerf developed MLPerf HPC as a new machine learning benchmark to evaluate the performance of machine learning calculations using supercomputers. It is used for supercomputers around the world and is expected to become a new industry standard. MLPerf HPC v0.7 evaluated performance on two real applications, "CosmoFlow" and "DeepCAM," to measure large-scale machine learning performance requiring the use of a supercomputer.

All measurement data are available on the following website:
Related links: https://mlperf.org/

Comments from the Partners

Fujitsu, Executive Director, Naoki Shinjo
"The successful construction and optimization of the software stack for large-scale deep learning processing, executed in close collaboration with AIST, RIKEN, and many other stakeholders made this achievement a reality, helping us to successfully claim the top position in the MLPerf HPC benchmark in an important milestone for the HPC community. I would like to express my heartfelt gratitude to all concerned for their great cooperation and support. We are confident that these results will pave the way for the use of supercomputers for increasingly large-scale machine learning processing tasks and contribute to many research and development projects in the future, and we are proud that Japan's research and development capabilities will help lead global efforts in this field."

Hirotaka Ogawa, Principal Research Manager, Artificial Intelligence Research Center, AIST
"ABCI" was launched on August 1, 2018 as an open, advanced, and high-performance computing infrastructure for the development of artificial intelligence technologies in Japan. Since then, it has been used in industry-academia-government collaboration and by a diverse range of businesses, to accelerate R&D and verification of AI technologies that utilize high computing power, and to advance social utilization of AI technologies. The overwhelming results of MLPerf HPC, the benchmark for large-scale machine learning processing, showed the world the high level of technological capabilities of Japan's industry-academia-government collaboration. AIST's Artificial Intelligence Research Center is promoting the construction of large-scale machine learning models with high versatility and the development of its application technologies, with the aim of realizing "easily-constructable AI". We expect that the results of this time will be utilized in such technological development.

Satoshi Matsuoka, Director General, RIKEN Center for Computational Science
"In this memorable first MLPerf HPC, Fugaku, Japan's top CPU supercomputer, along with AIST's ABCI, Japan's top GPU supercomputer, exhibited extraordinary performance and results, serving as a testament to Japan's ability to compete at an exceptional level on the global stage in the area of AI research and development. I only regret that we couldn't achieve the overwhelming performance as we did for HPL-AI to be compliant with inaugural regulations for MLPerf HPC benchmark. In the future, as we continue to further improve the performance on Fugaku, we will make ongoing efforts to take advantage of Fugaku's super large-scale environment in the area of high-performance deep learning in cooperation with various stakeholders."

(1) MLPerf HPC MLPerf HPC evaluates the processing performance of the system as a whole, including the software required for machine learning processing, based on real applications that utilize machine learning. HPL-AI evaluates the basic performance of the hardware used in machine learning processing, such as single-precision and half-precision arithmetic units.
(2) CosmoFLow Deep learning models were trained to predict cosmological parameters from the results of three-dimensional simulations of dark matter distributed in space.
(3) DeepCAM A deep learning model was trained that identifies abnormal weather phenomena with global climate prediction simulation data.
(4) half of the whole ABCI system In accordance with the rules of this time's MLPerf HPC v0.7, the measurement was executing using not the whole system, but just half of ABCI's resources.
(5) 1/10 of the whole Fugaku system In accordance with the rules of this time's MLPerf HPC v0.7, the measurement was executing using not the whole system, but just 1/10 of Fugaku's resources.

About Fujitsu

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 130,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE:6702) reported consolidated revenues of 3.9 trillion yen (US$35 billion) for the fiscal year ended March 31, 2020. For more information, please see www.fujitsu.com.

About National Institute of Advanced Industrial Science & Technology (AIST)

AIST is the largest public research institute established in 1882 in Japan. The research fields of AIST covers all industrial sciences, e.g., electronics, material science, life science, metrology, etc. Our missions are bridging the gap between basic science and industrialization and solving social problems facing the world. we prepare several open innovation platforms to contribute to these missions, where researchers in companies, university professors, graduated students, as well as AIST researchers, get together to achieve our missions. The open innovation platform established recently is The Global Zero Emission Research Center which contributes to achieving a zero-emission society collaborating with foreign researches.
https://www.aist.go.jp/index_en.html

About RIKEN Center for Computational Science

RIKEN is Japan's largest comprehensive research institution renowned for high-quality research in a diverse range of scientific disciplines. Founded in 1917 as a private research foundation in Tokyo, RIKEN has grown rapidly in size and scope, today encompassing a network of world-class research centers and institutes across Japan including the RIKEN Center for Computational Science (R-CCS), the home of the supercomputer Fugaku. As the leadership center of high-performance computing, the R-CCS explores the "Science of computing, by computing, and for computing." The outcomes of the exploration - the technologies such as open source software - are its core competence. The R-CCS strives to enhance the core competence and to promote the technologies throughout the world.

Source: Fujitsu Ltd
Sectors: Enterprise IT