NEC and Hortonworks to Co-develop High Performance Analytics Platform for Big Data with SX-Aurora TSUBASA
TOKYO, Oct, 15 2018 - (JCN Newswire) - NEC Corporation (TSE: 6701) and Hortonworks, Inc. today announced plans for the co-development of a high performance Big Data analytics platform for AI integrating the "SX-Aurora TSUBASA" vector engine, a new hardware platform by NEC to accelerate computing using vectorization. This new platform, combined with NEC's Big Data platform "Data Platform for Hadoop," significantly improves processing performance and scalability to deliver better business results for Artificial Intelligence (AI), Machine Learning and Advanced Analytics.
Prior to this co-development, NEC and Hortonworks announced an expansion of their strategic partnership in September, 2017 to deliver a Big Data processing platform(1). Utilizing their strengths, the two companies aim to offer new products suited for advanced and high performance Big Data analysis in a wider range of industries and fields. Moreover, the companies aim to provide the results of this co-development as open source software (OSS) that can be implemented in diverse environments and various industry use cases.
Co-development plans for the analytics platform include the following:
Integration of the SX-Aurora TSUBASA platform with "YARN"(2), the architectural center of Hadoop/Spark, a data processing engine which allows customers to run their existing Big Data analytics programs on the SX-Aurora TSUBASA. This enables easy integration of applications and reduces the workload for system administrators. In a standard system architecture using YARN, the server resources required to execute a typical analysis will be reduced by 99% when compared to existing systems(3).
The integration of NEC's "Frovedis"(4) middleware with Spark on the SX-Aurora TSUBASA platform. By utilizing Frovedis, AI (machine learning) applications run up to 100 times faster on the SX-Aurora TSUBASA than on conventional servers (*3). This results in a high performance and easy-to-use platform for customers to execute AI and Big Data analysis using the Spark machine learning library (MLlib)(5).
Enhance the capabilities of NEC's distributed processing platform, "Data Platform for Hadoop," by integrating SX-Aurora TSUBASA, which allows customers to run Big Data & Analytics workloads much faster and to provide better, more accurate results.
"NEC is pleased to agree and collaborate with Hortonworks, a leading Hadoop distribution provider, to develop YARN and Spark support for the NEC vector engine, 'SX-Aurora TSUBASA.' The prime objective of the collaboration will be to provide a high-speed, parallel process computing environment best suited for customers with large amounts of data that can be utilized for developing and building essential Machine Learning-based use cases. Adding support to the vector engine for Apache, Hadoop, YARN and Spark helps the customer to quickly achieve effective results from Big Data and AI use cases," said Tomoyasu Nishimura, senior vice president, NEC Corporation.
"An enormous amount of data is required to achieve high accuracy in Machine Learning. The combination of SX-Aurora TSUBASA's high processing performance and Hortonworks HDP's scalability will be an innovative choice in the global market," said Yuji Hirokawa, regional vice president of Hortonworks, Inc. and managing director of Hortonworks Japan Co., Ltd.
(1) Tokyo, Japan, September 25, 2017 - NEC Corporation and Hortonworks, Inc. announced the expansion of their strategic partnership in the field of distributed Big Data processing platforms (https://www.nec.com)
(2) Resource Manager and Job scheduler for Apache Hadoop / Spark applications, which allocate and mange distributed computing resources, including CPU and memory
(3) Xeon (Gold 6126) 1 socket vs 1 VE, with sparse data (w/o I/O) LR uses CTR data provided by Criteo (1/4 of the original, 6GB) K-means and SVD used Wikipedia doc-term matrix (10GB)
(4) NEC accelerates machine learning for vector computers (https://www.nec.com)
(5) Machine Learning Library for Apache Spark which is utilized with Java, Scala, Python and R languages
Hortonworks is an industry-leading innovator that creates, distributes and supports enterprise-ready open data platforms and modern data applications that deliver actionable intelligence from all data: data-in-15motion and data-at-rest. Hortonworks is focused on driving innovation in open source communities such as Apache Hadoop, Apache NiFi and Apache Spark. Along with its 2,100+ partners, Hortonworks provides the expertise, training and services that allow customers to unlock transformational value for their organizations across any line of business.
Hortonworks and HDP are registered trademarks or trademarks of Hortonworks, Inc. and its subsidiaries in the United States and other jurisdictions. For more information, please visit http://www.hortonworks.com/. All other trademarks are the property of their respective owners.
About NEC Corporation
NEC Corporation is a leader in the integration of IT and network technologies that benefit businesses and people around the world. The NEC Group globally provides "Solutions for Society" that promote the safety, security efficiency and fairness of society. Under the company's corporate message of "Orchestrating a brighter world," NEC aims to help solve a wide range of challenging issues and to create new social value for the changing world of tomorrow. For more information, visit NEC at https://www.nec.com.
Source: NEC Corporation
Sectors: Enterprise IT
Copyright ©2019 JCN Newswire. All rights reserved. A division of Japan Corporate News Network.
Latest Press Release
More Latest Release >>
DOCOMO Earns Gold Prize for Card Keitai at iF Design Award 2019
Mar 18, 2019 17:09 JST
Mitsubishi Corporation, Chubu Electric Power and HICL Infrastructure Consortium Named Preferred Bidder for Offshore Transmission Asset in the UK
Mar 18, 2019 16:50 JST
Victory for TOYOTA GAZOO Racing at Sebring
Mar 18, 2019 09:37 JST
Mitsubishi Motors TRITON Show Model is Almost Here
Mar 18, 2019 08:32 JST
DOCOMO to Test Remote-Monitoring Solution for Eldercare
Mar 14, 2019 21:32 JST
Nissan and Mitsubishi Motors to Launch New Kei Cars as Collaboration Expands
Mar 14, 2019 17:32 JST
Fujitsu Formulates "Fujitsu Group AI Commitment," Demonstrating Dedication to Safe and Secure Use of AI
Mar 13, 2019 19:38 JST
Nishi Nippon Railroad and Mitsubishi Corporation to Commence Commercial AI-Controlled Bus Transit Services in Fukuoka, Japan
Mar 13, 2019 17:14 JST
Mitsubishi Shipbuilding Holds Christening Ceremony for LPG Carrier "FUTURE ACE'
Mar 13, 2019 16:01 JST
Toyota Tsusho and NEC Conclude Contract with Uzbektelecom on Nationwide Data Communication System
Mar 13, 2019 12:39 JST
Renault, Nissan, Mitsubishi Motors Announce Intention to Create a New Alliance Operating Board
Mar 13, 2019 11:16 JST
Hitachi Automotive Systems to Strengthen its Global Organizational Structure
Mar 13, 2019 09:11 JST
Journey Orchestration Leader Kitewheel Expands into Asia Pacific with Superdrive Partnership
Mar 13, 2019 09:00 JST
DENSO Takes a Stake in Airbiquity to Advance Connected Vehicle Technology
Mar 12, 2019 14:37 JST
MHPS' H-100 Gas Turbine Gains Momentum with Multiple Qualifications
Mar 12, 2019 13:36 JST
MHPS to Use Drones for Inspecting Power Plant Boilers
Mar 12, 2019 12:21 JST
Eisai and Imbrium Therapeutics Announce U.S. FDA Filing Acceptance of New Drug Application for Lemborexant for the Treatment of Insomnia
Mar 12, 2019 08:43 JST
Tanak and TOYOTA GAZOO Racing Finish a Strong Second in Mexico
Mar 11, 2019 13:08 JST
Fujitsu Completes Image Processing Field Trial to Support Restoration of Earthquake-Damaged Kumamoto Castle
Mar 11, 2019 11:31 JST
Yamaha Motor and Fujitsu Begin IoT-based Field Trial to Improve Sailing Performance for 470 Class Events
Mar 11, 2019 11:07 JST