NEC develops lightweight LLM with world-class Japanese language proficiency and just 13 billion parameters

Jul 06, 2023 17:32 JST

Source: NEC Corporation

TOKYO, Jul 06, 2023 - (JCN Newswire) - NEC Corporation (NEC; TSE: 6701) has developed generative artificial intelligence (AI) that is customizable for each customer in order to create new value for companies in response to business changes caused by new technologies. Starting this month in Japan, the new "NEC Generative AI Service" will begin providing licenses for proprietary large language models (LLM), dedicated hardware, software, consulting services and more, then sequentially expanding to new markets after FY2024.

Moreover, in collaboration with approximately 10 companies and universities, NEC is also launching the "NEC Generative AI Advanced Customer Program" in July, which works with customers to support the creation of models for them as well as the development of software, organizations, etc. for the utilization of LLM.

In addition, on July 1, the "NEC Generative AI Hub" was established as a specialized organization for promoting the business transformation of customers, consisting of researchers, prompt engineers who provide precise instructions to AI, consultants, digital trust specialists and other professionals. NEC aims to achieve sales of 50 billion yen (approximately $346 million USD) over the next three years from these generative AI-related businesses.

The area of generative AI is attracting significant market attention as companies and local governments consider business transformation using various language models, such as ChatGPT, which recently surpassed 100 million users within two months of its service launch in November 2022.

However, when using generative AI, there are security issues related to information leakage and vulnerability, as well as issues related to accuracy and continuous use of the system. In addition, for corporate use, it is necessary to make efforts to use it for more essential purposes than translation and summarization, such as modeling the knowledge accumulated in a company and developing a system to promote its use within the company.

NEC began using generative AI for internal business use in May of this year. An environment and system that can be used safely and securely by employees were built in two weeks. The system is also linked to internal systems such as internal chat and web conferencing tools, and is being used by about 20,000 users, or about 10,000 times a day.

As a result, the system is beginning to produce results, such as an 80% reduction in man-hours required to create source code for internal system development, a 50% reduction in the time required to create documents, and a reduction in the time required to take meeting minutes from an average of 30 minutes to approximately 5 minutes.

NEC will continue to use the system to improve the efficiency of document proofreading and other tasks common to all employees, as well as in specialized areas such as software development, while reflecting the know-how gained through in-house use of its LLM-related services.

Based on the resolution of these kinds of challenges and internal use, NEC will now provide its own generative AI for creating new corporate value.

NEC's unique LLM features

- High Japanese proficiency: Achieves top-class performance in the amount of knowledge and reading comprehension required for business operations
- Lightweight: Compact model size and can run on a standard GPU server

NEC Generative AI Service
NEC will begin sequentially providing a one-stop support menu for customers as the "NEC Generative AI Service Menu," based on the know-how and initiatives it has cultivated. By providing services such as consulting and hypothesis testing, NEC will contribute to the rapid and effective transformation of customers' business operations.

NEC will also provide "NEC Generative AI Framework" software to facilitate the integration of LLM into customer operations.

The "Microsoft Azure OpenAI Service" and NEC's LLM will be provided in accordance with customer needs. NEC also provides secure environments such as on-premises environments together with cloud services for customers who handle confidential information.

These services will be provided with security and low latency, centered on the NEC Inzai Data Center, which has a connection point to "Microsoft Azure ExpressRoute." The combination of NEC's proprietary LLM, NEC Generative AI Framework, and "NEC Generative AI Appliance Server," a hardware platform that enables on-premises use, will successfully provide for a secure LLM environment.

NEC Generative AI Advanced Customer Program
This program provides comprehensive support for the creation of corporate value through the use of generative AI, including the creation of company-specific language models, the development of business-applicable applications, environmental improvement, and human resource development, as well as promoting interaction among participating companies.

Consultant-led workshops to develop LLM utilization strategies, scenarios, use cases, and guidelines for internal use.
Demonstration experiments in a private environment by using NEC's proprietary LLM and building individual tuning models that utilize NEC LLM to learn data within the company.
Conducting advanced trials of NEC's cutting-edge services as part of high-level human resource development in the AI domain, as well as training sessions and hands-on training for LLM utilization.
Creation of new business patterns through exchange of ideas between different industries.
"Microsoft warmly welcomes NEC's release of its generative AI service," said Miki Tsusaka, Corporate Vice President, Microsoft Corporation and President, Microsoft Japan, Ltd. "Generative AI is regarded as an historical and disruptive turning point in technology, comparable to the arrival of the Internet, or the Industrial Revolution. NEC was one of the first companies to focus on this field and has been working with us to make it a reality. NEC and Microsoft, in a strategic global partnership, will leverage Microsoft Azure OpenAI Service, which enables secure data handling, and NEC's diverse technology assets, including the NEC Inzai Data Center. Both companies will work together to accelerate customers' digital transformation and realize work style innovation."

"NEC will provide a secure and safe generative AI environment that reflects our strategic partnership with Microsoft and combines LLM based on NEC's long-cultivated AI expertise and Microsoft Azure OpenAI," said Toshifumi Yoshizaki, Corporate Executive Vice President and Chief Digital Officer (CDO), NEC Corporation. "In addition, under the new partnership program, we will bring together the wisdom of both customers and academia, aiming for a major leap forward in productivity."

About NEC Corporation

NEC Corporation has established itself as a leader in the integration of IT and network technologies while promoting the brand statement of "Orchestrating a brighter world." NEC enables businesses and communities to adapt to rapid changes taking place in both society and the market as it provides for the social values of safety, security, fairness and efficiency to promote a more sustainable world where everyone has the chance to reach their full potential. For more information, visit NEC at https://www.nec.com.

Source: NEC Corporation
Sectors: Artificial Intel [AI]