Development of Active-learning Dialogue Data-based AI Technology

Oct 03, 2017 12:34 JST

Source: Hitachi, Ltd.

Reducing labor time for conversation contents to one tenth

TOKYO, Oct 03, 2017 - (JCN Newswire) - Hitachi, Ltd. (TSE: 6501) today announced the development of active-learning dialogue-data based AI technology to enable EMIEW3, Hitachi's human symbiotic service robot(1) to spontaneously "learn" how to respond to questions that it could not previously answer. EMIEW3 clarifies the meaning of enquiries with related staff through dialogue interaction, and in the process, automatically increases its dialogue contents to increase "comprehension" for appropriate responses. Hitachi is currently developing EMIEW3 with view to use in customer service and guidance settings. Using this technology, EMIEW3's dialogue contents can be enhanced by staff without specialist training, simply by responding to queries posed by EMIEW3, and was found to reduce labor-hours for this process to about one-tenth the time previously needed.(2) Further, this technology allows EMIEW3 to learn more quickly about products or facilities which may change daily, as well as increase comprehension and correctly respond to customer enquiries. Hitachi is aiming to provide even higher quality dialogue-data based solutions by using this technology.

Fig. 1. Learning process

Fig. 2. Overview of this technology

http://www.acnnewswire.com/topimg/Low_HitachiAI10317Fig1.jpg
Fig. 1. Learning process

In recent years, in light of companies facing labor-shortage for customer service desks, there is an increasing anticipation for advanced robot-based voice-dialog solutions. Hitachi has conducted several field-tests for customer service and guidance solutions with EMIEW3(3) through which it has found that due to wide variation in how a customer query might be posed, that in some cases EMIEW3 is unable to comprehend the nature of the question, and thus unable to answer the question. To address this issue, conventionally, a system administrator would need to continuously analyze interaction logs even after commencement of the service, and regularly expand the dialog contents. Recognizing the importance of being able to efficiently expand the dialog contents after the service has been initiated, Hitachi developed active-learning AI technology that investigates questions which EMIEW3 was unable to answer, identifies the causes and clarifies questions that it did not previously understand, to enable EMIEW3 to "learn and grow" through voice-based dialog with staff. The technology developed consists of the following two points:

1. Active-learning technology
Machine learning was applied to identify and spontaneously learn about components of the dialog that could not be understood. The technology analyzes the causes of unanswerable questions, and classifies them into two patterns: one where the answer is not registered, and the other, where the intention of the query was not understood due to the question being expressed in an unfamiliar form. In the first case of where the question was understood but the answer is not registered, EMIEW3 will ask a staff member for the appropriate information. In the second case where the question could not be understood due to the way it was expressed, a similar question registered in the question-answer database will be sought, and EMIEW3 will confirms with a staff member if the similar question has the same intent as the query which could not be understood. The new "response" and "query expression" learned from the staff response is then automatically registered in the question-answer database.

2. Technology to efficiently use newly learned query expressions
Natural language processing techniques such as morphological analysis and syntax analysis were used to develop technology to efficiently learn new forms of expressing the query. The technology uses morphological analysis and difference detection to find interchangeable components from two different ways of asking the same question, and learns rules about diverse forms of how the same question might be posed (hereafter referred to as rephrasing). Further, syntax analysis and machine learning are used to check if incorrect rephrasing is remembered. Through this, more correct rephrasing rules are formed, and by applying this to other questions, increases the pattern of expressions which have the same meaning.

As a result, log analysis by system administrators become unnecessary, and enables daily enhancement of the dialogue contents by simple on-site dialogue between staff with appropriate business knowledge and EMIEW3.

Using this technology, Hitachi aims to provide higher quality correct response voice-dialog solutions to businesses with customer service desks. This technology will be demonstrated with EMIEW3 in the showcase at the Hitachi Social Innovation Forum 2017 TOKYO, to be held from 1-2 November at the Tokyo International Forum in Yurakucho, Tokyo. Demonstration field-tests will also be conducted in collaboration with the Haneda Robotics Lab*4 at as part of the Haneda Airport Robot Experiment Project.

http://www.acnnewswire.com/topimg/Low_HitachiAI10317Fig2.jpg
Fig. 2. Overview of this technology

(1) Hitachi News Release issued on 8th April 2016, announcing EMIEW3 and its Robotics IT Platform http://www.hitachi.com/New/cnews/month/2016/04/160408.html
(2) The actual reduction ratio will depend on the target business operation and the amount of data involved. The ratio given in this release is based on simulation results from help desk operation and related data within Hitachi.
(3) Hitachi News Releases on EMIEW3 field tests
(4) For more information on the Haneda Robotics Lab, please visit the webpage on the Japan Airport Terminal Co., Ltd. website. https://www.tokyo-airport-bldg.co.jp/hanedaroboticslab/en.html

Contact:

Hitachi Ltd
Corporate Communications
Tel: +81-3-3258-1111

Source: Hitachi, Ltd.
Sectors: Cloud & Enterprise

Related Press Release

Hitachi Energy and SP Energy Networks to boost renewable energy flow

April 05 2024 16:15 JST

Hitachi Selected as "Excellent TCFD Disclosure" by GPIF's External Asset Managers for the Third Consecutive Year

April 05 2024 16:00 JST

JFE Steel and Hitachi Jointly Started Providing Solutions for the Steel Industry

March 26 2024 18:04 JST

Hitachi Selected as CDP Supplier Engagement Leader for the Third Consecutive Year

March 22 2024 15:04 JST

Hitachi Collaborates with NVIDIA to Accelerate Digital Transformation with Generative AI

March 19 2024 18:11 JST

Hitachi Vantara Announces Collaboration with NVIDIA to Create New Portfolio of Industrial AI Solutions

March 19 2024 11:35 JST

Hitachi High-Tech Launches High-sensitivity and High-throughput Wafer Surface Inspection System LS9300AD for Wafer Manufacturers

March 15 2024 10:21 JST

Hitachi Forges a Three Year Strategic Alliance with AWS to Advance Hybrid Cloud Solutions

March 11 2024 15:44 JST

Hitachi Energy and TransnetBW make German grid fit for future

February 15 2024 10:22 JST

Contributing to Efficient Development of Metal Thin Film Materials by Using Chemicals Informatics and Materials Informatics

February 09 2024 12:41 JST

More Press release >>

Latest Press Release

Mitsubishi Power Begins Commercial Operation of Seventh M701JAC Gas Turbine in Thailand GTCC Project; Achieves 75,000 AOH To-Date
Apr 24, 2024 17:19 JST

MC and Denka Sign J/V Agreement in Fullerene Business
Apr 24, 2024 17:02 JST

Mitsubishi Motors Posts Record Sales in the Philippines in FY2023
Apr 24, 2024 13:56 JST

NEC Develops High-speed Generative AI Large Language Models (LLM) with World-class Performance
Apr 24, 2024 13:25 JST

Fujitsu SX Survey reveals key success factors for sustainability
Apr 23, 2024 10:25 JST

Fujitsu and METRON collaborate to drive ESG success: slashing energy costs, boosting productivity with new manufacturing industry solutions
Apr 22, 2024 16:09 JST

NEC Strengthens Commitment to Space Industry with Investment in Seraphim Space Venture Fund II
Apr 22, 2024 15:09 JST

Soft Space Launches the First and Only JCB Payment Gateway in Malaysia
Apr 22, 2024 15:00 JST

TOYOTA GAZOO Racing takes a one-two in Croatian thriller
Apr 22, 2024 10:47 JST

First-ever Mazda CX-80 Crossover SUV Unveiled in Europe
Apr 19, 2024 13:50 JST

Fujitsu develops technology to convert corporate digital identity credentials, enabling participation of non-European companies in European data spaces
Apr 19, 2024 10:17 JST

Mitsubishi Heavy Industries and NGK to Jointly Develop Hydrogen Purification System from Ammonia Cracking Gas
Apr 18, 2024 17:01 JST

Toyota Launches All-New Land Cruiser "250" Series in Japan
Apr 18, 2024 13:39 JST

Fujitsu and Oracle collaborate to deliver sovereign cloud and AI capabilities in Japan
Apr 18, 2024 11:14 JST

Eisai: Research on Treatments for Alzheimer's Disease Based on Its Pathological Mechanisms Recieves Award for Science and Technology (Research Category)
Apr 18, 2024 10:53 JST

All-New Triton Confirmed as First Double-Cab Pickup Truck to Achieve 2024 Five-Star ANCAP Safety Rating
Apr 18, 2024 09:22 JST

Eisai's Antiepileptic Drug Fycompa Injection Formulation Launched In Japan
Apr 17, 2024 16:17 JST

Honda Unveils Next-generation EV Series for China
Apr 17, 2024 12:15 JST

Lexus presents Time at the 2024 Milan Design Week
Apr 16, 2024 18:49 JST

Mitsubishi Corporation Announces Participation in a DAC Project in Louisiana, USA
Apr 16, 2024 14:36 JST

More Latest Release >>