Fujitsu Technology Uses Conversational Speech to Identify Customer Satisfaction
Enables automatic response evaluation in customer interactions in various situations
TOKYO, Oct 17, 2016 - (JCN Newswire) - Fujitsu Laboratories Ltd. today announced the development of voice-analysis technology that can automatically identify times when customers feel satisfied or dissatisfied in their conversations with service personnel. Service provided by personnel in support of customers, such as at call centers and bank teller windows, directly relates to the company's image, making training critical. Given this, in the past, efforts have been made to convert conversations with customers to text with speech recognition technology in order to grasp a customer's sense of satisfaction. However, there are cases where the same words can convey either satisfaction or dissatisfaction, depending upon the tone of voice. For this reason, based on word content alone, it was impossible to fully grasp the customer's sense of satisfaction. Now, using a method that takes into account not only the average pitch of the voice and the degree of variation, but also the characteristic changes at relative points within voice data that covers multiple words - namely at the start or end of speech - Fujitsu has succeeded in a highly accurate quantification of voice cheerfulness. In addition, using machine learning in conjunction with customer-service evaluations, Fujitsu has developed a technology that can automatically identify times in a conversation when a customer is satisfied or dissatisfied with roughly 70% accuracy, as compared with results of a determination made by the human ear. In a field trial using this technology in Fujitsu Limited and Fujitsu FSAS Inc. call centers, Fujitsu confirmed increases in the efficiency of training, such as monitoring and evaluation of support personnel and feedback on the results, reducing the time required by about 30%. Moreover, there was a greater degree of acceptance by both the evaluator and the person being evaluated due to increased objectivity. Going forward, Fujitsu Laboratories intends to incorporate this technology into Human Centric AI Zinrai, the AI technology of Fujitsu Limited, and offer it as a product for use in customer-service evaluations and in the training of service personnel in a variety of enterprises that emphasize communication, such as banks and retail stores. Developmental Background
| Figure 1: Service personnel training using voice analysis | |
| Figure 2: Quantification of voice cheerfulness with this technology | |
| Figure 3: Structure of this technology | |
In communication, both remotely, as in call centers and distance learning services, as well as in such face-to-face situations as bank teller windows, the service provided to customers by service personnel is directly related to the company's image. This means that training for service personnel is seen as extremely important. Until now, information was sometimes gathered through customer surveys and used in training, but in many cases, the only data that could be obtained was the overall evaluation of the service. This made it difficult to determine what service personnel did wrong in the conversation. Also, in addition analyzing purchasing history for individual customers, surveys and other marketing activities, there is a need to discern, based on the customer's actual voice, such as can be heard in call centers, what the customer wants with regard to specific products or services, for example, what the customer's requirements are or what points need improvement. In so doing it is hoped that data from conversations with customers, gathered from service situations where personnel interact directly with customers, could be used in such areas as evaluating the quality of service, training employees, and marketing strategies.
Figure 1: Service personnel training using voice analysis http://www.acnnewswire.com/topimg/Low_FujitsuTechFig11017.jpg Issues
Previously, there were efforts to grasp customer feelings by converting conversations with customers to text using voice recognition software, but not only do actual conversations not always follow ordinary grammar, but they can also be impacted by surrounding noise. As a result, there were many technological difficulties in converting conversations to text through voice recognition, such as many instances where the conversion was incorrect. In addition, even if people use the same words, the meaning may change in a variety of ways depending on their emotions, so it was difficult to correctly interpret the customer's emotions using methods that analyze speech that has been converted to text. About the Technology
Fujitsu has now developed technology to automatically determine times in a conversation when customers feel satisfied or dissatisfied based on features of their voices in relation to the way they are speaking with service personnel. With this technology, customer service personnel and service providers can rapidly evaluate service content and improve support methods. Features of the newly developed technology are as follows. Technology to quantify "voice cheerfulness" from patterns of changes in voice pitch
A cheerful voice is ordinarily one with a high tone, or one in which the voice's tone and volume change a great deal. Moreover, Fujitsu Laboratories has determined through proprietary research that cheerful voices have unique characteristics of change at the beginnings and endings of statements. As a result, by using a method that takes into account unique changes at relative positions in voice data across multiple words, in addition to analyzing a voice's average pitch and changes, Fujitsu Laboratories has succeeded in accurately quantifying the cheerfulness of a voice (Figure 2). Figure 2: Quantification of voice cheerfulness with this technology http://www.acnnewswire.com/topimg/Low_FujitsuTechFig21017.jpg In addition, because there is a highly correlated relationship between perceived voice cheerfulness and degree of satisfaction, Fujitsu Laboratories has quantified the sense of satisfaction in a conversation, using the quantified cheerfulness of a voice in a proprietary conversion formula based on survey results (Figure 3). By combining this with customer-service evaluations, and using machine learning to find a threshold point between satisfaction and dissatisfaction, Fujitsu Laboratories has developed technology to automatically identify times during a conversation when the customer is satisfied or dissatisfied. With the learning, the customer can adopt the results of the response evaluation on site, and fixed standards can also be customized for each location. Figure 3: Structure of this technology http://www.acnnewswire.com/topimg/Low_FujitsuTechFig31017.jpg Effects
With this technology, Fujitsu Laboratories was able to determine times of satisfaction and dissatisfaction in conversations in customer service situations with about 70% accuracy compared with results of a determination made with the human ear. This has made it easier, in training customer service personnel, for the person receiving the results to understand which parts of the conversation were good or bad, leading to efficient improvement in service skills. This technology was field tested in three of Fujitsu and Fujitsu FSAS's call centers. In addition to this technology, the trial used evaluation tools that also implemented technology to identify problem areas in customer interaction, such as when service personnel spoke over customers or paused too long before responding. As a result, the field test confirmed that not only were there great increases in the efficiency of training through monitoring and evaluating service personnel and providing feedback on the results, with a 30% reduction in time required, but the acceptance of the evaluation by both the evaluator and person being evaluated was significantly increased because of the increased objectivity of the evaluation. This technology can be expected to lead to improvements in customers' sense of satisfaction and training efficiency due to increased service skills in a variety of customer contact situations, including call centers. Future Plans
By combining this technology with Fujitsu Limited's digital solutions and services, such as automatic interactive answering services, Fujitsu Laboratories is working on initiatives to extract information on highly satisfactory features from products customers offer for use in marketing analysis, as well as service that adapts on the fly to customers' sense of dissatisfaction. Plans call for commercialization as a call center-related service, offered by Fujitsu and Fujitsu FSAS, by the end of March 2017. In addition, by using this technology in a way that strengthens the sensory-media technology that is part of Human Centric AI Zinrai, Fujitsu Limited's AI technology, Fujitsu Laboratories aims to commercialize it for use in a variety of situations, such as bank teller windows, retail, healthcare and training, by the end of March 2019.
About Fujitsu Laboratories
Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.
Contact:Fujitsu Laboratories Ltd.
Media Processing Laboratory
E-mail: speech-analytics-cs@ml.labs.fujitsu.com
Fujitsu Limited
Public and Investor Relations
Tel: +81-3-3215-5259
URL: www.fujitsu.com/global/news/contacts/
Source: Fujitsu Ltd Sectors: Electronics
Copyright ©2024 JCN Newswire. All rights reserved. A division of Japan Corporate News Network.
|
Latest Press Release
JCB enables JCB Contactless acceptance at Taichung MRT in Taiwan Apr 26, 2024 10:00 JST
| Mazda Production and Sales Results for March 2024 and for April 2023 through March 2024 Apr 25, 2024 18:21 JST
| MHI Begins Operation of SOEC Test Module the Next-Generation High-Efficiency Hydrogen Production Technology at Takasago Hydrogen Park Apr 25, 2024 17:45 JST
| GAC Honda to Begin Sales of All-new e:NP2, the Second Model of e:N Series Apr 25, 2024 16:50 JST
| Toyota Exhibiting at Beijing Motor Show 2024 Apr 25, 2024 16:25 JST
| Honda Reaches Basic Agreement with Asahi Kasei on Collaboration for Production of Battery Separators for Automotive Batteries in Canada Apr 25, 2024 11:10 JST
| UNIQLO Sponsors KAWS + Warhol Exhibition Tour, Starting in Pittsburgh Apr 25, 2024 09:00 JST
| Mitsubishi Power Begins Commercial Operation of Seventh M701JAC Gas Turbine in Thailand GTCC Project; Achieves 75,000 AOH To-Date Apr 24, 2024 17:19 JST
| MC and Denka Sign J/V Agreement in Fullerene Business Apr 24, 2024 17:02 JST
| Mitsubishi Motors Posts Record Sales in the Philippines in FY2023 Apr 24, 2024 13:56 JST
| NEC Develops High-speed Generative AI Large Language Models (LLM) with World-class Performance Apr 24, 2024 13:25 JST
| Fujitsu SX Survey reveals key success factors for sustainability Apr 23, 2024 10:25 JST
| Fujitsu and METRON collaborate to drive ESG success: slashing energy costs, boosting productivity with new manufacturing industry solutions Apr 22, 2024 16:09 JST
| NEC Strengthens Commitment to Space Industry with Investment in Seraphim Space Venture Fund II Apr 22, 2024 15:09 JST
| Soft Space Launches the First and Only JCB Payment Gateway in Malaysia Apr 22, 2024 15:00 JST
| TOYOTA GAZOO Racing takes a one-two in Croatian thriller Apr 22, 2024 10:47 JST
| First-ever Mazda CX-80 Crossover SUV Unveiled in Europe Apr 19, 2024 13:50 JST
| Fujitsu develops technology to convert corporate digital identity credentials, enabling participation of non-European companies in European data spaces Apr 19, 2024 10:17 JST
| Mitsubishi Heavy Industries and NGK to Jointly Develop Hydrogen Purification System from Ammonia Cracking Gas Apr 18, 2024 17:01 JST
| Toyota Launches All-New Land Cruiser "250" Series in Japan Apr 18, 2024 13:39 JST
|
More Latest Release >>
|