Fujitsu Develops AI Model to Determine Concentration During Tasks Based on Facial Expression
KAWASAKI, Japan, Mar 10, 2021 - (JCN Newswire) - Fujitsu Laboratories Ltd. announced the successful development of a new, general purpose AI model for estimating concentration levels that can capture and quantify with high accuracy the degree of concentration when a person is performing various tasks. The model accomplishes this by detecting subtle changes in muscle movements that reveal differences in facial expression that occur when a person is concentrating or not.
|Fig. 1 New method overview|
|Fig. 2 Concentration Estimation Overview|
Conventionally, models that use AI to quantify concentration have been created by training algorithms to recognize the expressions and behaviors of people performing specific tasks, such as e-learning. Since facial expressions and behavior differ depending on the tasks involved and the cultural background in which each person grew up, however, the models created had to be individual models, and the challenge was to develop individual AI models for different, specific situations.
Fujitsu has succeeded in the development of an AI solution that can identify common features that indicate concentration or non-concentration not easily influenced by subjects' cultural backgrounds. The AI leverages proprietary technology that detects action units (AU)(1), which express the "units" of movement corresponding to each muscle or each muscle group of the face based on an anatomically based classification system, with the world's highest accuracy(2). The technology captures changes over a short period of a few seconds, such as a tense mouth, and long-term changes over periods of tens of seconds, such as staring intently, with time frames optimized for each action unit. Data was collected from a total of 650 people from a variety of regions including the United States and China, in addition to Japan, engaged in tasks like memorization and searching that require concentration to create a machine learning data set. This was used to create a general purpose AI model that can determine levels of concentration without relying on task-specific behaviors. The effectiveness of this model was subsequently verified using this data set, and it was confirmed that subjects' degree of concentration could be quantitatively estimated with an accuracy rate of over 85%.
Ultimately, this technology delivers AI support that offers the possibility of using accurate data about concentration and attention to improve the efficiency and productivity of peoples' activities online, as more and more aspects of life move online amidst the COVID-19 pandemic.
Newly Developed Technology
Fujitsu has developed a general purpose AI model that quantifies concentration levels without depending on the detection of a specific task and regardless of cultural background by leveraging unique technology that detects facial expressions through Action Units with the world's highest accuracy.
Using proprietary Action Unit detection technology that accurately learns the relative changes of facial expression muscles by training on a pair of images in which the intensity of movements of facial expression muscles differs, it becomes possible to capture changes over a short period of a few seconds, such as a tense mouth, and long-term changes over a period of several tens of seconds, such as staring intently, in time frames optimized for each action unit. A highly accurate concentration estimation AI model was then developed using a new method of integrated concentration estimation (Fig. 1).
This AI model was trained on a data set based on results of memorization and searching tasks that require concentration, drawing from a diverse pool of 650 people from Japan, the U.S., and China. The resulting general purpose AI model can quantify the degree of a subject?s concentration or lack of concentration for a variety of tasks, such as whether someone is concentrating during e-learning, the degree to which someone is immersed in desk work, or the concentration levels of people engaged in plant assembly work, on a range from 0.0 (complete lack of concentration) to 1.0 (maximum concentration).
In order to verify the versatility of the AI model, Fujitsu constructed a data set for a total of 650 people from a variety of regions, including in Japan as well as in the U.S. and China. Using the newly developed AI model, the concentration levels of participants in each country was estimated for a series of tasks, and it was possible to estimate the degree of concentration with more than 85% accuracy. This result is comparable to or higher than the results from the latest international academic conferences quantifying the degree of concentration of students on e-learning tasks. It was confirmed that this method works effectively despite possible variations in cultural background.
In addition, when the developed AI model was evaluated using data that included both concentration and non-concentration due to drowsiness, which was recorded by a drive simulator, it showed a high correlation with the correct data labeled based on a national Japanese research organization's index for measuring sleepiness(3), and it was confirmed that the decline in concentration due to sleepiness could be estimated. This confirms that the AI model can be applied to different tasks that it is not specifically trained on.
In the future, in order to expand the application of this technology to various services such as online classes, online meetings, and sales activities, which are expanding globally amidst the "New Normal" , we will further promote the rigorous verification of such technologies from the perspective of AI ethics, with the aim of realizing the practical use of trust-worthy AI technologies.
(1) Action Unit
The movement unit of each part of the face corresponding to about 40 kinds of facial expression muscles defined in the Facial Action Coding System (https://www.paulekman.com/facial-action-coding-system/) proposed based on the anatomical knowledge. Each Action Unit is defined by five levels of intensity corresponding to the movement of the facial muscles.
(2) with the world's highest accuracy
Action Unit recognition technology that won first place in the competition for action unit detection accuracy held at the IEEE International Conference on Automatic Face & Gesture Recognition (FG 2020).
(3) a national Japanese research organization?s index for measuring fatigue
The NEDO Sleepiness Index, which measures sleepiness in a person being monitored by multiple observers. The level of sleepiness is defined by five levels.
About Fujitsu Laboratories
Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.
Source: Fujitsu Ltd
Sectors: Artificial Intel [AI]
Copyright ©2021 JCN Newswire. All rights reserved. A division of Japan Corporate News Network.
More Latest Release >>
Eisai and Merck & Co., Inc., Kenilworth, N.J., U.S.A. Receive Priority Review From FDA for LENVIMA (lenvatinib) Plus KEYTRUDA (pembrolizumab) Applications
May 07, 2021 11:08 JST
Showa Denko and Infineon Technologies Conclude Supply Contract and Development Agreement
May 06, 2021 17:30 JST
NEC Develops Neuroscience-inspired AI Technology for Time Series Analysis
May 06, 2021 14:13 JST
NEC Contributes to Development of Artificial DNA Aptamer that Binds to the Novel Coronavirus (SARS-CoV-2)
May 06, 2021 11:27 JST
Synopsis 2021: Hot Trends - Join the Summit 1-5 June
May 04, 2021 09:00 JST
Hard-Fought Hypercar Win for Toyota Gazoo Racing
May 03, 2021 04:25 JST
Komatsu, NTT DOCOMO, Sony Semiconductor Solutions and Nomura Research Institute to Launch "EARTHBRAIN"
Apr 30, 2021 16:35 JST
Toyota Developing Hydrogen Engine Technologies Through Motorsports
Apr 30, 2021 14:20 JST
Toyota Global Sales and Production Secures 90 Percent Level Year-on-Year in FY2021
Apr 28, 2021 16:46 JST
RESONA and Eisai Enter Into Business Alliance Aiming to Support People Living with Dementia and to Prevent Dementia in Saitama Prefecture, Japan
Apr 28, 2021 12:33 JST
NEC recognized in Gartner Magic Quadrant for 5G Network Infrastructure for Communications Service Providers as a Visionary
Apr 28, 2021 11:05 JST
LEXUS DESIGN AWARD 2021 Grand Prix Winner Announced
Apr 27, 2021 17:38 JST
AEON GLOBAL SCM and Toyota Starts to Consider Collaboration on Logistics Improvement and Carbon Neutrality Initiatives
Apr 27, 2021 16:15 JST
Suzuki, Subaru, Daihatsu, Toyota and Mazda Reach Agreement on Joint Development of Technical Specifications for Next-generation Vehicle Communications Devices
Apr 27, 2021 14:35 JST
MHIEC Supplies Incinerators for First Waste-to-Energy Plant in Xiaogan, Hubei Province, China
Apr 27, 2021 11:22 JST
Woven Planet Holdings, a Subsidiary of Toyota, Announces Acquisition of Lyft's Level 5 Division to Accelerate Software Innovation for Automated Driving Mobility
Apr 27, 2021 09:00 JST
Mitsubishi Heavy Industries Partner in Newly Established Hamburg Hydrogen Network to 'Make Hamburg Greener'
Apr 26, 2021 17:27 JST
NTT and Fujitsu Embark on Strategic Alliance to Drive "Realization of Sustainable Digital Society"
Apr 26, 2021 14:05 JST
AD ECU and OTA Unit Adopted in New Model Legend Capable of Over-the-Air (OTA) Vehicle Control Software Updating
Apr 26, 2021 11:35 JST
Honda to be Title Sponsor of the 2021 FIA Formula One Japanese Grand Prix
Apr 26, 2021 10:16 JST