Fujitsu Delivers Cashless, Contactless Retail Experience for Masked Shoppers with Hygienic, Multi-Factor Biometric Authentication Technology
KAWASAKI, Japan, Jan 21, 2021 - (JCN Newswire) - Fujitsu Laboratories, Ltd. has announced the development of a new multi-factor biometric authentication technology to deliver an innovative shopping experience for the "New Normal" era, combining non-contact biometrics that filter the verification target through facial data with identification performed via palm vein recognition. This technology enables identification with greater than 99% accuracy even when the user wears a mask, and will be showcased at a concept cashless Lawson convenience store at the Fujitsu Technology Square office in Shin-Kawasaki, Japan (1), for a field trial starting from January 2021.
|Fig. 1 Technology currently being verified|
|Fig. 2 Masks added to facial image data|
|Fig. 3 Image of the updated user interface|
|Fig. 4 Multi-factor biometric authentication terminal in use|
Users wearing masks present challenges to conventional facial recognition filtering technologies because a large part of the face is obscured, rendering authentication impossible in some cases. With the newly developed technology, however, differences in the appearance depending on the presence or absence of the mask can be absorbed by generating a composite image that combines the mask with the face image and training the model, achieving filtering accuracy of greater than 99%, or equivalent to that without a mask. Fujitsu has additionally enhanced its existing palm vein authentication sensor technology by improving the user interface so that users know how close to position their hand from the sensor for smooth authentication. This technology was ranked 6th amongst 147 participating global vendors and 1st place amongst Japanese vendors (2) in the face authentication vendor test conducted by the United States' National Institute of Standards and Technology (NIST).
In recent years, the use of biometric authentication technologies has been increasing, including in areas like the processing of payments at brick-and-mortar stores and in ID verification for events. Now, these technologies also promise to help limit the spread of COVID-19 by limiting human contact during transactions and verification processes. To this end, Fujitsu is accelerating the introduction of contactless user interfaces for authentication leveraging facial and palm vein recognition with a variety of field trials over the past year (Fig. 1).
In many parts of the world, mask-wearing has been highlighted by health officials as an important tool to help prevent the spread of infectious diseases like the COVID-19 virus. However, when face authentication is performed while wearing a mask, most of the face is hidden, and the accuracy of this method can sometimes deteriorate. With this in mind, Fujitsu has worked to improve the accuracy of multi-factor biometric authentication at its pilot store by combining facial filtering technology with palm vein recognition. In addition, when considering the introduction of the system for general users in brick-and-mortar stores going forward, it will become essential to improve the user interface of the system to improve user-friendliness, allowing users to register and authenticate themselves without complex explanations or intervention from store clerks.
Newly Developed Technology
Fujitsu Laboratories has developed a data expansion machine learning technology that enables highly accurate filtering even when the target user is wearing a mask.
The features of the developed technology are as follows.
With typical facial recognition technology, when a user is wearing a mask only the exposed eye area is checked in order to extract features such as the shape and position of the face. While this method can help reduce the influence of wearing a mask over an accurate reading, it cannot extract the features of the entire face, presenting the possibility that the target user cannot be recognized due to insufficient data.
In order to reduce this effect, the newly developed technology generates an image of the user's face without a mask while taking into account the extraction of features of the entire face, like its shape and contours. This means that even when the user is wearing a mask, the user can be recognized against the corresponding facial image can be narrowed down from a large database with the same level of accuracy as without a mask. Specifically, the technology estimates the position of the face based on facial features such as the position of the eyes and nose, and based on the estimation results, an artificial mask is resized and reshaped then superimposed over the face image to generate a natural masked facial image. In addition, the system uses various types of masks in order to deal with situations in which masks of various colors, patterns and shapes are worn by users (Fig. 2). This makes multi-factor authentication more hygienic and easier to use by allowing people to undergo authentication without removing their mask.
Improved user interface
The user interface of the palm vein authentication system has also been improved to enable smoother use. A palm-shaped light has been added to the sensor, and the color and the pattern of the light changes according to the distance of the hand, so that the appropriate height for accurate authentication is apparent (Fig. 3). This allows people who are not familiar with palm vein authentication to adjust their palms to the appropriate height for smooth, contactless authentication (Fig. 4).
By using the newly developed technology and user interface, Fujitsu hopes to provide safer and more secure services while preventing the spread of infectious diseases in a variety of situations, including payments at brick and mortar stores using biometric authentication and personal identification at leisure facilities.
To make sure users can do the authentication process by themselves using the developed technology and improved UI, Fujitsu will introduce this technology to a system currently under verification(3) at a concept cashless Lawson convenience store in Shin-Kawasaki Technology Square in cooperation with Lawson, a major Japanese convenience store chain. Fujitsu will conduct verification tests from January 21, 2021 with the aim of putting the system into practical use by the end of FY 2021.
(1) a concept cashless Lawson convenience store the Fujitsu Technology Square office in Shin-Kawasaki
Since February 2020, Fujitsu has been participating in a POC conducted by Lawson, Inc. for cashier-less solutions at a location in its offices. Based on the results of the POC, Lawson has been working with the Fujitsu as well as America's Zippin to identify business and technical issues.
(2) This technology was ranked 6th amongst 147 participating global vendors and 1st place amongst Japanese vendors
In the facial recognition vendor test conducted by the United States' NIST in November 2020.
FRVT Face Mask Effects
(3) Fujitsu will introduce this technology to a system currently under verification
Refers to system provided by VCOGNITION TECHNOLOGIES, INC "Zippin". The system integrates devices such as cameras and weight sensors necessary for automatic payment, AI functions for recognizing customers and products, and linking functions with payment and inventory management.
Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 130,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE:6702) reported consolidated revenues of 3.9 trillion yen (US$35 billion) for the fiscal year ended March 31, 2020. For more information, please see www.fujitsu.com.
About Fujitsu Laboratories
Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.
Source: Fujitsu Ltd
Sectors: Electronics, Cloud & Enterprise
Copyright ©2021 JCN Newswire. All rights reserved. A division of Japan Corporate News Network.
Latest Press Release
More Latest Release >>
DENSO Announces First Quarter Financial Results
Jul 30, 2021 17:12 JST
Showa Denko Group Challenges to Realize Carbon Neutrality by 2050
Jul 30, 2021 17:00 JST
Agreement Concluded for Mitsubishi Power to be Integrated into MHI
Jul 30, 2021 16:40 JST
DENSO Provides First Quarter Results and Progress Updates in Key Focus
Jul 30, 2021 15:48 JST
Port of Rotterdam Authority, Koole Terminals, Chiyoda Corporation and Mitsubishi Corporation Sign MoU to Study Commercial-Scale Hydrogen Imports to the Netherlands
Jul 30, 2021 12:30 JST
Mitsubishi Motors to Launch the All-New Outlander PHEV Model with a New-Generation PHEV System This Fiscal Year
Jul 30, 2021 10:46 JST
Eisai and Biogen Present Preliminary Assessment of the Clinical Effects of Lecanemab (BAN2401)
Jul 30, 2021 10:07 JST
Biogen and Eisai Announce Design of ADUHELM ICARE AD-US Study, the First Real-World Observational Phase 4 Study in Alzheimer's Disease at AAIC 2021
Jul 30, 2021 09:24 JST
"Tanegashima Loggerhead Sea Turtle Survey 2021" Takes Place amid Covid Restrictions
Jul 29, 2021 17:50 JST
Eisai Listed for 20th Consecutive Year in FTSE4Good Index Series, An Index for Socially Responsible Investment
Jul 29, 2021 17:34 JST
Mazda Production and Sales Results for June 2021 and for January through June 2021
Jul 29, 2021 17:16 JST
Honda Sets All-Time Accumulated Production Records for the First Half of Year in China
Jul 29, 2021 15:40 JST
Toyota Releases Sales, Production, and Export Results for the First Half of 2021
Jul 29, 2021 14:05 JST
Showa Denko Installs Additional Lines to Produce Aluminum Heat Radiators for xEVs
Jul 29, 2021 11:30 JST
Mitsubishi Corporation: Regeneration Project / Investment in Australian Integrated Carbon Pty Ltd
Jul 29, 2021 11:12 JST
Biogen and Eisai Announce ADUHELM (aducanumab-avwa) Data Presentations at Alzheimer's Association International Conference 2021
Jul 27, 2021 09:00 JST
Mitsubishi Shipbuilding Holds Launch Ceremony in Shimonoseki for First MRRV for the Philippines Department of Transportation
Jul 26, 2021 15:56 JST
Eisai: FDA Approves LENVIMA (lenvatinib) Plus KEYTRUDA (pembrolizumab) Combination for Patients With Certain Types of Advanced Endometrial Carcinoma
Jul 23, 2021 09:17 JST
Suzuki and Daihatsu Join Commercial Japan Partnership for Dissemination of CASE Technologies in Mini-commercial Vehicles
Jul 21, 2021 17:09 JST
Eisai to Present Latest Data on Pipeline Assets in The Area of Alzheimer's Disease and Dementia at AAIC 2021
Jul 21, 2021 10:34 JST