May, 10 2019 11:21 JST

Source: Fujitsu Ltd

Fujitsu Develops Automatic Labeling Technology to Accelerate AI Use of Time-Series Data

Expected to see application in monitoring for people and machines using smartphones and equipment sensors

TOKYO, May, 10 2019 - (JCN Newswire) - Fujitsu Laboratories Ltd. and Kumamoto University has announced the development of technology to easily create the training data necessary to apply AI to time-series data, such as those from accelerometers and gyroscopic sensors.

Time-series data obtained from sensors does not include anything other than every-changing numerical data. Therefore, in order to create training data for use in machine learning, it was necessary to manually attach finely detailed labels to the data in accordance to its changing values, indicating what was done and when at each point where the numerical values changed. For this reason, huge numbers of man-hours were required, and the use of AI with time-series data had seen limited progress.

Now, Fujitsu Laboratories and Kumamoto University have enabled the automatic creation of highly accurate training data with appropriate labels for each action, just by manually attaching a single label to each longer time period, even if they include multiple actions, indicating the major action in that time period according to human judgement. Because this significantly reduces the number of man-hours required, this technology will accelerate the use of AI with time-series data. The new development is expected to enable easier installation of services such as fall detection, operational functionality checks, and abnormality detection for machines, in smartphones and various other devices.

Development Background

In recent years, with the evolution of technology such as the Internet of Things (IoT), it has become possible to obtain a large amount time-series data from a variety of sensors. For example, by developing a functionality in which AI can determine the meaning of the motions of people and objects from the characteristics captured by accelerometers, it is expected that advanced functionality for monitoring people and machines can be incorporated into smartphones and various equipment. In order to apply AI to this sort of time-series data, it is necessary to create training data to train AI.
Figure 1: Examples of AI monitoring using time-series data


Time-series data obtained from sensors consists of just numbers recording values from the sensors moment by moment, so it is necessary to attach meaning to the data indicating "what" (labels) and "when" (segments) in creating training data for AI. For example, data from accelerometers when a person goes running includes intermingled data from when a person is running, when they are walking, and when they are standing still. So in order to create training data for AI, the data needs to be separated into segments, and labeled as "Running" "Walking" and "Stopped."

Conventionally, to create this sort of training data, the typical process was to record a video of the behavior while measuring the time-series data, identify the type of behavior seen with the changes in the numerical values at a second-by-second level, and manually attaching the labels. Because this process required a significant amount of work and time, the application of AI to time-series data saw limited progress, and there was a demand for a technology to automate the labeling process and reduce the workload.

About the Newly Developed Technology

Now, Fujitsu Laboratories and Kumamoto University have developed a technology that can automatically create highly accurate training data that enables the use of AI with time-series data, just by inputting a label expressing the main action underway over a longer time segment (for example, one hour). The features of this newly developed technology are as follows.

1. Extracting appropriate segments

Looking at time-series data, this technology can learn characteristics of times when the same activity is ongoing and characteristics of times when the activity changes, and can then automatically extract appropriate time periods from time-series data with actions based on same characteristics(1).

2. Highly accurate labeling

With this technology, users attach a single broad label for long segments of data (for example, one hour), such as "running" if the majority of the segment is spent running. After a deep neural network is trained to predict such labels and the resulting estimated labels can be used to calculate the segment of the time-series data that most contributed to that prediction. Also by adding up the time periods that have a high degree of contribution as label candidates, this system can create training data capable of accurate prediction.
Figure 2: Diagram of the newly developed technology


Fujitsu Laboratories and Kumamoto University conducted a trial where they attached labels to time-series data from accelerometers while performing mock work processes in a factory such as polishing. As a result, they confirmed that this technology was able to correctly label 92% of time periods. They judged that this was equivalent to the highly accurate results obtained when using data that was manually labelled in detail as training data. With this technology, one can easily create training data for AI use from time-series data, and further development is expected for the functionality that uses AI to determine activities captured by sensors. In addition, because this technology makes determinations based on just the numerical characteristics of time-series data, and does not rely on the type of sensor, it could also be applied to time-series data obtained from devices such as temperature sensors and pulse wave sensors.

Future Plans

Fujitsu Laboratories and Kumamoto University aim to conduct field trials using time-series data from a variety of fields, with the goal of commercializing this technology as a preprocessing technology for time-series data as part of Fujitsu Human Centric AI Zinrai, Fujitsu Limited's AI technology, during fiscal 2019.

(1) Automatically extract appropriate time periods with actions based on same characteristics from time-series data Using technology from Kumamoto University.

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see:

About Fujitsu Ltd
Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. Approximately 132,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. For more information, please see

This release can be found at

Fujitsu Laboratories Ltd.
Artificial Intelligence Laboratory
E-mail: [email protected]

Fujitsu Limited
Public and Investor Relations
Tel: +81-3-3215-5259
Source: Fujitsu Ltd
Sectors: Electronics, Enterprise IT

Copyright ©2019 JCN Newswire. All rights reserved. A division of Japan Corporate News Network.


Figure 1: Examples of AI monitoring using time-series data
Figure 2: Diagram of the newly developed technology

Related Press Release

Fujitsu and Qualcomm Complete 5G Data Calls in Sub-6 GHz and mmWave Spectrum Bands
August 22 2019 10:13 JST
Fujitsu Develops AI Disaster Mitigation Technology to Predict River Flooding with Limited Data
August 16 2019 13:15 JST
Fujitsu Initiates Year-Round Recruitment
August 09 2019 10:27 JST
Fujitsu RunMyProcess Joins Google Cloud Partner Program
August 08 2019 08:00 JST
Fujitsu Launches Latest Version of its VPS Digital Production Preparation Tool, Supporting Improved Manufacturing Productivity
August 05 2019 10:25 JST
Fujitsu's Encryption Technology for Biometric Information Provides Safer Authentication in Open Environments
August 02 2019 10:26 JST
Fujitsu Delivers Complete Set of 5G Base Station Products to NTT DOCOMO for Commercial 5G Service
July 31 2019 10:17 JST
Fujitsu to Deliver Australia's Most Powerful Supercomputer to Help Solve Complex and Pressing Global Challenges
July 29 2019 09:17 JST
Fujitsu Harnesses Quantum-Inspired Digital Annealer Technology to Optimize Output Efficiency in Power Generation for Renewable Energy Devices
July 19 2019 10:40 JST
Fujitsu Completes Survey of Business Leaders across 9 Countries on the Global State of Digital Transformation
July 19 2019 10:09 JST
More Press release >>

Latest Press Release

More Latest Release >>