|
Fujitsu and OIST Begin Joint R&D on Reinforcement Learning Algorithms Utilizing Neuroscience Insights
In pursuit of AI with human-like applied skills
Okinawa Institute of Science and Technology Graduate University (OIST), Fujitsu Laboratories Ltd.
KAWASAKI, Japan, Oct 12, 2016 - (JCN Newswire) - The Okinawa Institute of Science and Technology Graduate University (OIST) and Fujitsu Laboratories Ltd. today announced that they have commenced joint research to develop reinforcement learning algorithms with human-like applied skills, putting to use the latest neuroscience knowledge.
Recently, a variety of successful cases has put the spotlight on reinforcement learning, in which a computer acquires an action selection policy suited to the environment through trial and error, based on rewards for certain actions. With reinforcement learning techniques to date, however, the designer had to specify the information of interest beforehand, and the learning process had to be done over again for each problem, limiting applicability in the real world.
In this joint research, the partners will look at how the human brain learns, and incorporate those mechanisms into reinforcement learning algorithms, with the goal of producing an artificial intelligence (AI) with human-like applied skills to tackle a wide range of real-world problems.
Background
 | | Figure: Image of joint research results | | |
Machine learning, which creates a variety of task executors based on the data, has also moved forward in practical terms in the areas of image and voice recognition, and now forms the core of AI technology. One particularly appealing subcategory is reinforcement learning, in which the computer acquires an action-selection policy adapted to an environment through trial and error, based on rewards for certain actions.
Issues
The human brain is capable of learning applied skills in which it can select what is important from different kinds of information, apply past learning to new problems, and select a behavior as needed from among those suited to a particular situation, or that have a greater degree of certainty and safety. For example, a person in a crowd can instantly identify people or obstacles they need to watch out for, depending on the direction they wish to take, and avoid collisions. A person who already knows how to play chess can also generally quickly pick up shogi (a Japanese game similar to chess). Moreover, it is possible for a good player to make an appropriate choice according to the situation, depending on if a standard move should be played, or if a move based on deeper thoughts is required. But existing reinforcement learning techniques need a designer to specify the information of interest beforehand, and need to retrain for every problem, which limits applicability in the real world.
About the Joint Research
OIST and Fujitsu Laboratories will focus on such learning mechanisms contained in human brains and incorporate them based on the latest neuroscience insights to develop reinforcement learning algorithms with greater applied skills, and will work to create an AI that can autonomously modulate itself, unlike earlier AI that needed human intervention.
Figure: Image of joint research results
http://www.acnnewswire.com/topimg/Low_FujitsuOIST1012.jpg
Specifically, they plan to develop new technologies in the following three areas where needs are high, from within those issues set for practical application:
1. Technology to automatically extract information, suitable to reinforcement learning, from within enormous volumes of data that automatically changes.
2. Transfer learning technology to apply past experience to create an action selection policy for a separate problem.
3. Cooperative-concurrent reinforcement learning technology to select from many policies an appropriate one depending upon conditions to take an action.
Professor Kenji Doya of OIST and his research team will focus on mathematical modeling of neural computation structures from a neuroscience perspective, and apply that to reinforcement learning algorithms. Fujitsu Laboratories will jointly develop algorithms based on an optimization and control engineering perspective, and to investigate implementation methods that make full use of computing resources.
Future Plans
Moving forward, OIST and Fujitsu Laboratories will begin work on the problems of handling massive volumes of input data, and selecting actions where multiple policies learn in parallel, such as policies that can flexibly adapt in response to changes in the environment or more conservative responses.
Fujitsu Laboratories aims to build on the results of this joint research to develop AI solutions for real-world applications, such as ICT system management and energy management. Computers will thereby more efficiently be able to acquire policies adjusted to environments without needing manual setting or adjusting.
Fujitsu Laboratories also aims to develop new technologies that can serve as the core of Fujitsu's AI technology, Human Centric AI Zinrai.
About OIST
Established in November 2011, Okinawa Institute of Science and Technology Graduate University (OIST) is an interdisciplinary graduate school offering a 5-year PhD program in Science. Its mission is to provide internationally outstanding education and research in science and technology, thus contributing to the sustainable development of Okinawa. More than 400 researchers from over 50 countries are conducting their research in Neuroscience, Molecular, Cellular, and Developmental Biology, Environmental and Ecological Science, Mathematical and Computational Science, Physics and Chemistry.
About Fujitsu Laboratories
Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.
Contact:Okinawa Institute of Science and Technology Graduate University (OIST)
E-mail: media@oist.jp
Fujitsu Laboratories Ltd.
Knowledge Information Processing Laboratory
E-mail: bsrl@ml.labs.fujitsu.com
Fujitsu Limited
Public and Investor Relations
Tel: +81-3-3215-5259
URL: www.fujitsu.com/global/news/contacts/
Source: Fujitsu Ltd
Sectors: Electronics
Copyright ©2024 JCN Newswire. All rights reserved. A division of Japan Corporate News Network. |