NEC develops technology for disaster damage assessment using a Large Language Model (LLM) and image analysis
- Enables swift responses based on disaster situations through the constant collection of field images to determine what is happening and where -
TOKYO, Aug 25, 2023 - (JCN Newswire) - NEC Corporation (TSE: 6701) has developed a technology for disaster damage assessment using a Large Language Model (LLM) and image analysis. This technology enables users to immediately and accurately assess the extent and location of damage from the multitude of images collected when a disaster strikes. Going forward, NEC will contribute to the acceleration of evacuation guidance, rescue efforts, and other initial response activities in the event of a disaster by providing this technology to government ministries and municipal authorities in charge of disaster response.
![](https://photos.acnnewswire.com/tr:n-650/2502-01_s.jpg) | Figure 1: Result of narrowing down field images |
In recent years, the world has witnessed a rise in the frequency and severity of natural disasters, including intensified torrential rains and massive earthquakes. When disasters occur, it is vital to quickly and accurately assess the damage to expedite initial response activities such as evacuation guidance and rescue efforts for disaster victims. However, the realization of a rapid initial response remains a challenge because precipitation distribution maps and seismic intensity distribution maps, for example, as well as textual information received from residents, do not include sufficient details on the extent and location of damages. In contrast, images from disaster-stricken areas provided to municipalities and other entities (images captured by smartphones, drive recorders, CCTV, etc.) hold great promise as they contain extensive damage and geographical location information.
In an effort to accelerate initial response activities, NEC has developed a technology that can be used to quickly and accurately narrow down which images are necessary for assessing the impact of a disaster, and then display these images on a map with street address-level accuracy.
Features of the new technology
1. Narrows down field images in accordance with a user's intent
Images can be narrowed down from a multitude of field images to include only those aligned with a user's intent by utilizing semantic interpretation of words of an LLM and image analysis to determine image similarity.
Image recognition technology has conventionally been used for narrowing down images to those that are relevant for users. However, these technologies are only capable of recognizing images pre-trained, thereby limiting which images can be narrowed down. This has made it difficult to conduct surveys in accordance with a user's intent, which varies depending on the type and scale of a disaster, the affected areas, and the extent of the situation.
This newly developed technology utilizes LLM to narrow down field images using keywords. Moreover, employing image analysis and specifying the scene a user would like to search for makes it possible to narrow down scenes that are difficult to express in words. In other words, by combining LLM and image analysis, users can accurately narrow down the images to only those matching their intentions, thereby making it possible to quickly respond to disasters as they unfold.
2. Displays the extent and location of damage on a map at street address level
In the case of field images for which the location of a disaster-stricken area is unknown, the location can be estimated with street address-level accuracy and then displayed on a map by comparing the images with aerial imagery and map data covering extensive areas.
Field images provided in emergency situations such as disasters do not necessarily include location information, which can sometimes make it difficult to identify disaster-stricken areas. While NEC has developed technologies for estimating locations through the utilization of satellite images and aerial photographs in the past(1), this latest technology has achieved the world's highest matching accuracy(2)(3), enabling location estimation with a high degree of precision, even for field images captured during a disaster.
To estimate locations, this technology automatically extracts areas such as roads, buildings, and traffic signals from field images and then matches them with map layout information (the shape and layout of roads, buildings, etc.). In this way, highly accurate estimation of a photographed location is made possible, even for images of partially collapsed buildings or partially flooded roads, by proactively using information on roads with a lower risk of damage in the event of an earthquake and information on buildings with a lower risk of submergence in the event of flooding to perform matching.
NEC plans to put this newly developed technology into practical use within FY2025 in an effort to help accelerate evacuation guidance, rescue efforts, and other initial response activities in the event of a disaster. In addition, NEC remains committed to making society safer, more secure, and more convenient by expanding the use of LLM and image analysis technology to other applications.
(1) February 10, 2022: NEC develops technology capable of estimating the locations of landscape images from satellite imagery and aerial photographs (press release available in Japanese only) https://jpn.nec.com/press/202202/20220210_03.html (2) Top-1% retrieval rate based on retrieval tasks involving 8,884 aerial images from the publicly available CVUSA data set (in the case of ground view images for a 90 degrees field of view) (3) SemGeo: Semantic Keywords for Cross-View Image Geo-Localization https://ieeexplore.ieee.org/document/10094763
About NEC Corporation
NEC Corporation has established itself as a leader in the integration of IT and network technologies while promoting the brand statement of "Orchestrating a brighter world." NEC enables businesses and communities to adapt to rapid changes taking place in both society and the market as it provides for the social values of safety, security, fairness and efficiency to promote a more sustainable world where everyone has the chance to reach their full potential. For more information, visit NEC at www.nec.com.
Source: NEC Corporation Sectors: Cloud & Enterprise
Copyright ©2024 JCN Newswire. All rights reserved. A division of Japan Corporate News Network.
|
Latest Release
![NTT DOCOMO](http://www.jcnnewswire.com/image/toppage/Docomo_Top.jpg) DOCOMO and NTT Com Jointly Demonstrate Practicality of DOCOMO's New Multi-platform Cloud-rendering Technology Jul 26, 2024 17:05 JST
| ![Tanaka Holdings Co., Ltd.](http://www.jcnnewswire.com/image/toppage/Tanaka_Logo_2s.jpg) TANAKA Precious Metals Provided Award Items and Ceremony Souvenirs for the International Friendly Matches of the Japan Men's National Blind Football Team at the "DAICEL Blind Football Japan Cup 2024 in Osaka" on July 7 Jul 26, 2024 03:00 JST
| ![Eisai](http://www.jcnnewswire.com/image/toppage/eisai45.jpg) Eisai and EcoNaviSta Enter into Business Alliance Agreement Aimed at Building a Dementia Ecosystem and Commence Collaboration Jul 25, 2024 10:30 JST
| ![Hitachi, Ltd.](http://www.jcnnewswire.com/image/toppage/hitachi.jpg) Hitachi Awarded Largest Contract in Singapore to Supply 450 Lifts at HDB Blocks Jul 24, 2024 16:27 JST
| ![Hitachi, Ltd.](http://www.jcnnewswire.com/image/toppage/hitachi.jpg) Hitachi to Announce Capital Reorganization of Air Conditioning Joint Venture Jul 24, 2024 15:02 JST
| ![Eisai](http://www.jcnnewswire.com/image/toppage/eisai45.jpg) Eisai to Present Dual-Acting Lecanemab Three-Year Efficacy and Safety Data and Discuss Long-Term Outcomes of Continued Treatment at the Alzheimer's Association International Conference 2024 Jul 23, 2024 20:23 JST
| ![Fujitsu Ltd](http://www.jcnnewswire.com/image/toppage/Fujitsu.Logo.68.jpg) Toyota Material Handling Japan and Fujitsu launch Japan's first service for evaluating forklift safety in the cloud using AI Jul 23, 2024 11:26 JST
| ![Toyota Motor Corporation](http://www.jcnnewswire.com/image/toppage/ToyotaBb.68.jpg) AEON and CJPT working to resolve logistics industry issues and achieve carbon neutrality at AEON Fukuoka XD Jul 22, 2024 13:52 JST
| ![Toyota Motor Corporation](http://www.jcnnewswire.com/image/toppage/ToyotaBb.68.jpg) Rovanpera and Ogier score another TOYOTA GAZOO Racing one-two Jul 22, 2024 12:30 JST
| ![Honda Motor Co, Ltd](http://www.jcnnewswire.com/image/toppage/honda.gif) Team HRC with Japan Post Wins 45th Suzuka 8 Hours Endurance Road Race Jul 22, 2024 11:33 JST
| ![Honda Motor Co, Ltd](http://www.jcnnewswire.com/image/toppage/honda.gif) Honda to Hold its Official e-Motorsports Event, "Honda Racing eMS 2024" Jul 19, 2024 20:04 JST
| ![Mitsubishi Heavy Industries, Ltd.](http://www.jcnnewswire.com/image/toppage/MHI_newT.jpg) MHI America Acquires Three Utility-Scale Solar Power Projects in Pennsylvania, Advancing the Company's Energy Transition Strategy Jul 19, 2024 19:04 JST
| ![JCB](http://www.jcnnewswire.com/image/toppage/JCB55.jpg) JCB and Worldline unveil a new whitepaper offering European merchants invaluable insights into facilitating seamless payments for international consumers Jul 19, 2024 12:00 JST
| ![Fujitsu Ltd](http://www.jcnnewswire.com/image/toppage/Fujitsu.Logo.68.jpg) Fujitsu Chosen to Help Solving Social Issues Caused by Fake News Jul 19, 2024 11:30 JST
| ![Champion REIT](http://www.jcnnewswire.com/image/toppage/ChampionREIT1_Top.jpg) Champion REIT holds first 'ESG Week' Jul 18, 2024 20:14 JST
| ![Lexus International](http://www.jcnnewswire.com/image/toppage/Lexus_68.jpg) Lexus LBX Adds a New High Performance Variant, the LBX "MORIZO RR" Jul 18, 2024 17:25 JST
| ![NEC Corporation](http://www.jcnnewswire.com/image/toppage/NEC.62.jpg) VitalLife and Bumrungrad International Hospital in Thailand Launch NEC's FonesVisuas Test: First Major Deployment Outside Japan, Revolutionizing Disease Risk Prediction Jul 18, 2024 15:34 JST
| ![Fujitsu Ltd](http://www.jcnnewswire.com/image/toppage/Fujitsu.Logo.68.jpg) Fujitsu publishes CHRO Roundtable Report 2024, summarizing the challenges and implications of the implementation of data-driven human capital management Jul 18, 2024 10:44 JST
| ![Fujitsu Ltd](http://www.jcnnewswire.com/image/toppage/Fujitsu.Logo.68.jpg) Fujitsu-sponsored professional golfer Ayaka Furue victorious in the Amundi Evian Championship Jul 16, 2024 23:26 JST
| ![Mitsubishi Corporation](http://www.jcnnewswire.com/image/toppage/MC.68.jpg) Neste and Mitsubishi Corporation agree on strategic partnership to develop supply chains for renewable chemicals and plastics Jul 16, 2024 18:36 JST
|
More Latest Release >>
|