tech

NEC, Tokyo Institute of Technology use AI to dramatically increase image clarity under severe conditions

1 Comment

NEC Corp and Tokyo Institute of Technology (Tokyo Tech) have announced their joint development of a multi-modal image fusion technology that dramatically improves the clarity of images by using artificial intelligence (AI) to automatically combine visible images taken by standard cameras with non-visible images taken by specialized devices, such as thermal or terahertz cameras.

In recent years, technological advancements and cost reductions for specialized devices that photograph non-visible images, such as thermal cameras, which capture heat, and X-ray cameras, have enabled them to be used for an expanding range of purposes, including nighttime monitoring under severe weather conditions, such as dense fog. However, these cameras tend to provide images of poor resolution and quality in comparison to images taken of visible subjects.

Conventionally, in order to analyze non-visible and visible images of the same subject, images had to be viewed and compared separately, or they had to be manually combined by a trained expert. Moreover, the detection of abnormalities or hazards contained in non-visible images could be easily overlooked when combining the images.

This new technology uses AI to achieve greater image visibility by automatically selecting highly visible parts from multiple images and combining them, while enhancing the smallest characteristics contained in non-visible images. Specifically, AI carries out detailed examination of each image in order to assess the degree of visibility of each part, then automatically extracts the best areas from each image, taking environmental characteristics into consideration, such as brightness, the direction of light and obstacles.

"As this technology enables instant visual clarification, even under harsh conditions, it allows users to make well informed evaluations. For example, it can be applied to monitoring systems to assist with nighttime observations, or for infrastructure inspection devices to improve the detection of interior and exterior abnormalities, such as cracking," said Akio Yamada, General Manager, Data Science Research Laboratories, NEC Corporation.

"Until now, a specialist had to manually carry out complex conversion tasks in order to combine images taken by different types of cameras. This technology eliminates the need for such manual work, using AI to effectively and automatically combine images taken by different cameras. This also increases visibility by actively utilizing the strong points of each visible image and non-visible image, even when the images are difficult to visualize," said Professor Masatoshi Okutomi, School of Engineering, Tokyo Institute of Technology.

Moreover, AI analyzes the slightest clue to detecting an abnormality and hazard in a non-visible camera image and automatically generates a multi-modal (fusion of visible and non-visible) image with exceptionally high visibility, while properly regulating the degree of enhancement to avoid causing image breakdowns, such as clipped highlights and crushed blacks.

© NEC

©2021 GPlusMedia Inc.

1 Comment
Login to comment

Japan loves buzzwords

Since Dear Leader mentioned using robots and AI instead of hiring foreigners to overcome labour shortage, everyone is ensuring to include the word AI in anything they do

-1 ( +0 / -1 )

Login to leave a comment

Facebook users

Use your Facebook account to login or register with JapanToday. By doing so, you will also receive an email inviting you to receive our news alerts.

Facebook Connect

Login with your JapanToday account

User registration

Articles, Offers & Useful Resources

A mix of what's trending on our other sites