Document Type

Thesis - Open Access

Award Date

2020

Degree Name

Master of Science (MS)

Department / School

Electrical Engineering and Computer Science

First Advisor

Sung Shin

Keywords

Colorization, Computer vision, Generative Adversarial Nets

Abstract

Thermal image colorization into realistic RGB image is a challenging task. Thermal cameras are easily to detect objects in particular situation (e.g. darkness and fog) that the human eyes cannot detect. However, it is difficult to interpret the thermal image with human eyes. Enhancing thermal image colorization is an important task to improve these areas. The results of the existing colorization method still have color ambiguities, distortion, and blurriness problems. This paper focused on thermal image colorization using pix2pix network architecture based on Generative Adversarial Net (GAN). Pix2pix is a model that transforms thermal image into RGB image, but our proposed model used three input types of images which are present as frame thermal image, present frame RGB image, and previous frame RGB image. By extracting the color information (i.e. luminance and chrominance) of the previous frame RGB image, the result obtained a more realistic RGB image. Experiments use two kinds of evaluation method, which are quantitative measure and qualitative measure. First, quantitative measure is the calculation of specific numerical scores, the method names are PSNR and SSIM. Second, qualitative measure is human subjective evaluation. Evaluation method compared and evaluated pix2pix and our proposed method with the two types of measuring method.

Library of Congress Subject Headings

Computer vision.
Infrared imaging.
Roads.

Format

application/pdf

Number of Pages

40

Publisher

South Dakota State University

Download

Share

COinS
 

Rights Statement

In Copyright