Комплексування зображень з видимого та тепловізійного каналів у формі комплексної функції

Y. Y. Khaustov; D. Y. Khaustov; Y. V. Ryzhov; Е. I. Lychkovskyy; Y. A. Nastishin

doi:10.33577/2312-4458.22.2020.20-31

Authors

Y. Y. Khaustov Hetman Petro Sahaidachnyi National Army Academy, Lviv, adjunct of scientific and organizational department, Ukraine https://orcid.org/0000-0003-4553-0702
D. Y. Khaustov Hetman Petro Sahaidachnyi National Army Academy, Lviv, doctoral student of scientific and organizational department, Ukraine https://orcid.org/0000-0001-5542-2831
Y. V. Ryzhov Hetman Petro Sahaidachnyi National Army Academy, Lviv, chief of research laboratory (information and geographic information systems) of the research and development department (command and control systems) of the Army scientific center, Ukraine https://orcid.org/0000-0002-0132-3931
Е. I. Lychkovskyy Lviv Danylo Halytsky National Medical University, Lviv, manager of department of biophysics., Ukraine https://orcid.org/0000-0003-1236-8614
Y. A. Nastishin Hetman Petro Sahaidachnyi National Army Academy, Lviv, senior staff scientist of research department (engineering troops) of the Army scientific center., Ukraine https://orcid.org/0000-0001-7521-3906

DOI:

https://doi.org/10.33577/2312-4458.22.2020.20-31

Keywords:

digital image processing, image fusion, infrared imaging, image quality assessment

Abstract

We propose an algorithm for the fusion of partial images collected from the visual and infrared cameras such that the visual and infrared images are the real and imaginary parts of a complex function. The proposed image fusion algorithm of the complex function is a generalization for the algorithm of conventional image addition in the same way as the addition of complex numbers is the generalization for the addition of real numbers. The proposed algorithm of the complex function is simple in use and non-demanding in computer power. The complex form of the fused image opens a possibility to form the fused image either as the amplitude image or as a phase image, which in turn can be in several forms. We show theoretically that the local contrast of the fused phase images is higher than those of the partial images as well as in comparison with the images obtained by the algorithm of the simple or weighted addition. Experimental image quality assessment of the fused phase images performed using the histograms, entropy shows the higher quality of the phase images in comparison with those of the input partial images as well as those obtained with different fusion methods reported in the literature.

References

Castanedo F. A Review of Data Fusion Techniques / F. Castanedo // The ScientificWorld Journal. ¬ 2013. ¬ 19р. Article ID: 70450, DOI: http://dx.doi.org/10.1155/2013/ 704504

Khaustov Ya.Ye. Image fusion for a target sightseeing system of armored vehicles / Ya.Ye. Khaustov, D.Ye. Khaustov, Е. Lychkovskyy, Ye. Ryzhov, Yu.A. Nastishin // Development and modernization military equipment. Military Technical Collection – Lviv, 2019. ¬ no. 21 ¬ P. 28¬37. DOI: https://doi.org/10.33577/2312-4458.21.2019.28-37 .

Kong W. Adaptive fusion method of visible light and infrared images based on non-subsampled shearlet transform and fast non-negative matrix factorization / W. Kong, Y. Lei, H. Zhao // Infrared Physics & Technology. ¬ 2014. ¬ vol. 67. ¬ P. 161–172. DOI: http://dx.doi.org/10.1016/j.infrared. 2014. 07.019

Ma J. Infrared and visible image fusion via gradient transfer and total variation minimization / J. Ma, Ch. Chen, Ch. Li, J. Huang // Information Fusion. ¬ 2016. ¬ vol. 31. ¬ P. 100–109. DOI: http://dx.doi.org/10.1016/j.inffus.2016.02. 001

Ma J. FusionGAN: A generative adversarial network for infrared and visible image fusion / J. Ma, W. Yu, P. Liang, Ch. Li, J. Jiang // Information Fusion. ¬ 2019. ¬ vol. 48. ¬ P. 11-26. DOI: https://doi.org/10.1016/j.inffus. 2018.09.004

Ma J. Infrared and visible image fusion via detail preserving adversarial learning / J. Ma, P. Liang, W. Yu, Ch. Chen, X. Guo, J. Wu, J. Jiang // Information Fusion. ¬ 2020. ¬ vol. 54. ¬ P. 85-98. DOI: https://doi.org/10.1016/j. inffus.2019.07.005

Ma J. Infrared and visible image fusion methods and applications: A survey / J. Ma, Y. Ma, C. Li // Information Fusion. ¬ 2019. ¬ vol. 45. ¬ P. 153-178. DOI: https://doi.org/ 10.1016/j.inffus.2018.02.004

Zitova B. Image Registration Methods: A survey / B. Zitova, J. Flusser // Image and Vision Computing. ¬ 2003. ¬ vol. 21. ¬ P. 977-1000. DOI: https://doi.org/10.1016/S0262-8856(03)00137-9

Gonzalez R.C. Digital Image Processing / C. Gonzalez, R. E. Woods and S. L. Eddins. ¬ Pearson Education, 2003. ¬ 976p.

Jolliffe I.T., Principal Component Analysis, 2nd ed. / I.T. Jolliffe. ¬ Springer-Verlag, Berlin, Germany, 2002 ¬ 518p. ¬ ISBN 0-387-95442-2.

Markushevich A.I. Theory of functions of a complex variable, 2nd ed. (3 vol. set) / A. I. Markushevich.¬American Mathematical Society, 2017. ¬ 1138p.

Wolfram S. The Mathematica Book: 5th ed. / S. Wolfram. ¬ New York : Wolfram Media, 2005. ¬ 1486p.

Shannon C.E. A mathematical theory of communication / C.E. Shannon // The Bell System Technical Journal. ¬1948. ¬ vol. 27. ¬ P. 379–423. DOI: https://doi.org/ 10.1002/j.1538-7305.1948.tb01338.x

Huang G. Visual and infrared dual-band false color image fusion method motivated by Land’s experiment / G. Huang, G. Ni, B. Zhang // Optical Engineering. ¬2007. ¬ vol. 46(2). DOI: https://doi.org/10.1117/1.2709851