Citation: | Zhang Qian, Zhou Pucheng, Xue Mogen, et al. Image enhancement using IGM and improved PCNN[J]. Opto-Electronic Engineering, 2017, 44(9): 888-894. doi: 10.3969/j.issn.1003-501X.2017.09.005 |
[1] | Magudeeswaran V, Ravichandran C G, Thirumurugan P. Brightness preserving bi-level fuzzy histogram equalization for MRI brain image contrast enhancement[J]. International Journal of Imaging Systems and Technology, 2017, 27(2): 153–161. doi: 10.1002/ima.v27.2 |
[2] | Xu F Y, Zeng D G, Zhang J, et al. Detail enhancement of blurred infrared images based on frequency extrapolation[J]. Infrared Physics and Technology, 2016, 76: 560-568. doi: 10.1016/j.infrared.2016.04.008 |
[3] | 吴燕燕, 王亚杰, 石祥滨, 等.结合NSST和颜色对比度增强的彩色夜视方法[J].光电工程, 2016, 43(11): 88–94. doi: 10.3969/j.issn.1003-501X.2016.11.014 Wu Yanyan, Wang Yajie, Shi Xiangbin, et al. Color night vision method combing NSST with color contrast enhancement[J]. Opto-Electronic Engineering, 2016, 43(11): 88–94. doi: 10.3969/j.issn.1003-501X.2016.11.014 |
[4] | Kaur A, Singh C. Contrast enhancement for cephalometric images using wavelet-based modified adaptive histogram equalization[J]. Applied Soft Computing, 2017, 51: 180–191. doi: 10.1016/j.asoc.2016.11.046 |
[5] | Bai T B, Zhang L B, Duan L X, et al. NSCT-based infrared image enhancement method for rotating machinery fault diagnosis[J]. IEEE Transactions on Instrumentation and Measurement, 2016, 65(10): 2293–2301. doi: 10.1109/TIM.2016.2579440 |
[6] | Wang Y F, Wang H Y, Yin C L, et al. Biologically inspired image enhancement based on Retinex[J]. Neurocomputing, 2016, 177: 373–384. doi: 10.1016/j.neucom.2015.10.124 |
[7] | Johnson J L, Ritter D. Observation of periodic waves in a pulse-coupled neural network[J]. Optics Letters, 1993, 18(15): 1253–1255. doi: 10.1364/OL.18.001253 |
[8] |
Xu G Z, Li C L, Zhao J J, et al. Multiplicative decomposition based image contrast enhancement method using PCNN fac-toring model[C]// Proceedings of the 11th World Congress on Intelligent Control and Automation, Shenyang, China, 2014: 1511–1516. |
[9] | 苏娟, 李冰, 王延钊.结合PCNN分割和模糊集理论的红外图像增强[J].光学学报, 2016, 36(9): 0910001. Su Juan, Li Bing, Wang Yanzhao. Infrared image enhancement based on PCNN segmentation and fuzzy set theory[J]. Acta Optica Sinica, 2016, 36(9): 0910001. |
[10] | Peter D, Geoffrey E H, Radford M N, et al. The Helmholtz machine[J]. Neural computation, 1995, 7(5): 889–904. doi: 10.1162/neco.1995.7.5.889 |
[11] | Wu J J, Lin W S, Shi G M, et al. Perceptual quality metric with internal generative mechanism[J]. IEEE Transactions on Image Processing, 2013, 22(1): 43–54 doi: 10.1109/TIP.2012.2214048 |
[12] |
Zhang K H, Zhang L, Yang X. Infrared image adaptive en-hancement based on fuzzy sets theory[C]// Proceedings of the 2nd IEEE International Asia Conference on Informatics in Control, Automation and Robotics, 2010, 2: 242–245 |
[13] | Li C F, Bovik A C, Wu X J. Blind image quality assessment using a general regression neural network[J]. IEEE Transactions on Neural Networks, 2011, 22(5): 793–799. doi: 10.1109/TNN.2011.2120620 |
[14] | 毛瑞全, 宫霄霖, 刘开华.基于PCNN区域分割的图像邻域去噪算法[J].光电工程, 2010, 37(2): 122–127. Mao Ruiquan, Gong Xiaolin, Liu Kaihua. Image de-noising algorithm with neighborhood based on PCNN segmentation[J]. Opto-Electronic Engineering, 2010, 37(2): 122–127. |
[15] | 何胜宗, 刘映杰, 马义德, 等.基于PCNN图像因子分解的X线医学图像增强[J].中国图象图形学报, 2011, 16(1): 21–26. He Shengzong, Liu Yingjie, Ma Yide, et al. Medical X-ray image enhancement based on PCNN image factorization[J]. Journal of Image and Graphics, 2011, 16(1): 21–26. |
[16] | Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600–612. doi: 10.1109/TIP.2003.819861 |
[17] | Gupta S, Kaur L, Chauhan R C, et al. A versatile technique for visual enhancement of medical ultrasound images[J]. Digital Signal Processing, 2007, 17(3): 542–560. doi: 10.1016/j.dsp.2006.12.001 |
Abstract: Image enhancement is an important and fundamental problem for image processing. However, there are some images that the visual system obtained with a mass of effective features loss, appearing to be low contrast and high noise, which will affect the image enhancement and the subsequent processing of computer vision applications. To deal with the low-contrast and high-noisy natural images, an image enhancement method based on internal generative mechanism (IGM) and improved pulse coupled neural network (PCNN) is proposed. First, in the division operation, an image is segmented into two parts using the theory of IGM. One part is a rough sub-graph, which contains the basic information of the images, and the other is a detail sub-graph, which contains the image details. Second, in order to make the rough sub-graph more clearly, an improved PCNN enhancement method with fuzzy sets is adopted. As we all know, the lij in PCNN represents the working state of each neuron and every neuron has its own lij. So we use the lij as the input of the fuzzy function to obtain the fuzzy membership. Subsequently, through the successive iteration of the fuzzy membership, we have achieved the purpose of using this information to non- linearly extend the lij, and then, the image contrast of the target and background is enhanced accordingly. At the same time, βij in PCNN affects the ignition cycle between the central neuron and the neighborhood neurons, which in turn affects the gray value of the pixels. By improving the calculation method of βij in PCNN, we have achieved the purpose of sharpening the image edge and removing the noises of the detail sub-graph. Finally, the final image is reconstructed by the processed rough sub-graph and detail sub-graph. To verify the effectiveness and superiority, we design three sets of controlled experiments which are performed on some PCNN enhancement algorithms, including the original PCNN method in Ref.[7], the improved PCNN methods in Ref.[8] and Ref.[9]. Meanwhile, we choose three classic images to show the experiment results qualitatively, and the results are shown in Fig. 4, Fig. 5 and Fig. 6. After that, in order to show the quantitative experiment results, we also chose five reference and no-reference image quality assessment methods, such as the DV/BV, SSIM, entropy, SNR, and EPI, to compare the effect of various image enhancement methods. Experimental results show that the proposed algorithm can effectively enhance the image contrast and image contour, as well as filter out some noise without any loss of image edges.
Examples of image decomposition by IGM. (a) Original image. (b) Rough sub-graph. (c) Detail sub-graph.
Enhancement results of rough sub-graph. (a) Original rough sub-graph. (b) Enhanced rough sub-graph.
Enhancement results of detail sub-graph. (a) Original detail sub-graph. (b) Enhanced detail sub-graph.
The first experimental results. (a) Tree. (b) Degraded image. (c) Original PCNN. (d) Ref. [8]. (e) Ref. [9]. (f) This paper.
The second experimental results. (a) People. (b) Degraded image. (c) Original PCNN. (d) Ref. [8]. (e) Ref. [9]. (f) This paper.
The third experimental results. (a) Barbara. (b) Degraded image. (c) Original PCNN. (d) Ref. [8]. (e) Ref. [9]. (f) This paper.