Color Demosaicking in Digital Image Using Nonlocal Adaptive Thresholding and Local Directional Interpolation

Authors(1) :-Kr. Nain Yadav

Single sensor digital color cameras capture only one of the three primary colors at each pixel and a process called color demosaicking (CDM) is used to reconstruct the full color images. Most CDM algorithms assume the existence of high local spectral redundancy in estimating the missing color samples. However, for images with sharp color transitions and high color saturation, such an assumption may be invalid and visually unpleasant CDM errors will occur. In this paper we exploit the image non-local redundancy to improve the local color reproduction result. First, multiple local directional estimates of a missing color sample are computed and fused according to local gradients. Then nonlocal pixels similar to the estimated pixel are searched to enhance the local estimate. An adaptive thresholding method rather than the commonly used nonlocal means filtering is proposed to improve the local estimate. This allows the final reconstruction to be performed at the structural level as opposed to the pixel level. Experimental results demonstrate that the proposed local directional interpolation and nonlocal adaptive thresholding (LDI-NAT) method outperforms many state-of-the-art CDM methods in reconstructing the edges and reducing color interpolation artifacts, leading to higher visual quality of reproduced color images.

Authors and Affiliations

Kr. Nain Yadav
M.Tech Scholar, Department of Computer Science, NVPEMI, Kanpur, Uttar Pradesh, India

Color Demosaicking, Nonlocal, Sparse Representation, Image Interpolation.

  1. B. E. Bayer and Eastman Kodak Company, "Color Imaging Array," US patent 3 971 065, 1975.
  2. Kodak color image dataset,
  3. J. E. Adams, "Intersections between color plane interpolation and other image processing functions in electronic photography," Proceedings of SPIE, vol. 2416, pp. 144-151, 1995.
  4. J. E. Adams and J. F. Hamilton Jr., "Adaptive color plane interpolation in single color electronic camera," U. S. Patent, 5 506 619, 1996.
  5. R. Kimmel, "Demosaicing: Image reconstruction from CCD samples," IEEE Trans. on Image Processing, vol. 8, no. 9, pp. 1221-1228, Sep. 1999.
  6. B. K. Gunturk, Y. Altunbasak and R. M. Mersereau, "Color plane interpolation using alternating projections," IEEE Trans. on Image Processing, vol. 11, no. 9, pp. 997-1013, Sep. 2002.
  7. R. Lukac, K. Martin, and K.N. Plataniotis, "Demosaicked image postprocessing using local color ratios," IEEE Trans. on Circuits and Syst. for Video Tech., vol. 14, no. 6, pp. 914-920, June 2004.
  8. D. D. Muresan and T. W. Parks, "Demosaicing using optimal recovery," IEEE Trans. on Image Processing, vol. 14, no. 2, pp. 267 – 278, Feb. 2005.
  9. Xin Li, "Demosaicing by successive approximation," IEEE Trans. on Image Processing, vol. 14, no. 3, pp. 370-379, Mar. 2005.
  10. K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicing algorithm", IEEE Trans. on Image Processing, vol. 14, no. 3, pp. 360-369, Mar. 2005.
  11. D. Alleysson, S. Susstrunk and J. Herault, "Linear demosaicing inspired by the human visual system," IEEE Trans. on Image Processing, vol. 14, no. 4, pp. 439-449, April 2005.
  12. Lei Zhang and X. Wu, "Color demosaicking via directional linear minimum mean square-error estimation," IEEE Trans. on Image Processing, vol. 14, no. 12, pp. 2167-2178, Dec. 2005.
  13. D. Menon, S. Andriani, and G. Calvagno, "Demosaicing with directional filtering and a posteriori decision," IEEE Trans. on Image Processing, vol. 16, no. 1, pp. 132–141, Jan. 2007.
  14. J. Mairal, M. Elad, and G. Sapiro, "Sparse Representation for Color Image Restoration," IEEE Transactions on Image Processing, vol. 17, no. 1, pp. 53–69, 2009.
  15. A. Buades, B. Coll, J.-M. Morel, and C. Sbert, "Self-similarity driven color demosaicking," IEEE Trans. Image Processing, vol. 18, no. 6, pp. 1192-1202, June 2009.
  16. F. Zhang, X. Wu, X. Yang, W. Zhang and L. Zhang "Robust color demosaicking with adaptation to varying spectral correlations", IEEE Trans. on Image Processing, vol. 18, no. 12, pp. 2706-2717, Dec. 2009.
  17. X. Wu and L. Zhang, "Color video demosaicking via motion estimation and data fusion," IEEE Trans. on Circuits and Systems for Video Technology, vol. 16, pp. 231-240, Feb. 2006.
  18. X. Wu and L. Zhang, "Improvement of color video demosaicking in temporal domain," IEEE Trans. on Image Processing, vol. 15, Oct. 2006.
  19. P. Longère, Xuemei Zhang, P. B. Delahunt and Davaid H. Brainard, "Perceptual assessment of demosaicing algorithm performance," Proc. of IEEE, vol. 90, no. 1, pp. 123-132, Jan. 2002.
  20. Xin Li, B. Gunturk, L. Zhang, "Image demosaicking: a systematic survey," Visual Communications and Image Processing 2008, Proceedings of the SPIE, Volume 6822, pp. 68221J-68221J-15 (2008). San Jose, CA, USA.
  21. A. Buades, B. Coll, and J. M. Morel, "A review of image denoising algorithms, with a new one," Multisc. Model. Simulat., vol. 4, no. 2, pp. 490.530, 2005.
  22. S. Kindermann, S. Osher, and P. W. Jones, "Deblurring and denoising of images by nonlocal functionals," Multiscale Modeling and Simulation, vol. 4, no. 4, pp. 1091-1115, 2005.
  23. K.Dabov, A. Foi, V.Katkovnik, K. Egiazarian, "Image denoising by sparse 3-D transform domain collaborative filtering," IEEE Transactions on Image Processing, vol. 16, no. 8, pp. 2080-2094, Aug. 2007.
  24. T. Brox, O. Kleinschmidt, D. Cremers, "Efficient nonlocal means for denoising of textural patterns," IEEE Transactions on Image Processing, vol. 17, no. 7, pp. 1083-1092, July, 2008.
  25. A. Buades, B. Coll, J.M Morel, "Nonlocal image and movie denoising," International Journal of Computer Vision, vol. 76, no. 2, pp. 123-139, 2008.
  26. Xin Li and Yunfei Zheng, "Patch-based video processing: a variational Bayesian approach," IEEE Trans. on Cir. Sys. for Video Tech., vol. 19, no. 1, pp. 27-40, Jan. 2009.

Publication Details

Published in : Volume 3 | Issue 6 | July-August 2018
Date of Publication : 2018-07-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 38-47
Manuscript Number : CSEIT183612
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

Kr. Nain Yadav, "Color Demosaicking in Digital Image Using Nonlocal Adaptive Thresholding and Local Directional Interpolation", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 3, Issue 6, pp.38-47, July-August-2018.
Journal URL :

Article Preview