Impact of image demosaicing on similarity of color channels for forensics

DegreeMaster
StatusAvailable
Supervisor(s)Martin Beneš, MSc

Description

To produce a color image, the “color-blind” sensor in a digital camera is attached to a grid of colored filters, called Bayer filter. This design produces a sparse raw image, whose pixels have only the value of a single (position-dependent) channel. The missing values are interpolated from the measured values by demosaicing, i.e., removing the mosaic. Many demosaicing methods are known: simple linear interpolation of each channel independently, gradient-based demosaicing, i.e., interpolation of R and B with a help of gradient of G, or most recently neural demosaicing that employs neural networks. The choice of a demosaicing method influences the information flow between the color channels during the demosaicing, and may have an effect on performance of forensic methods or steganographic detectors.

The goal of the thesis is to study the spill-over of information for different demosaicing methods. This is measured by comparing the color channels of images, produced with existing demosaicing methods. Common design choices should also be considered, e.g., the presence of median filter or color correction. The impact of the demosaicing method should be further demonstrated by measuring the performance of a down-stream task, e.g., PRNU estimation.

References

  • Chang, E., Cheung, S., and Pan, D.Y. Color filter array recovery using a threshold-based variable number of gradients. In Sensors, Cameras, and Applications for Digital Photography. 3650, SPIE, 1999, pp. 36–43.
  • Hirakawa, K. and Parks, T.W. Adaptive homogeneity-directed demosaicing algorithm. IEEE Transactions on Image Processing (TIP), 14, 3 (2005), 360–369.
  • Liu, L., Jia, X., Liu, J., and Tian, Q. Joint demosaicing and denoising with self guidance. In IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020, pp. 2240–2249.
  • Giboulot, Q., Bas, P., Cogranne, R., and Borghys, D. The cover source mismatch problem in deep-learning steganalysis. In European Signal Processing Conference (EUSIPCO). IEEE, 2022, pp. 1032–1036.
  • Forsey, A. and Gungor, S. Demosaicing images from colour cameras for digital image correlation. Optics and Lasers in Engineering, 86, (2016), 20–28.