Inter frame coding with template matching spatio-temporal prediction

• Published in: 2004 International Conference on Image Processing, 2004. ICIP '04 Vol. 1; pp. 465 - 468 Vol. 1
• Main Authors: Sugimoto, K., Kobayashi, M., Suzuki, Y., Kato, S., Choong Seng Boon
• Format: Conference Proceeding
• Language: English
• Published: Piscataway NJ IEEE 2004
• Subjects: Applied sciences; Artificial intelligence; Bit rate; Computer science; control theory; systems; Decoding; Exact sciences and technology; Filling; Image reconstruction; Image sequences; Laboratories; Motion compensation; Pattern recognition. Digital image processing. Computational geometry; Pixel; PSNR; Signal generators; Block code; Codec; Image matching; Image processing; Spatial correlation; Decoding circuit; Motion compensation; Pattern matching
• ISBN: 0780385543; 9780780385542
• ISSN: 1522-4880
• DOI: 10.1109/ICIP.2004.1418791

A new algorithm is proposed for predicting pixels for inter frame coding without side information. There are many approaches in the past that exploited either spatial or temporal correlations for generating prediction signals of an image in a block-by-block basis. Our method proposed in this paper exploits both spatial and temporal correlations at once to predict the pixels to be encoded. The prediction is achieved by using a template matching mechanism, with reference to previously reconstructed groups of pixels in the same frame or adjacent frames, to fill in the pixels of target regions of a frame. This process is conducted at both the encoder and decoder, and hence allows the decoder to produce the same predictor as the encoder does without any side information. Our coder uses the proposed prediction in addition to conventional motion compensation means. Simulation results show that our approach achieves up to 11.14% of improvements at the same PSNR over a codec which uses conventional block-based motion compensation.