Rate-Distortion Optimal Video Transport Over IP Allowing Packets With Bit Errors

• Published in: IEEE transactions on image processing Vol. 16; no. 5; pp. 1315 - 1326
• Main Authors: Harmanci, O., Tekalp, A.M.
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.05.2007; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Applied sciences; Channels; Coding, codes; Computer Communication Networks; Data Compression - methods; Decoding; Dynamic programming; Error correction codes; Error resilience; Exact sciences and technology; Forward error correction; Frames; Image coding; Image Enhancement - methods; Image Interpretation, Computer-Assisted - methods; Image processing; Information, signal and communications theory; IP (Internet Protocol); IP networks; Mathematical models; Methods; Numerical Analysis, Computer-Assisted; Optimal control; optimal slices; Optimization; Permissible error; Protocols; Rate-distortion; rate-distortion optimization; Resilience; resynchronization markers; Signal and communications theory; Signal processing; Signal Processing, Computer-Assisted; Slicing; Studies; TCP-IP; Telecommunications and information theory; Transport; unequal error protection; Video Recording - methods; video transport; Packet switching; unequal error protection; Video signal; Rate distortion theory; Information transmission; Optimization; rate-distortion optimization; Forward error correction; Error detection; Error correcting code; resynchronization markers; Error correction; Objective function; Open market; Dynamic programming; optimal slices; Error resilience; video transport; Control code
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2007.891792

We propose new models and methods for rate-distortion (RD) optimal video delivery over IP, when packets with bit errors are also delivered. In particular, we propose RD optimal methods for slicing and unequal error protection (UEP) of packets over IP allowing transmission of packets with bit errors. The proposed framework can be employed in a classical independent-layer transport model for optimal slicing, as well as in a cross-layer transport model for optimal slicing and UEP, where the forward error correction (FEC) coding is performed at the link layer, but the application controls the FEC code rate with the constraint that a given IP packet is subject to constant channel protection. The proposed method uses a novel dynamic programming approach to determine the optimal slicing and UEP configuration for each video frame in a practical manner, that is compliant with the AVC/H.264 standard. We also propose new rate and distortion estimation techniques at the encoder side in order to efficiently evaluate the objective function for a slice configuration. The cross-layer formulation option effectively determines which regions of a frame should be protected better; hence, it can be considered as a spatial UEP scheme. We successfully demonstrate, by means of experimental results, that each component of the proposed system provides significant gains, up to 2.0 dB, compared to competitive methods