A dynamically reconfigurable architecture system for time-varying image constraints (DRASTIC) for motion JPEG

• Published in: Journal of real-time image processing Vol. 14; no. 2; pp. 395 - 411
• Main Authors: Jiang, Yuebing, Pattichis, Marios S.
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.02.2018; Springer Nature B.V
• Subjects: Bandwidths; Co-design; Coding standards; Computer Graphics; Computer Science; Configurations; Controllers; Critical components; Hardware; Image compression; Image Processing and Computer Vision; Image quality; Multimedia Information Systems; Optimization; Original Research Paper; Pattern Recognition; Quality standards; Real time; Signal,Image and Speech Processing; Software; User experience; Video communication; Video compression; DCT; FPGA; Finite word length; Dynamically reconfigurable computing; MJPEG; Dynamic partial reconfiguration; Zonal
• ISSN: 1861-8200; 1861-8219
• DOI: 10.1007/s11554-014-0460-8

We propose a dynamically reconfigurable system for time-varying image constraints (DRASTIC) for applications in video communications. DRASTIC defines a framework for both joint and independent optimization of dynamic power, image quality, and bitrate subject to different constraint scenarios. We demonstrate DRASTIC for intra-mode video encoding for MJPEG. However, since the DCT is critical component of most video coding standards, our approach can be extended to modern standards such as AVC (H.264), and emerging standards such as HEVC (H.265), and VP9. Based on a hardware–software co-design approach, we define a family of scalable 2D DCT hardware modules that are jointly optimized with the quality factor (in software). We generate a total of 1,280 configurations of which 841 were found to be Pareto optimal. For full 2D DCT calculation, the results indicate that the proposed method is DRASTIC mode implementation at least as good or significantly better than any previously published implementation. A scalable, real-time controller is used for selecting an appropriate configuration so as to meet time-varying constraints. The real-time controller is shown to satisfy the constraints of different communications modes (e.g., minimum dynamic power, maximum image quality, etc.) as well as to adapt to mode changes. Empirically, we have found that the DRASTIC controller adapts to meet the new constraints within five video frames of a mode change. Overall, the proposed approach yields significant savings over the use of comparable static architectures.