Alternating Minimization Schemes for Computing Rate-Distortion-Perception Functions with f-Divergence Perception Constraints
We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of f -divergences. In this setting, the RDPF forms a convex programming problem for...
Saved in:
| Published in | IEEE transactions on information theory Vol. 71; no. 11; p. 1 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
IEEE
01.11.2025
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0018-9448 1557-9654 |
| DOI | 10.1109/TIT.2025.3604602 |
Cover
| Abstract | We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of f -divergences. In this setting, the RDPF forms a convex programming problem for which we characterize optimal parametric solutions. We employ the developed solutions in an alternating minimization scheme, namely Optimal Alternating Minimization (OAM), for which we provide convergence guarantees. Nevertheless, the OAM scheme does not lead to a direct implementation of a generalized Blahut-Arimoto (BA) type of algorithm due to implicit equations in the iteration's structure. To overcome this difficulty, we propose two alternative minimization approaches whose applicability depends on the smoothness of the used perception metric: a Newton-based Alternating Minimization (NAM) scheme, relying on Newton's root-finding method for the approximation of the optimal solution of the iteration, and a Relaxed Alternating Minimization (RAM) scheme, based on relaxing the OAM iterates. We show, by deriving necessary and sufficient conditions, that both schemes guarantee convergence to a globally optimal solution. We also provide sufficient conditions on the distortion and perception constraints, which guarantee that the proposed algorithms converge exponentially fast in the number of iteration steps. We corroborate our theoretical results with numerical simulations and establish connections with existing results. |
|---|---|
| AbstractList | We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of f -divergences. In this setting, the RDPF forms a convex programming problem for which we characterize optimal parametric solutions. We employ the developed solutions in an alternating minimization scheme, namely Optimal Alternating Minimization (OAM), for which we provide convergence guarantees. Nevertheless, the OAM scheme does not lead to a direct implementation of a generalized Blahut-Arimoto (BA) type of algorithm due to implicit equations in the iteration's structure. To overcome this difficulty, we propose two alternative minimization approaches whose applicability depends on the smoothness of the used perception metric: a Newton-based Alternating Minimization (NAM) scheme, relying on Newton's root-finding method for the approximation of the optimal solution of the iteration, and a Relaxed Alternating Minimization (RAM) scheme, based on relaxing the OAM iterates. We show, by deriving necessary and sufficient conditions, that both schemes guarantee convergence to a globally optimal solution. We also provide sufficient conditions on the distortion and perception constraints, which guarantee that the proposed algorithms converge exponentially fast in the number of iteration steps. We corroborate our theoretical results with numerical simulations and establish connections with existing results. |
| Author | Kountouris, Marios Serra, Giuseppe Stavrou, Photios A. |
| Author_xml | – sequence: 1 givenname: Giuseppe orcidid: 0000-0001-5620-4932 surname: Serra fullname: Serra, Giuseppe email: giuseppe.serra@eurecom.fr organization: Communication Systems Department, EURECOM, Sophia-Antipolis, France – sequence: 2 givenname: Photios A. orcidid: 0000-0003-0989-1682 surname: Stavrou fullname: Stavrou, Photios A. email: fotios.stavrou@eurecom.fr organization: Communication Systems Department, EURECOM, Sophia-Antipolis, France – sequence: 3 givenname: Marios orcidid: 0000-0003-1143-080X surname: Kountouris fullname: Kountouris, Marios email: marios.kountouris@eurecom.fr organization: Communication Systems Department, EURECOM, Sophia-Antipolis, France |
| BookMark | eNpNkEFLwzAYhoNMcJvePXjoH-hM0qRNjqM6HUwUneeSZl-2yJqOJFMUf7ztJujpe1943u_wjNDAtQ4QuiR4QgiW18v5ckIx5ZMsxyzH9AQNCedFKnPOBmiIMRGpZEycoVEIb11lnNAh-p5uI3inonXr5ME629ivrrQuedEbaCAkpvVJ2Ta7_QF5VhHSGxti63sqfQKvYXcYzPZO9yEkHzZuEtNh7-DX4DQk_7CyI6JX1sVwjk6N2ga4-L1j9Dq7XZb36eLxbl5OF6kmGYspkTUX1AisVMFrxlcMBMt5TYmkVHKVMaUztTIcMqMEowURtZBG1malZFHrbIzw8a_2bQgeTLXztlH-syK46u1Vnb2qt1f92usmV8eJBYA_nHTahGDZDywRcQM |
| CODEN | IETTAW |
| Cites_doi | 10.1109/TCOMM.2023.3274122 10.1587/comex.2018XBL0109 10.1109/ISIT54713.2023.10206646 10.1109/CVPR.2017.19 10.1109/ICCV.2019.00031 10.1109/PCS50896.2021.9477479 10.1109/JSAIT.2024.3381230 10.1109/TIP.2011.2147325 10.1109/ISIT44484.2020.9174429 10.1109/CVPR.2018.00260 10.1587/comex.2018XBL0139 10.1109/LSP.2012.2227726 10.1007/978-3-642-02431-3 10.1109/JSAIT.2024.3509420 10.1109/TIT.2018.2865570 10.1109/tit.2025.3584291 10.3390/e20050383 10.1109/TIT.1972.1054855 10.1109/TIT.2021.3095406 10.1016/S0167-6377(99)00074-7 10.1017/cbo9781139020411 10.1109/MCOM.001.2000604 10.1561/0100000004 10.1109/PCS48520.2019.8954548 10.1109/TIP.2012.2191563 10.1109/ISIT57864.2024.10619503 10.1515/9781400873173 10.1109/TIT.2015.2450721 10.1109/TIT.1972.1054753 10.1109/ISIT54713.2023.10206982 10.1002/0471200611 10.1109/TIP.2021.3058545 10.1007/978-0-387-79234-7 10.1109/JSAIT.2022.3231820 |
| ContentType | Journal Article |
| DBID | 97E RIA RIE AAYXX CITATION |
| DOI | 10.1109/TIT.2025.3604602 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Computer Science |
| EISSN | 1557-9654 |
| EndPage | 1 |
| ExternalDocumentID | 10_1109_TIT_2025_3604602 11145884 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: Horizon 2020 Research and Innovation Programme grantid: No. 101003431 |
| GroupedDBID | -~X .DC 0R~ 29I 4.4 5GY 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACGOD ACIWK AENEX AGQYO AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS F5P HZ~ IFIPE IPLJI JAVBF LAI M43 MS~ O9- OCL P2P PQQKQ RIA RIE RNS RXW TAE TN5 3EH 5VS AAYXX ABFSI AETEA AETIX AGSQL AI. AIBXA ALLEH CITATION E.L EJD H~9 IAAWW IBMZZ ICLAB IDIHD IFJZH VH1 VJK |
| ID | FETCH-LOGICAL-c134t-19b582f80aa75b45d4e8465b2192295a34ac3adf5e3fa842718b89f9bfda97bc3 |
| IEDL.DBID | RIE |
| ISSN | 0018-9448 |
| IngestDate | Wed Oct 29 21:20:37 EDT 2025 Wed Sep 10 07:40:24 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 11 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c134t-19b582f80aa75b45d4e8465b2192295a34ac3adf5e3fa842718b89f9bfda97bc3 |
| ORCID | 0000-0001-5620-4932 0000-0003-0989-1682 0000-0003-1143-080X |
| PageCount | 1 |
| ParticipantIDs | ieee_primary_11145884 crossref_primary_10_1109_TIT_2025_3604602 |
| PublicationCentury | 2000 |
| PublicationDate | 2025-11-00 |
| PublicationDateYYYYMMDD | 2025-11-01 |
| PublicationDate_xml | – month: 11 year: 2025 text: 2025-11-00 |
| PublicationDecade | 2020 |
| PublicationTitle | IEEE transactions on information theory |
| PublicationTitleAbbrev | TIT |
| PublicationYear | 2025 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| References | ref13 ref15 ref14 ref36 ref31 ref11 ref10 ref32 ref1 Blau (ref3) ref16 ref38 ref19 ref18 Burden (ref33) 2015 Rényi (ref37); 4 Shannon (ref2) 1993; 4 Blahut (ref43) 1987 ref24 ref46 Mentzer (ref12); 33 ref23 ref45 ref47 ref20 Yang (ref25) 2021 ref42 ref41 ref22 ref44 ref21 ref28 ref27 ref29 ref8 ref7 Rockafellar (ref34) 1998 ref4 Theis (ref17) ref6 ref5 Yang (ref26); 36 Csiszar (ref39) 1984; 1 Minnen (ref9); 31 ref40 Salehkalaibar (ref30); 36 Csiszár (ref35) 1974; 9 |
| References_xml | – ident: ref28 doi: 10.1109/TCOMM.2023.3274122 – volume: 4 start-page: 142 year: 1993 ident: ref2 article-title: Coding theorems for a discrete source with a fidelity criterion publication-title: Inst. Radio Eng., Nat. Conv. Rec. – ident: ref4 doi: 10.1587/comex.2018XBL0109 – ident: ref1 doi: 10.1109/ISIT54713.2023.10206646 – ident: ref6 doi: 10.1109/CVPR.2017.19 – ident: ref11 doi: 10.1109/ICCV.2019.00031 – ident: ref29 doi: 10.1109/PCS50896.2021.9477479 – ident: ref21 doi: 10.1109/JSAIT.2024.3381230 – ident: ref10 doi: 10.1109/TIP.2011.2147325 – ident: ref27 doi: 10.1109/ISIT44484.2020.9174429 – volume: 36 start-page: 1 volume-title: Proc. Adv. Neural Inf. Process. Syst. ident: ref26 article-title: Estimating the rate-distortion function by Wasserstein gradient descent – ident: ref7 doi: 10.1109/CVPR.2018.00260 – ident: ref5 doi: 10.1587/comex.2018XBL0139 – ident: ref13 doi: 10.1109/LSP.2012.2227726 – volume-title: Variational Analysis year: 1998 ident: ref34 doi: 10.1007/978-3-642-02431-3 – ident: ref23 doi: 10.1109/JSAIT.2024.3509420 – ident: ref18 doi: 10.1109/TIT.2018.2865570 – start-page: 1 volume-title: Proc. Int. Conf. Learn. Represent. (ICLR) ident: ref17 article-title: A coding theorem for the rate-distortion-perception function – ident: ref22 doi: 10.1109/tit.2025.3584291 – volume-title: Principles and Practice of Information Theory year: 1987 ident: ref43 – volume: 31 start-page: 1 volume-title: Proc. Adv. Neural Inf. Process. Syst. ident: ref9 article-title: Joint autoregressive and hierarchical priors for learned image compression – ident: ref38 doi: 10.3390/e20050383 – ident: ref24 doi: 10.1109/TIT.1972.1054855 – volume: 4 start-page: 461 volume-title: Proc. 4th Berkeley Symp. Math. Statist. Probab., Contrib. Theory Statist. ident: ref37 article-title: On measures of entropy and information – volume: 9 start-page: 57 year: 1974 ident: ref35 article-title: On an extremum problem of information theory publication-title: Studia Scientiarum Mathematicarum Hungarica – ident: ref44 doi: 10.1109/TIT.2021.3095406 – start-page: 675 volume-title: Proc. Int. Conf. Mach. Learn. ident: ref3 article-title: Rethinking lossy compression: The rate-distortion-perception tradeoff – ident: ref40 doi: 10.1016/S0167-6377(99)00074-7 – ident: ref47 doi: 10.1017/cbo9781139020411 – volume: 36 start-page: 1 volume-title: Proc. Adv. Neural Inf. Process. Syst. ident: ref30 article-title: On the choice of perception loss function for learned video compression – ident: ref15 doi: 10.1109/MCOM.001.2000604 – ident: ref36 doi: 10.1561/0100000004 – ident: ref8 doi: 10.1109/PCS48520.2019.8954548 – volume-title: Numerical Analysis year: 2015 ident: ref33 – volume: 1 start-page: 205 year: 1984 ident: ref39 article-title: Information geometry and alternating minimization procedures publication-title: Statist. Decisions, Dedewicz – volume: 33 start-page: 11913 volume-title: Proc. Adv. Neural Inf. Process. Syst. ident: ref12 article-title: High-fidelity generative image compression – ident: ref14 doi: 10.1109/TIP.2012.2191563 – ident: ref32 doi: 10.1109/ISIT57864.2024.10619503 – ident: ref46 doi: 10.1515/9781400873173 – ident: ref19 doi: 10.1109/TIT.2015.2450721 – year: 2021 ident: ref25 article-title: Towards empirical sandwich bounds on the rate-distortion function publication-title: arXiv:2111.12166 – ident: ref41 doi: 10.1109/TIT.1972.1054753 – ident: ref31 doi: 10.1109/ISIT54713.2023.10206982 – ident: ref45 doi: 10.1002/0471200611 – ident: ref16 doi: 10.1109/TIP.2021.3058545 – ident: ref42 doi: 10.1007/978-0-387-79234-7 – ident: ref20 doi: 10.1109/JSAIT.2022.3231820 |
| SSID | ssj0014512 |
| Score | 2.4932594 |
| Snippet | We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion... |
| SourceID | crossref ieee |
| SourceType | Index Database Publisher |
| StartPage | 1 |
| SubjectTerms | <italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">f -divergence Approximation algorithms Approximation Methods Blahut-Arimoto Algorithms Decoding Distortion Distortion measurement Focusing Lossy Source Coding Minimization Rate-distortion Rate-Distortion-Perception Trade-off Resource description framework Stochastic processes Sufficient conditions |
| Title | Alternating Minimization Schemes for Computing Rate-Distortion-Perception Functions with f-Divergence Perception Constraints |
| URI | https://ieeexplore.ieee.org/document/11145884 |
| Volume | 71 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1557-9654 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014512 issn: 0018-9448 databaseCode: RIE dateStart: 19630101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDI4YJzjwHGK8lAMXDtnW5tHmiIBpIIEQ2qTdqiZ1YQI6BB0HxI_HSbsxkJC4VZVTRbUdO7Y_m5BjbrkCyDMmFSgmtM2YEQEwBdpIpcFq6wL61zeqPxRXIzmqweoeCwMAvvgM2u7R5_KziZ26UFkH9dIDKxukEcWqAmvNUwZCBlVr8AA1GC8ds5xkV3cGlwO8CYayzZXLA4Y_bNDCUBVvU3rr5Ga2m6qU5LE9LU3bfvxq1Pjv7W6Qtdq7pKeVOGySJSi2yPpscgOtFXmLrC60Idwmn6dPdViwuKfX42L8XIMzccEDPMMbRc-WVl9xJHfon7Jz31_EUbHbeXEM7aGZ9JJMXYCX5kj2XuE7gS6QuTGhfjhF-dYkw97F4KzP6qkMzAZclCxAJsZhHnfTNJJGyEwA-jDS4NHnRoOnXKSWp1kugedpLEI0fibWuTZ5lurIWL5DlotJAbuERmgqU6OAdzUgoYnzAFSojRLKGgG8RU5mfEpequYbib-0dHWCPE0cT5Oapy3SdBz4pqt__t4f7_fJiltewQoPyHL5OoVD9C9Kc-Tl6gvYrtAU |
| linkProvider | IEEE |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3db9NADLdgPMAeGIxO7AO4B154uLbJfTT3OMGqFtYKoVTqW5S7OFCNZhNLeZj44-e7JKUgIfEWRb7TKbZjn-2fDfBWOKERy4IrjZpL4wpuZYRco7FKG3TG-YD-bK4nC_lxqZYtWD1gYRAxFJ9h3z-GXH5x7TY-VDYgvQzAyofwSEkpVQPX2iYNpIqa5uAR6TBdO7qs5NAM0mlKd8FY9YX2mcD4Dyu0M1YlWJXxAcy78zTFJFf9TW377u6vVo3_feBn8LT1L9l5IxDP4QFWh3DQzW5grSofwv5OI8IX8Ov8exsYrL6y2aparVt4Ji34hmu8ZeTbsmYXT_KFPFT-IXQY8VT887Y8ho3JUAZZZj7Ey0oi-9kgPJHtkPlBoWE8RX3bg8X4In0_4e1cBu4iIWseERuTuEyGeT5SVqpCInkxytLPzw8Hz4XMnciLUqEo80TGZP5sYkpjyyI3I-vEEexV1xW-BDYiY5lbjWJokAhtUkaoY2O11M5KFMfwruNTdtO038jCtWVoMuJp5nmatTw9hp7nwG-69uOf_OP9G3g8SWeX2eV0_ukUnvitGpDhGezVPzb4iryN2r4OMnYP5bjTYQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Alternating+Minimization+Schemes+for+Computing+Rate-Distortion-Perception+Functions+with+f-Divergence+Perception+Constraints&rft.jtitle=IEEE+transactions+on+information+theory&rft.au=Serra%2C+Giuseppe&rft.au=Stavrou%2C+Photios+A.&rft.au=Kountouris%2C+Marios&rft.date=2025-11-01&rft.pub=IEEE&rft.issn=0018-9448&rft.spage=1&rft.epage=1&rft_id=info:doi/10.1109%2FTIT.2025.3604602&rft.externalDocID=11145884 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9448&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9448&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9448&client=summon |