Alternating Minimization Schemes for Computing Rate-Distortion-Perception Functions with f-Divergence Perception Constraints

We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of f -divergences. In this setting, the RDPF forms a convex programming problem for...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on information theory Vol. 71; no. 11; p. 1
Main Authors Serra, Giuseppe, Stavrou, Photios A., Kountouris, Marios
Format Journal Article
LanguageEnglish
Published IEEE 01.11.2025
Subjects
Online AccessGet full text
ISSN0018-9448
1557-9654
DOI10.1109/TIT.2025.3604602

Cover

Abstract We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of f -divergences. In this setting, the RDPF forms a convex programming problem for which we characterize optimal parametric solutions. We employ the developed solutions in an alternating minimization scheme, namely Optimal Alternating Minimization (OAM), for which we provide convergence guarantees. Nevertheless, the OAM scheme does not lead to a direct implementation of a generalized Blahut-Arimoto (BA) type of algorithm due to implicit equations in the iteration's structure. To overcome this difficulty, we propose two alternative minimization approaches whose applicability depends on the smoothness of the used perception metric: a Newton-based Alternating Minimization (NAM) scheme, relying on Newton's root-finding method for the approximation of the optimal solution of the iteration, and a Relaxed Alternating Minimization (RAM) scheme, based on relaxing the OAM iterates. We show, by deriving necessary and sufficient conditions, that both schemes guarantee convergence to a globally optimal solution. We also provide sufficient conditions on the distortion and perception constraints, which guarantee that the proposed algorithms converge exponentially fast in the number of iteration steps. We corroborate our theoretical results with numerical simulations and establish connections with existing results.
AbstractList We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of f -divergences. In this setting, the RDPF forms a convex programming problem for which we characterize optimal parametric solutions. We employ the developed solutions in an alternating minimization scheme, namely Optimal Alternating Minimization (OAM), for which we provide convergence guarantees. Nevertheless, the OAM scheme does not lead to a direct implementation of a generalized Blahut-Arimoto (BA) type of algorithm due to implicit equations in the iteration's structure. To overcome this difficulty, we propose two alternative minimization approaches whose applicability depends on the smoothness of the used perception metric: a Newton-based Alternating Minimization (NAM) scheme, relying on Newton's root-finding method for the approximation of the optimal solution of the iteration, and a Relaxed Alternating Minimization (RAM) scheme, based on relaxing the OAM iterates. We show, by deriving necessary and sufficient conditions, that both schemes guarantee convergence to a globally optimal solution. We also provide sufficient conditions on the distortion and perception constraints, which guarantee that the proposed algorithms converge exponentially fast in the number of iteration steps. We corroborate our theoretical results with numerical simulations and establish connections with existing results.
Author Kountouris, Marios
Serra, Giuseppe
Stavrou, Photios A.
Author_xml – sequence: 1
  givenname: Giuseppe
  orcidid: 0000-0001-5620-4932
  surname: Serra
  fullname: Serra, Giuseppe
  email: giuseppe.serra@eurecom.fr
  organization: Communication Systems Department, EURECOM, Sophia-Antipolis, France
– sequence: 2
  givenname: Photios A.
  orcidid: 0000-0003-0989-1682
  surname: Stavrou
  fullname: Stavrou, Photios A.
  email: fotios.stavrou@eurecom.fr
  organization: Communication Systems Department, EURECOM, Sophia-Antipolis, France
– sequence: 3
  givenname: Marios
  orcidid: 0000-0003-1143-080X
  surname: Kountouris
  fullname: Kountouris, Marios
  email: marios.kountouris@eurecom.fr
  organization: Communication Systems Department, EURECOM, Sophia-Antipolis, France
BookMark eNpNkEFLwzAYhoNMcJvePXjoH-hM0qRNjqM6HUwUneeSZl-2yJqOJFMUf7ztJujpe1943u_wjNDAtQ4QuiR4QgiW18v5ckIx5ZMsxyzH9AQNCedFKnPOBmiIMRGpZEycoVEIb11lnNAh-p5uI3inonXr5ME629ivrrQuedEbaCAkpvVJ2Ta7_QF5VhHSGxti63sqfQKvYXcYzPZO9yEkHzZuEtNh7-DX4DQk_7CyI6JX1sVwjk6N2ga4-L1j9Dq7XZb36eLxbl5OF6kmGYspkTUX1AisVMFrxlcMBMt5TYmkVHKVMaUztTIcMqMEowURtZBG1malZFHrbIzw8a_2bQgeTLXztlH-syK46u1Vnb2qt1f92usmV8eJBYA_nHTahGDZDywRcQM
CODEN IETTAW
Cites_doi 10.1109/TCOMM.2023.3274122
10.1587/comex.2018XBL0109
10.1109/ISIT54713.2023.10206646
10.1109/CVPR.2017.19
10.1109/ICCV.2019.00031
10.1109/PCS50896.2021.9477479
10.1109/JSAIT.2024.3381230
10.1109/TIP.2011.2147325
10.1109/ISIT44484.2020.9174429
10.1109/CVPR.2018.00260
10.1587/comex.2018XBL0139
10.1109/LSP.2012.2227726
10.1007/978-3-642-02431-3
10.1109/JSAIT.2024.3509420
10.1109/TIT.2018.2865570
10.1109/tit.2025.3584291
10.3390/e20050383
10.1109/TIT.1972.1054855
10.1109/TIT.2021.3095406
10.1016/S0167-6377(99)00074-7
10.1017/cbo9781139020411
10.1109/MCOM.001.2000604
10.1561/0100000004
10.1109/PCS48520.2019.8954548
10.1109/TIP.2012.2191563
10.1109/ISIT57864.2024.10619503
10.1515/9781400873173
10.1109/TIT.2015.2450721
10.1109/TIT.1972.1054753
10.1109/ISIT54713.2023.10206982
10.1002/0471200611
10.1109/TIP.2021.3058545
10.1007/978-0-387-79234-7
10.1109/JSAIT.2022.3231820
ContentType Journal Article
DBID 97E
RIA
RIE
AAYXX
CITATION
DOI 10.1109/TIT.2025.3604602
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
DatabaseTitle CrossRef
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Computer Science
EISSN 1557-9654
EndPage 1
ExternalDocumentID 10_1109_TIT_2025_3604602
11145884
Genre orig-research
GrantInformation_xml – fundername: Horizon 2020 Research and Innovation Programme
  grantid: No. 101003431
GroupedDBID -~X
.DC
0R~
29I
4.4
5GY
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACGFS
ACGOD
ACIWK
AENEX
AGQYO
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
F5P
HZ~
IFIPE
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
PQQKQ
RIA
RIE
RNS
RXW
TAE
TN5
3EH
5VS
AAYXX
ABFSI
AETEA
AETIX
AGSQL
AI.
AIBXA
ALLEH
CITATION
E.L
EJD
H~9
IAAWW
IBMZZ
ICLAB
IDIHD
IFJZH
VH1
VJK
ID FETCH-LOGICAL-c134t-19b582f80aa75b45d4e8465b2192295a34ac3adf5e3fa842718b89f9bfda97bc3
IEDL.DBID RIE
ISSN 0018-9448
IngestDate Wed Oct 29 21:20:37 EDT 2025
Wed Sep 10 07:40:24 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 11
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c134t-19b582f80aa75b45d4e8465b2192295a34ac3adf5e3fa842718b89f9bfda97bc3
ORCID 0000-0001-5620-4932
0000-0003-0989-1682
0000-0003-1143-080X
PageCount 1
ParticipantIDs ieee_primary_11145884
crossref_primary_10_1109_TIT_2025_3604602
PublicationCentury 2000
PublicationDate 2025-11-00
PublicationDateYYYYMMDD 2025-11-01
PublicationDate_xml – month: 11
  year: 2025
  text: 2025-11-00
PublicationDecade 2020
PublicationTitle IEEE transactions on information theory
PublicationTitleAbbrev TIT
PublicationYear 2025
Publisher IEEE
Publisher_xml – name: IEEE
References ref13
ref15
ref14
ref36
ref31
ref11
ref10
ref32
ref1
Blau (ref3)
ref16
ref38
ref19
ref18
Burden (ref33) 2015
Rényi (ref37); 4
Shannon (ref2) 1993; 4
Blahut (ref43) 1987
ref24
ref46
Mentzer (ref12); 33
ref23
ref45
ref47
ref20
Yang (ref25) 2021
ref42
ref41
ref22
ref44
ref21
ref28
ref27
ref29
ref8
ref7
Rockafellar (ref34) 1998
ref4
Theis (ref17)
ref6
ref5
Yang (ref26); 36
Csiszar (ref39) 1984; 1
Minnen (ref9); 31
ref40
Salehkalaibar (ref30); 36
Csiszár (ref35) 1974; 9
References_xml – ident: ref28
  doi: 10.1109/TCOMM.2023.3274122
– volume: 4
  start-page: 142
  year: 1993
  ident: ref2
  article-title: Coding theorems for a discrete source with a fidelity criterion
  publication-title: Inst. Radio Eng., Nat. Conv. Rec.
– ident: ref4
  doi: 10.1587/comex.2018XBL0109
– ident: ref1
  doi: 10.1109/ISIT54713.2023.10206646
– ident: ref6
  doi: 10.1109/CVPR.2017.19
– ident: ref11
  doi: 10.1109/ICCV.2019.00031
– ident: ref29
  doi: 10.1109/PCS50896.2021.9477479
– ident: ref21
  doi: 10.1109/JSAIT.2024.3381230
– ident: ref10
  doi: 10.1109/TIP.2011.2147325
– ident: ref27
  doi: 10.1109/ISIT44484.2020.9174429
– volume: 36
  start-page: 1
  volume-title: Proc. Adv. Neural Inf. Process. Syst.
  ident: ref26
  article-title: Estimating the rate-distortion function by Wasserstein gradient descent
– ident: ref7
  doi: 10.1109/CVPR.2018.00260
– ident: ref5
  doi: 10.1587/comex.2018XBL0139
– ident: ref13
  doi: 10.1109/LSP.2012.2227726
– volume-title: Variational Analysis
  year: 1998
  ident: ref34
  doi: 10.1007/978-3-642-02431-3
– ident: ref23
  doi: 10.1109/JSAIT.2024.3509420
– ident: ref18
  doi: 10.1109/TIT.2018.2865570
– start-page: 1
  volume-title: Proc. Int. Conf. Learn. Represent. (ICLR)
  ident: ref17
  article-title: A coding theorem for the rate-distortion-perception function
– ident: ref22
  doi: 10.1109/tit.2025.3584291
– volume-title: Principles and Practice of Information Theory
  year: 1987
  ident: ref43
– volume: 31
  start-page: 1
  volume-title: Proc. Adv. Neural Inf. Process. Syst.
  ident: ref9
  article-title: Joint autoregressive and hierarchical priors for learned image compression
– ident: ref38
  doi: 10.3390/e20050383
– ident: ref24
  doi: 10.1109/TIT.1972.1054855
– volume: 4
  start-page: 461
  volume-title: Proc. 4th Berkeley Symp. Math. Statist. Probab., Contrib. Theory Statist.
  ident: ref37
  article-title: On measures of entropy and information
– volume: 9
  start-page: 57
  year: 1974
  ident: ref35
  article-title: On an extremum problem of information theory
  publication-title: Studia Scientiarum Mathematicarum Hungarica
– ident: ref44
  doi: 10.1109/TIT.2021.3095406
– start-page: 675
  volume-title: Proc. Int. Conf. Mach. Learn.
  ident: ref3
  article-title: Rethinking lossy compression: The rate-distortion-perception tradeoff
– ident: ref40
  doi: 10.1016/S0167-6377(99)00074-7
– ident: ref47
  doi: 10.1017/cbo9781139020411
– volume: 36
  start-page: 1
  volume-title: Proc. Adv. Neural Inf. Process. Syst.
  ident: ref30
  article-title: On the choice of perception loss function for learned video compression
– ident: ref15
  doi: 10.1109/MCOM.001.2000604
– ident: ref36
  doi: 10.1561/0100000004
– ident: ref8
  doi: 10.1109/PCS48520.2019.8954548
– volume-title: Numerical Analysis
  year: 2015
  ident: ref33
– volume: 1
  start-page: 205
  year: 1984
  ident: ref39
  article-title: Information geometry and alternating minimization procedures
  publication-title: Statist. Decisions, Dedewicz
– volume: 33
  start-page: 11913
  volume-title: Proc. Adv. Neural Inf. Process. Syst.
  ident: ref12
  article-title: High-fidelity generative image compression
– ident: ref14
  doi: 10.1109/TIP.2012.2191563
– ident: ref32
  doi: 10.1109/ISIT57864.2024.10619503
– ident: ref46
  doi: 10.1515/9781400873173
– ident: ref19
  doi: 10.1109/TIT.2015.2450721
– year: 2021
  ident: ref25
  article-title: Towards empirical sandwich bounds on the rate-distortion function
  publication-title: arXiv:2111.12166
– ident: ref41
  doi: 10.1109/TIT.1972.1054753
– ident: ref31
  doi: 10.1109/ISIT54713.2023.10206982
– ident: ref45
  doi: 10.1002/0471200611
– ident: ref16
  doi: 10.1109/TIP.2021.3058545
– ident: ref42
  doi: 10.1007/978-0-387-79234-7
– ident: ref20
  doi: 10.1109/JSAIT.2022.3231820
SSID ssj0014512
Score 2.4932594
Snippet We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion...
SourceID crossref
ieee
SourceType Index Database
Publisher
StartPage 1
SubjectTerms <italic xmlns:ali="http://www.niso.org/schemas/ali/1.0/" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">f -divergence
Approximation algorithms
Approximation Methods
Blahut-Arimoto Algorithms
Decoding
Distortion
Distortion measurement
Focusing
Lossy Source Coding
Minimization
Rate-distortion
Rate-Distortion-Perception Trade-off
Resource description framework
Stochastic processes
Sufficient conditions
Title Alternating Minimization Schemes for Computing Rate-Distortion-Perception Functions with f-Divergence Perception Constraints
URI https://ieeexplore.ieee.org/document/11145884
Volume 71
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 1557-9654
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0014512
  issn: 0018-9448
  databaseCode: RIE
  dateStart: 19630101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDI4YJzjwHGK8lAMXDtnW5tHmiIBpIIEQ2qTdqiZ1YQI6BB0HxI_HSbsxkJC4VZVTRbUdO7Y_m5BjbrkCyDMmFSgmtM2YEQEwBdpIpcFq6wL61zeqPxRXIzmqweoeCwMAvvgM2u7R5_KziZ26UFkH9dIDKxukEcWqAmvNUwZCBlVr8AA1GC8ds5xkV3cGlwO8CYayzZXLA4Y_bNDCUBVvU3rr5Ga2m6qU5LE9LU3bfvxq1Pjv7W6Qtdq7pKeVOGySJSi2yPpscgOtFXmLrC60Idwmn6dPdViwuKfX42L8XIMzccEDPMMbRc-WVl9xJHfon7Jz31_EUbHbeXEM7aGZ9JJMXYCX5kj2XuE7gS6QuTGhfjhF-dYkw97F4KzP6qkMzAZclCxAJsZhHnfTNJJGyEwA-jDS4NHnRoOnXKSWp1kugedpLEI0fibWuTZ5lurIWL5DlotJAbuERmgqU6OAdzUgoYnzAFSojRLKGgG8RU5mfEpequYbib-0dHWCPE0cT5Oapy3SdBz4pqt__t4f7_fJiltewQoPyHL5OoVD9C9Kc-Tl6gvYrtAU
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3db9NADLdgPMAeGIxO7AO4B154uLbJfTT3OMGqFtYKoVTqW5S7OFCNZhNLeZj44-e7JKUgIfEWRb7TKbZjn-2fDfBWOKERy4IrjZpL4wpuZYRco7FKG3TG-YD-bK4nC_lxqZYtWD1gYRAxFJ9h3z-GXH5x7TY-VDYgvQzAyofwSEkpVQPX2iYNpIqa5uAR6TBdO7qs5NAM0mlKd8FY9YX2mcD4Dyu0M1YlWJXxAcy78zTFJFf9TW377u6vVo3_feBn8LT1L9l5IxDP4QFWh3DQzW5grSofwv5OI8IX8Ov8exsYrL6y2aparVt4Ji34hmu8ZeTbsmYXT_KFPFT-IXQY8VT887Y8ho3JUAZZZj7Ey0oi-9kgPJHtkPlBoWE8RX3bg8X4In0_4e1cBu4iIWseERuTuEyGeT5SVqpCInkxytLPzw8Hz4XMnciLUqEo80TGZP5sYkpjyyI3I-vEEexV1xW-BDYiY5lbjWJokAhtUkaoY2O11M5KFMfwruNTdtO038jCtWVoMuJp5nmatTw9hp7nwG-69uOf_OP9G3g8SWeX2eV0_ukUnvitGpDhGezVPzb4iryN2r4OMnYP5bjTYQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Alternating+Minimization+Schemes+for+Computing+Rate-Distortion-Perception+Functions+with+f-Divergence+Perception+Constraints&rft.jtitle=IEEE+transactions+on+information+theory&rft.au=Serra%2C+Giuseppe&rft.au=Stavrou%2C+Photios+A.&rft.au=Kountouris%2C+Marios&rft.date=2025-11-01&rft.pub=IEEE&rft.issn=0018-9448&rft.spage=1&rft.epage=1&rft_id=info:doi/10.1109%2FTIT.2025.3604602&rft.externalDocID=11145884
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9448&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9448&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9448&client=summon