Differential Dynamic Programming With Nonlinear Safety Constraints Under System Uncertainties
Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to uncertainties in their dynamics, it is challenging to ensure that the constraints are not violated. In this letter, we propose Safe-CDDP, a safe tr...
        Saved in:
      
    
          | Published in | IEEE robotics and automation letters Vol. 7; no. 2; pp. 1760 - 1767 | 
|---|---|
| Main Authors | , | 
| Format | Journal Article | 
| Language | English | 
| Published | 
        Piscataway
          IEEE
    
        01.04.2022
     The Institute of Electrical and Electronics Engineers, Inc. (IEEE)  | 
| Subjects | |
| Online Access | Get full text | 
| ISSN | 2377-3766 2377-3766  | 
| DOI | 10.1109/LRA.2022.3141192 | 
Cover
| Abstract | Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to uncertainties in their dynamics, it is challenging to ensure that the constraints are not violated. In this letter, we propose Safe-CDDP, a safe trajectory optimization and control approach for systems under additive uncertainties and nonlinear safety constraints based on constrained differential dynamic programming (DDP). The safety of the robot during its motion is formulated as chance constraints with user-chosen probabilities of constraint satisfaction. The chance constraints are transformed into deterministic ones in DDP formulation by constraint tightening. To avoid over-conservatism during constraint tightening, linear control gains of the feedback policy derived from the constrained DDP are used in the approximation of closed-loop uncertainty propagation in prediction. The proposed algorithm is empirically evaluated on three different robot dynamics with up to 12 degrees of freedom in simulation. The computational feasibility and applicability of the approach are demonstrated with a physical hardware implementation. | 
    
|---|---|
| AbstractList | Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to uncertainties in their dynamics, it is challenging to ensure that the constraints are not violated. In this letter, we propose Safe-CDDP, a safe trajectory optimization and control approach for systems under additive uncertainties and nonlinear safety constraints based on constrained differential dynamic programming (DDP). The safety of the robot during its motion is formulated as chance constraints with user-chosen probabilities of constraint satisfaction. The chance constraints are transformed into deterministic ones in DDP formulation by constraint tightening. To avoid over-conservatism during constraint tightening, linear control gains of the feedback policy derived from the constrained DDP are used in the approximation of closed-loop uncertainty propagation in prediction. The proposed algorithm is empirically evaluated on three different robot dynamics with up to 12 degrees of freedom in simulation. The computational feasibility and applicability of the approach are demonstrated with a physical hardware implementation. | 
    
| Author | Kyrki, Ville Alcan, Gokhan  | 
    
| Author_xml | – sequence: 1 givenname: Gokhan orcidid: 0000-0003-3025-5883 surname: Alcan fullname: Alcan, Gokhan email: gokhan.alcan@aalto.fi organization: Intelligent Robotics Group, Department of Electrical Engineering and Automation (EEA), Aalto University, Espoo, Finland – sequence: 2 givenname: Ville orcidid: 0000-0002-5230-5549 surname: Kyrki fullname: Kyrki, Ville email: ville.kyrki@aalto.fi organization: Intelligent Robotics Group, Department of Electrical Engineering and Automation (EEA), Aalto University, Espoo, Finland  | 
    
| BookMark | eNp9kM1LwzAYh4NMcM7dBS8Fz5v5aJP2ODa_YKiow5OUrH0zM9p0JhnS_96UDZEJnpLw_p5fkucU9UxjAKFzgseE4Oxq_jwZU0zpmJGYkIweoT5lQoyY4Lz3a3-Chs6tMcYkoYJlSR-9z7RSYMF4Lato1hpZ6yJ6ss3KyrrWZhW9af8RPTSm0gakjV6kAt9G08Y4b6U23kULU0IYtM5DHQ4FWN8NNLgzdKxk5WC4XwdocXP9Or0bzR9v76eT-ahgjPlRnAqiUlBLqZJlWspkWYLCXMRFyhORhS8KlhQlJSSJGVcsgVKm2TIEuYCYSzZAZNe7NRvZfsmqyjdW19K2OcF5pyivrMw7RfleUWAud8zGNp9bcD5fN1trwjNzyikRWUriLoV3qcI2zllQf4qD-8NifoAU2kuvG9MJq_4DL3agBoCfe7LgIQ2avgHKtJID | 
    
| CODEN | IRALC6 | 
    
| CitedBy_id | crossref_primary_10_1109_LRA_2024_3466069 crossref_primary_10_1109_LRA_2022_3182544 crossref_primary_10_1109_TAES_2021_3121668  | 
    
| Cites_doi | 10.1109/CDC45484.2021.9683085 10.1109/IROS40897.2019.8967788 10.1109/ICRA40945.2020.9197414 10.1109/TCST.2021.3049416 10.1007/s10957-012-0039-0 10.1504/IJMMS.2019.103495 10.23919/ACC.2019.8814758 10.1109/ICRA.2017.7989086 10.1109/ICUAS.2017.7991335 10.1109/ICCPS.2018.00018 10.2514/1.G002367 10.1109/ICRA48506.2021.9561530 10.1177/0278364916645661 10.2514/1.G004363 10.1109/ACC.2005.1469949 10.1177/0278364917712421 10.1109/TAC.2016.2625048 10.1007/s12532-020-00179-2 10.1016/j.compchemeng.2017.10.026 10.1016/j.automatica.2014.10.128 10.1109/IROS.2012.6386025 10.1109/ACC.2010.5530971 10.1109/IROS40897.2019.8967794 10.1007/BFb0109870 10.1109/ICRA.2014.6907001 10.1109/TCST.2019.2949757  | 
    
| ContentType | Journal Article | 
    
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 | 
    
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 | 
    
| DBID | 97E ESBDL RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D ADTOC UNPAY  | 
    
| DOI | 10.1109/LRA.2022.3141192 | 
    
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE Xplore Open Access (Activated by CARLI) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts  Academic Computer and Information Systems Abstracts Professional Unpaywall for CDI: Periodical Content Unpaywall  | 
    
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional  | 
    
| DatabaseTitleList | Technology Research Database  | 
    
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher – sequence: 2 dbid: UNPAY name: Unpaywall url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/ sourceTypes: Open Access Repository  | 
    
| DeliveryMethod | fulltext_linktorsrc | 
    
| Discipline | Engineering | 
    
| EISSN | 2377-3766 | 
    
| EndPage | 1767 | 
    
| ExternalDocumentID | 10.1109/lra.2022.3141192 10_1109_LRA_2022_3141192 9674833  | 
    
| Genre | orig-research | 
    
| GrantInformation_xml | – fundername: Academy of Finland B-REAL Project grantid: 328399  | 
    
| GroupedDBID | 0R~ 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFS AGQYO AGSQL AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS EJD ESBDL IFIPE IPLJI JAVBF KQ8 M43 M~E O9- OCL RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D ADTOC UNPAY  | 
    
| ID | FETCH-LOGICAL-c333t-4871f8efbaf5b8da5bdef0674c86579110735cd2115436f35eda89bda567e46a3 | 
    
| IEDL.DBID | UNPAY | 
    
| ISSN | 2377-3766 | 
    
| IngestDate | Sun Oct 26 02:06:37 EDT 2025 Mon Jun 30 05:26:50 EDT 2025 Wed Oct 01 04:32:25 EDT 2025 Thu Apr 24 22:59:49 EDT 2025 Wed Aug 27 03:02:26 EDT 2025  | 
    
| IsDoiOpenAccess | true | 
    
| IsOpenAccess | true | 
    
| IsPeerReviewed | true | 
    
| IsScholarly | true | 
    
| Issue | 2 | 
    
| Language | English | 
    
| License | https://creativecommons.org/licenses/by/4.0/legalcode cc-by  | 
    
| LinkModel | DirectLink | 
    
| MergedId | FETCHMERGED-LOGICAL-c333t-4871f8efbaf5b8da5bdef0674c86579110735cd2115436f35eda89bda567e46a3 | 
    
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14  | 
    
| ORCID | 0000-0003-3025-5883 0000-0002-5230-5549  | 
    
| OpenAccessLink | https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ielx7/7083369/9647862/09674833.pdf | 
    
| PQID | 2621798142 | 
    
| PQPubID | 4437225 | 
    
| PageCount | 8 | 
    
| ParticipantIDs | proquest_journals_2621798142 crossref_primary_10_1109_LRA_2022_3141192 ieee_primary_9674833 crossref_citationtrail_10_1109_LRA_2022_3141192 unpaywall_primary_10_1109_lra_2022_3141192  | 
    
| ProviderPackageCode | CITATION AAYXX  | 
    
| PublicationCentury | 2000 | 
    
| PublicationDate | 2022-04-01 | 
    
| PublicationDateYYYYMMDD | 2022-04-01 | 
    
| PublicationDate_xml | – month: 04 year: 2022 text: 2022-04-01 day: 01  | 
    
| PublicationDecade | 2020 | 
    
| PublicationPlace | Piscataway | 
    
| PublicationPlace_xml | – name: Piscataway | 
    
| PublicationTitle | IEEE robotics and automation letters | 
    
| PublicationTitleAbbrev | LRA | 
    
| PublicationYear | 2022 | 
    
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE)  | 
    
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)  | 
    
| References | ref13 ref12 ref15 ref14 ref30 ref10 ref2 ref1 ref17 ref16 ref18 ref24 ref23 sola (ref11) 0 ref26 ref20 ref22 ref21 nocedal (ref25) 2006 choi (ref6) 2021 ref27 ref29 ref8 ref7 ref9 ref4 ref3 ref5 guennebaud (ref28) 2010 pan (ref19) 0  | 
    
| References_xml | – year: 2021 ident: ref6 article-title: Robust control barrier-value functions for safety-critical control doi: 10.1109/CDC45484.2021.9683085 – ident: ref16 doi: 10.1109/IROS40897.2019.8967788 – ident: ref12 doi: 10.1109/ICRA40945.2020.9197414 – ident: ref15 doi: 10.1109/TCST.2021.3049416 – ident: ref9 doi: 10.1007/s10957-012-0039-0 – ident: ref30 doi: 10.1504/IJMMS.2019.103495 – ident: ref7 doi: 10.23919/ACC.2019.8814758 – ident: ref13 doi: 10.1109/ICRA.2017.7989086 – ident: ref29 doi: 10.1109/ICUAS.2017.7991335 – ident: ref5 doi: 10.1109/ICCPS.2018.00018 – start-page: 7637 year: 0 ident: ref11 article-title: Squash-box feasibility driven differential dynamic programming publication-title: Proc IEEE Int Conf Intell Robots Syst – ident: ref21 doi: 10.2514/1.G002367 – ident: ref14 doi: 10.1109/ICRA48506.2021.9561530 – ident: ref3 doi: 10.1177/0278364916645661 – ident: ref22 doi: 10.2514/1.G004363 – ident: ref17 doi: 10.1109/ACC.2005.1469949 – ident: ref8 doi: 10.1177/0278364917712421 – ident: ref4 doi: 10.1109/TAC.2016.2625048 – ident: ref27 doi: 10.1007/s12532-020-00179-2 – ident: ref1 doi: 10.1016/j.compchemeng.2017.10.026 – ident: ref23 doi: 10.1016/j.automatica.2014.10.128 – ident: ref26 doi: 10.1109/IROS.2012.6386025 – ident: ref18 doi: 10.1109/ACC.2010.5530971 – year: 2010 ident: ref28 article-title: Eigen – year: 2006 ident: ref25 publication-title: Numerical Optimization – ident: ref20 doi: 10.1109/IROS40897.2019.8967794 – start-page: 1907 year: 0 ident: ref19 article-title: Probabilistic differential dynamic programming publication-title: Proc IEEE Adv Neural Inf Process Syst – ident: ref24 doi: 10.1007/BFb0109870 – ident: ref10 doi: 10.1109/ICRA.2014.6907001 – ident: ref2 doi: 10.1109/TCST.2019.2949757  | 
    
| SSID | ssj0001527395 | 
    
| Score | 2.286336 | 
    
| Snippet | Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to... | 
    
| SourceID | unpaywall proquest crossref ieee  | 
    
| SourceType | Open Access Repository Aggregation Database Enrichment Source Index Database Publisher  | 
    
| StartPage | 1760 | 
    
| SubjectTerms | Algorithms constrained motion planning Constraints Dynamic programming Electron tubes Linear control motion and path planning Optimization and optimal control planning under uncertainty Robot dynamics robot safety Robots Safety Stochastic processes Task analysis Tightening Trajectory control Trajectory optimization Trajectory planning Uncertainty  | 
    
| SummonAdditionalLinks | – databaseName: IEEE Electronic Library (IEL) dbid: RIE link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT9wwEB4BF-BQHgvqtlD5wAVEdokdO_YRdbtaIUCIh-CCIscZi4qwoCWrCn597Ti7PFohbrE01owytmbGHn8fwJaRLqxyiVHMcxElKapIWa0jK2VBrXA1F_XvnY-OxeAiObjiVzOwO30Lg4h18xl2_Gd9l1_cm7E_Kusqz4zB2CzMplKEt1ov5ykeSUzxyU3knuoenu67-o9SV5YmcbjrfIk8NZXKm6xyfjx80E9_dFm-CjD9JTiamBb6Sm474yrvmOd3qI2ftX0ZvjSZJtkPS2MFZnC4Couv8AdbcN1r6FHcNi9JL5DTk5PQsnXnRMjl7-qGHAc4DT0iZ9pi9UQ8y2fNLVE9kpo4iQTgczcwocXAw7SuwUX_1_nPQdTwLUSGMVZFrnaJrUSba8tzWWieF2hdNEuMFDxVvlJk3BTUI_gwYRnHQkuVO0GRYiI0W4e54f0QvwKJE4PSKqGpMUmhbF4Yl-ulPrtDSpG3oTvxRWYaMHJvd5nVRcmeypz3Mu-9rPFeG7anMx4CEMcHsi3vgKlc8-_bsDFxd9bs1MeMCuox2-LEzdqZLoF_VJQj_UbFt_-r-A4LXiq09mzAXDUa46bLWqr8R71c_wLZ4epJ priority: 102 providerName: IEEE  | 
    
| Title | Differential Dynamic Programming With Nonlinear Safety Constraints Under System Uncertainties | 
    
| URI | https://ieeexplore.ieee.org/document/9674833 https://www.proquest.com/docview/2621798142 https://ieeexplore.ieee.org/ielx7/7083369/9647862/09674833.pdf  | 
    
| UnpaywallVersion | publishedVersion | 
    
| Volume | 7 | 
    
| hasFullText | 1 | 
    
| inHoldings | 1 | 
    
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAFT databaseName: Open Access Digital Library customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: KQ8 dateStart: 20160101 isFulltext: true titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html providerName: Colorado Alliance of Research Libraries – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: RIE dateStart: 20160101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: M~E dateStart: 20160101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre  | 
    
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9QwELbo9gAceBXEQln5wAWkbBrHduzjiraqEF1VwIpyQJHjjEVFWFbbrKAc-O2MH7u0ICHBLY7GcuIZxzPxzPcR8tQq3FaFgqwQjcx4BTrTzpjMKdUyJzHmYr7e-Xgqj2b85ak4TT_cQi0MAITkMxj7y3CWfwbdtyqv0Fkopc596SS64Tn63hXHW-NF67bIthToiw_I9mx6MnkfGOWqsHo2Z5N7Ou-WHmmIMQxUeRFPP3_tRYFc5YqfeX01X5iLr6brLm05h7dJvX7YmGnyabzqm7H9_huO4_-_zR1yK3mjdBLN5y65BvN75OYljMId8mE_Uajgp6Cj-5HAnp7EtK7PKELfnfUf6TRCbpglfWMc9BfUM4EG_on-nAZyJRrB0bFhYxqCh3K9T2aHB29fHGWJkyGzZVn2GcY3hVPgGuNEo1ojmhYc7njcKikq7aPJUtiWeZSfUrpSQGuUblBQVsClKR-QwfzLHB4SWnALymlpmLW81a5pLU5K5T1AYAzEkORr7dQ2AZb75-7qELjs6frV60nt9VknfQ7Js02PRQTr-IvsjlfJRi7N_5Dsrg2gTqv5vGaSeVy3gmOv5xuj-GMINK8rQzz6F-HH5IZvxqSgXTLolyt4gv5O34zI1vGPg1EoTRwlA_8JY2L7GA | 
    
| linkProvider | Unpaywall | 
    
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LTxsxEB4BPVAOlJYiQin1oRcqNmH9in1EpSiFJEItqFyqldc7FogloLBRRX997fUmPFpV3NbSWB7t2JoZz_j7AD5a5d2qUJikIpcJ76JOtDMmcUoV1Emfc9Hw3nkwlL1TfngmzuZgZ_YWBhHr5jNsh8-6ll9c20m4KuvowIzB2Dy8EJxzEV9r3d-oBCwxLaa1yF3d6X_b8xkgpT4x5Wmsdt77nppM5VFcuTgZ3Zi7X6YsH7iYg1cwmCoXO0su25Mqb9vfT3Abn6v9Ciw3sSbZi5vjNczh6A0sPUAgXIWf-w1Bij_oJdmP9PTkODZtXXkR8uOiOifDCKhhxuS7cVjdkcDzWbNLVLekpk4iEfrcD2xsMghArW_h9ODLyede0jAuJJYxViU-e0mdQpcbJ3JVGJEX6Lw_41ZJ0dUhV2TCFjRg-DDpmMDCKJ17QdlFLg1bg4XR9QjXgaTconJaGmotL7TLC-ujvW6I75BSFC3oTG2R2QaOPOhdZnVasqszb70sWC9rrNeC7dmMmwjF8R_Z1WCAmVzz71uwOTV31pzV24xKGlDbUu5nfZptgb-WKMfm0RIb_17iAyz2Tgb9rP91ePQOXoYZsdFnExaq8QTf-ximyrfqrfsHQXztlg | 
    
| linkToUnpaywall | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9QwELZge4AeyqMgFgrygQtI2TSO7djHFaWqEKwqYEU5oMhxxmpF2K62WdH213f82KUFCQlucTSWE884MxOPv4-Ql1ahWxUKskI0MuMV6Ew7YzKnVMucxJyL-fPOHybyYMrfHYmj9MMtnIUBgFB8BiN_GfbyT6A7r_IKg4VS6twfncQwPMfYu-J4azRv3W2yIQXG4gOyMZ0cjr8GRrkqrJ713uSuzruFRxpiDBNVXsTdz1--KJCr3Igz7yxnc3Px03TdNZezf4_Uq4eNlSbfR8u-GdnL33Ac__9t7pOtFI3ScTSfB-QWzB6SzWsYhdvk216iUMFPQUf3IoE9PYxlXT9QhH456Y_pJEJumAX9ZBz0F9QzgQb-if6MBnIlGsHRsWFjGYKHcn1EpvtvP785yBInQ2bLsuwzzG8Kp8A1xolGtUY0LTj0eNwqKSrts8lS2JZ5lJ9SulJAa5RuUFBWwKUpH5PB7HQGTwgtuAXltDTMWt5q17QWJ6XyESAwBmJI8pV2apsAy_1zd3VIXHZ1_f7juPb6rJM-h-TVusc8gnX8RXbbq2Qtl-Z_SHZWBlCn1XxWM8k8rlvBsdfrtVH8MQSa140hnv6L8DNy1zdjUdAOGfSLJTzHeKdvXiSjvgKt-_jm | 
    
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Differential+Dynamic+Programming+With+Nonlinear+Safety+Constraints+Under+System+Uncertainties&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Alcan%2C+Gokhan&rft.au=Kyrki%2C+Ville&rft.date=2022-04-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=7&rft.issue=2&rft.spage=1760&rft.epage=1767&rft_id=info:doi/10.1109%2FLRA.2022.3141192&rft.externalDocID=9674833 | 
    
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon | 
    
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon | 
    
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon |