Differential Dynamic Programming With Nonlinear Safety Constraints Under System Uncertainties

Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to uncertainties in their dynamics, it is challenging to ensure that the constraints are not violated. In this letter, we propose Safe-CDDP, a safe tr...

Full description

Saved in:
Bibliographic Details
Published inIEEE robotics and automation letters Vol. 7; no. 2; pp. 1760 - 1767
Main Authors Alcan, Gokhan, Kyrki, Ville
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 01.04.2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN2377-3766
2377-3766
DOI10.1109/LRA.2022.3141192

Cover

Abstract Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to uncertainties in their dynamics, it is challenging to ensure that the constraints are not violated. In this letter, we propose Safe-CDDP, a safe trajectory optimization and control approach for systems under additive uncertainties and nonlinear safety constraints based on constrained differential dynamic programming (DDP). The safety of the robot during its motion is formulated as chance constraints with user-chosen probabilities of constraint satisfaction. The chance constraints are transformed into deterministic ones in DDP formulation by constraint tightening. To avoid over-conservatism during constraint tightening, linear control gains of the feedback policy derived from the constrained DDP are used in the approximation of closed-loop uncertainty propagation in prediction. The proposed algorithm is empirically evaluated on three different robot dynamics with up to 12 degrees of freedom in simulation. The computational feasibility and applicability of the approach are demonstrated with a physical hardware implementation.
AbstractList Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to uncertainties in their dynamics, it is challenging to ensure that the constraints are not violated. In this letter, we propose Safe-CDDP, a safe trajectory optimization and control approach for systems under additive uncertainties and nonlinear safety constraints based on constrained differential dynamic programming (DDP). The safety of the robot during its motion is formulated as chance constraints with user-chosen probabilities of constraint satisfaction. The chance constraints are transformed into deterministic ones in DDP formulation by constraint tightening. To avoid over-conservatism during constraint tightening, linear control gains of the feedback policy derived from the constrained DDP are used in the approximation of closed-loop uncertainty propagation in prediction. The proposed algorithm is empirically evaluated on three different robot dynamics with up to 12 degrees of freedom in simulation. The computational feasibility and applicability of the approach are demonstrated with a physical hardware implementation.
Author Kyrki, Ville
Alcan, Gokhan
Author_xml – sequence: 1
  givenname: Gokhan
  orcidid: 0000-0003-3025-5883
  surname: Alcan
  fullname: Alcan, Gokhan
  email: gokhan.alcan@aalto.fi
  organization: Intelligent Robotics Group, Department of Electrical Engineering and Automation (EEA), Aalto University, Espoo, Finland
– sequence: 2
  givenname: Ville
  orcidid: 0000-0002-5230-5549
  surname: Kyrki
  fullname: Kyrki, Ville
  email: ville.kyrki@aalto.fi
  organization: Intelligent Robotics Group, Department of Electrical Engineering and Automation (EEA), Aalto University, Espoo, Finland
BookMark eNp9kM1LwzAYh4NMcM7dBS8Fz5v5aJP2ODa_YKiow5OUrH0zM9p0JhnS_96UDZEJnpLw_p5fkucU9UxjAKFzgseE4Oxq_jwZU0zpmJGYkIweoT5lQoyY4Lz3a3-Chs6tMcYkoYJlSR-9z7RSYMF4Lato1hpZ6yJ6ss3KyrrWZhW9af8RPTSm0gakjV6kAt9G08Y4b6U23kULU0IYtM5DHQ4FWN8NNLgzdKxk5WC4XwdocXP9Or0bzR9v76eT-ahgjPlRnAqiUlBLqZJlWspkWYLCXMRFyhORhS8KlhQlJSSJGVcsgVKm2TIEuYCYSzZAZNe7NRvZfsmqyjdW19K2OcF5pyivrMw7RfleUWAud8zGNp9bcD5fN1trwjNzyikRWUriLoV3qcI2zllQf4qD-8NifoAU2kuvG9MJq_4DL3agBoCfe7LgIQ2avgHKtJID
CODEN IRALC6
CitedBy_id crossref_primary_10_1109_LRA_2024_3466069
crossref_primary_10_1109_LRA_2022_3182544
crossref_primary_10_1109_TAES_2021_3121668
Cites_doi 10.1109/CDC45484.2021.9683085
10.1109/IROS40897.2019.8967788
10.1109/ICRA40945.2020.9197414
10.1109/TCST.2021.3049416
10.1007/s10957-012-0039-0
10.1504/IJMMS.2019.103495
10.23919/ACC.2019.8814758
10.1109/ICRA.2017.7989086
10.1109/ICUAS.2017.7991335
10.1109/ICCPS.2018.00018
10.2514/1.G002367
10.1109/ICRA48506.2021.9561530
10.1177/0278364916645661
10.2514/1.G004363
10.1109/ACC.2005.1469949
10.1177/0278364917712421
10.1109/TAC.2016.2625048
10.1007/s12532-020-00179-2
10.1016/j.compchemeng.2017.10.026
10.1016/j.automatica.2014.10.128
10.1109/IROS.2012.6386025
10.1109/ACC.2010.5530971
10.1109/IROS40897.2019.8967794
10.1007/BFb0109870
10.1109/ICRA.2014.6907001
10.1109/TCST.2019.2949757
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022
DBID 97E
ESBDL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ADTOC
UNPAY
DOI 10.1109/LRA.2022.3141192
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE Xplore Open Access (Activated by CARLI)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
Unpaywall for CDI: Periodical Content
Unpaywall
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
– sequence: 2
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 1767
ExternalDocumentID 10.1109/lra.2022.3141192
10_1109_LRA_2022_3141192
9674833
Genre orig-research
GrantInformation_xml – fundername: Academy of Finland B-REAL Project
  grantid: 328399
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
ESBDL
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ADTOC
UNPAY
ID FETCH-LOGICAL-c333t-4871f8efbaf5b8da5bdef0674c86579110735cd2115436f35eda89bda567e46a3
IEDL.DBID UNPAY
ISSN 2377-3766
IngestDate Sun Oct 26 02:06:37 EDT 2025
Mon Jun 30 05:26:50 EDT 2025
Wed Oct 01 04:32:25 EDT 2025
Thu Apr 24 22:59:49 EDT 2025
Wed Aug 27 03:02:26 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://creativecommons.org/licenses/by/4.0/legalcode
cc-by
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c333t-4871f8efbaf5b8da5bdef0674c86579110735cd2115436f35eda89bda567e46a3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-3025-5883
0000-0002-5230-5549
OpenAccessLink https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ielx7/7083369/9647862/09674833.pdf
PQID 2621798142
PQPubID 4437225
PageCount 8
ParticipantIDs proquest_journals_2621798142
crossref_primary_10_1109_LRA_2022_3141192
ieee_primary_9674833
crossref_citationtrail_10_1109_LRA_2022_3141192
unpaywall_primary_10_1109_lra_2022_3141192
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2022-04-01
PublicationDateYYYYMMDD 2022-04-01
PublicationDate_xml – month: 04
  year: 2022
  text: 2022-04-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2022
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref14
ref30
ref10
ref2
ref1
ref17
ref16
ref18
ref24
ref23
sola (ref11) 0
ref26
ref20
ref22
ref21
nocedal (ref25) 2006
choi (ref6) 2021
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref5
guennebaud (ref28) 2010
pan (ref19) 0
References_xml – year: 2021
  ident: ref6
  article-title: Robust control barrier-value functions for safety-critical control
  doi: 10.1109/CDC45484.2021.9683085
– ident: ref16
  doi: 10.1109/IROS40897.2019.8967788
– ident: ref12
  doi: 10.1109/ICRA40945.2020.9197414
– ident: ref15
  doi: 10.1109/TCST.2021.3049416
– ident: ref9
  doi: 10.1007/s10957-012-0039-0
– ident: ref30
  doi: 10.1504/IJMMS.2019.103495
– ident: ref7
  doi: 10.23919/ACC.2019.8814758
– ident: ref13
  doi: 10.1109/ICRA.2017.7989086
– ident: ref29
  doi: 10.1109/ICUAS.2017.7991335
– ident: ref5
  doi: 10.1109/ICCPS.2018.00018
– start-page: 7637
  year: 0
  ident: ref11
  article-title: Squash-box feasibility driven differential dynamic programming
  publication-title: Proc IEEE Int Conf Intell Robots Syst
– ident: ref21
  doi: 10.2514/1.G002367
– ident: ref14
  doi: 10.1109/ICRA48506.2021.9561530
– ident: ref3
  doi: 10.1177/0278364916645661
– ident: ref22
  doi: 10.2514/1.G004363
– ident: ref17
  doi: 10.1109/ACC.2005.1469949
– ident: ref8
  doi: 10.1177/0278364917712421
– ident: ref4
  doi: 10.1109/TAC.2016.2625048
– ident: ref27
  doi: 10.1007/s12532-020-00179-2
– ident: ref1
  doi: 10.1016/j.compchemeng.2017.10.026
– ident: ref23
  doi: 10.1016/j.automatica.2014.10.128
– ident: ref26
  doi: 10.1109/IROS.2012.6386025
– ident: ref18
  doi: 10.1109/ACC.2010.5530971
– year: 2010
  ident: ref28
  article-title: Eigen
– year: 2006
  ident: ref25
  publication-title: Numerical Optimization
– ident: ref20
  doi: 10.1109/IROS40897.2019.8967794
– start-page: 1907
  year: 0
  ident: ref19
  article-title: Probabilistic differential dynamic programming
  publication-title: Proc IEEE Adv Neural Inf Process Syst
– ident: ref24
  doi: 10.1007/BFb0109870
– ident: ref10
  doi: 10.1109/ICRA.2014.6907001
– ident: ref2
  doi: 10.1109/TCST.2019.2949757
SSID ssj0001527395
Score 2.286336
Snippet Safe operation of systems such as robots requires them to plan and execute trajectories subject to safety constraints. When those systems are subject to...
SourceID unpaywall
proquest
crossref
ieee
SourceType Open Access Repository
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1760
SubjectTerms Algorithms
constrained motion planning
Constraints
Dynamic programming
Electron tubes
Linear control
motion and path planning
Optimization and optimal control
planning under uncertainty
Robot dynamics
robot safety
Robots
Safety
Stochastic processes
Task analysis
Tightening
Trajectory control
Trajectory optimization
Trajectory planning
Uncertainty
SummonAdditionalLinks – databaseName: IEEE Electronic Library (IEL)
  dbid: RIE
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT9wwEB4BF-BQHgvqtlD5wAVEdokdO_YRdbtaIUCIh-CCIscZi4qwoCWrCn597Ti7PFohbrE01owytmbGHn8fwJaRLqxyiVHMcxElKapIWa0jK2VBrXA1F_XvnY-OxeAiObjiVzOwO30Lg4h18xl2_Gd9l1_cm7E_Kusqz4zB2CzMplKEt1ov5ykeSUzxyU3knuoenu67-o9SV5YmcbjrfIk8NZXKm6xyfjx80E9_dFm-CjD9JTiamBb6Sm474yrvmOd3qI2ftX0ZvjSZJtkPS2MFZnC4Couv8AdbcN1r6FHcNi9JL5DTk5PQsnXnRMjl7-qGHAc4DT0iZ9pi9UQ8y2fNLVE9kpo4iQTgczcwocXAw7SuwUX_1_nPQdTwLUSGMVZFrnaJrUSba8tzWWieF2hdNEuMFDxVvlJk3BTUI_gwYRnHQkuVO0GRYiI0W4e54f0QvwKJE4PSKqGpMUmhbF4Yl-ulPrtDSpG3oTvxRWYaMHJvd5nVRcmeypz3Mu-9rPFeG7anMx4CEMcHsi3vgKlc8-_bsDFxd9bs1MeMCuox2-LEzdqZLoF_VJQj_UbFt_-r-A4LXiq09mzAXDUa46bLWqr8R71c_wLZ4epJ
  priority: 102
  providerName: IEEE
Title Differential Dynamic Programming With Nonlinear Safety Constraints Under System Uncertainties
URI https://ieeexplore.ieee.org/document/9674833
https://www.proquest.com/docview/2621798142
https://ieeexplore.ieee.org/ielx7/7083369/9647862/09674833.pdf
UnpaywallVersion publishedVersion
Volume 7
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAFT
  databaseName: Open Access Digital Library
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: KQ8
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html
  providerName: Colorado Alliance of Research Libraries
– providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: RIE
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: M~E
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9QwELbo9gAceBXEQln5wAWkbBrHduzjiraqEF1VwIpyQJHjjEVFWFbbrKAc-O2MH7u0ICHBLY7GcuIZxzPxzPcR8tQq3FaFgqwQjcx4BTrTzpjMKdUyJzHmYr7e-Xgqj2b85ak4TT_cQi0MAITkMxj7y3CWfwbdtyqv0Fkopc596SS64Tn63hXHW-NF67bIthToiw_I9mx6MnkfGOWqsHo2Z5N7Ou-WHmmIMQxUeRFPP3_tRYFc5YqfeX01X5iLr6brLm05h7dJvX7YmGnyabzqm7H9_huO4_-_zR1yK3mjdBLN5y65BvN75OYljMId8mE_Uajgp6Cj-5HAnp7EtK7PKELfnfUf6TRCbpglfWMc9BfUM4EG_on-nAZyJRrB0bFhYxqCh3K9T2aHB29fHGWJkyGzZVn2GcY3hVPgGuNEo1ojmhYc7njcKikq7aPJUtiWeZSfUrpSQGuUblBQVsClKR-QwfzLHB4SWnALymlpmLW81a5pLU5K5T1AYAzEkORr7dQ2AZb75-7qELjs6frV60nt9VknfQ7Js02PRQTr-IvsjlfJRi7N_5Dsrg2gTqv5vGaSeVy3gmOv5xuj-GMINK8rQzz6F-HH5IZvxqSgXTLolyt4gv5O34zI1vGPg1EoTRwlA_8JY2L7GA
linkProvider Unpaywall
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LTxsxEB4BPVAOlJYiQin1oRcqNmH9in1EpSiFJEItqFyqldc7FogloLBRRX997fUmPFpV3NbSWB7t2JoZz_j7AD5a5d2qUJikIpcJ76JOtDMmcUoV1Emfc9Hw3nkwlL1TfngmzuZgZ_YWBhHr5jNsh8-6ll9c20m4KuvowIzB2Dy8EJxzEV9r3d-oBCwxLaa1yF3d6X_b8xkgpT4x5Wmsdt77nppM5VFcuTgZ3Zi7X6YsH7iYg1cwmCoXO0su25Mqb9vfT3Abn6v9Ciw3sSbZi5vjNczh6A0sPUAgXIWf-w1Bij_oJdmP9PTkODZtXXkR8uOiOifDCKhhxuS7cVjdkcDzWbNLVLekpk4iEfrcD2xsMghArW_h9ODLyede0jAuJJYxViU-e0mdQpcbJ3JVGJEX6Lw_41ZJ0dUhV2TCFjRg-DDpmMDCKJ17QdlFLg1bg4XR9QjXgaTconJaGmotL7TLC-ujvW6I75BSFC3oTG2R2QaOPOhdZnVasqszb70sWC9rrNeC7dmMmwjF8R_Z1WCAmVzz71uwOTV31pzV24xKGlDbUu5nfZptgb-WKMfm0RIb_17iAyz2Tgb9rP91ePQOXoYZsdFnExaq8QTf-ximyrfqrfsHQXztlg
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9QwELZge4AeyqMgFgrygQtI2TSO7djHFaWqEKwqYEU5oMhxxmpF2K62WdH213f82KUFCQlucTSWE884MxOPv4-Ql1ahWxUKskI0MuMV6Ew7YzKnVMucxJyL-fPOHybyYMrfHYmj9MMtnIUBgFB8BiN_GfbyT6A7r_IKg4VS6twfncQwPMfYu-J4azRv3W2yIQXG4gOyMZ0cjr8GRrkqrJ713uSuzruFRxpiDBNVXsTdz1--KJCr3Igz7yxnc3Px03TdNZezf4_Uq4eNlSbfR8u-GdnL33Ac__9t7pOtFI3ScTSfB-QWzB6SzWsYhdvk216iUMFPQUf3IoE9PYxlXT9QhH456Y_pJEJumAX9ZBz0F9QzgQb-if6MBnIlGsHRsWFjGYKHcn1EpvtvP785yBInQ2bLsuwzzG8Kp8A1xolGtUY0LTj0eNwqKSrts8lS2JZ5lJ9SulJAa5RuUFBWwKUpH5PB7HQGTwgtuAXltDTMWt5q17QWJ6XyESAwBmJI8pV2apsAy_1zd3VIXHZ1_f7juPb6rJM-h-TVusc8gnX8RXbbq2Qtl-Z_SHZWBlCn1XxWM8k8rlvBsdfrtVH8MQSa140hnv6L8DNy1zdjUdAOGfSLJTzHeKdvXiSjvgKt-_jm
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Differential+Dynamic+Programming+With+Nonlinear+Safety+Constraints+Under+System+Uncertainties&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Alcan%2C+Gokhan&rft.au=Kyrki%2C+Ville&rft.date=2022-04-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=7&rft.issue=2&rft.spage=1760&rft.epage=1767&rft_id=info:doi/10.1109%2FLRA.2022.3141192&rft.externalDocID=9674833
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon