增强现实眼镜辅助的线缆连接器装配状态智能检错方法

TP274; 为替代航空航天产品装配过程中人工判定线缆连接器组装结果的操作,提出一种增强现实(AR)眼镜辅助的线缆连接器装配状态智能检错方法.该智能检错方法包括自动检测连接器孔位、分布排序和可视化不匹配孔位三个环节.面向孔位检测,融合了特征金字塔网络架构与双向长短期记忆网络结构的孔位检测网络可以有效定位图像中孔位位置并识别其真实安装状态;在孔位分布排序流程中,对检测到的孔位进行聚类划分至不同圆环上,排序每层圆环上孔位的极角以获得编号;顺序遍历所有编号的孔位,比对每个孔位的理想安装结果和真实安装状态可得知错装导线孔位与漏装导线的孔位,并使用AR眼镜可视化型谱图高亮这些不匹配孔位.采用PASCAL...

Full description

Saved in:
Bibliographic Details
Published in计算机集成制造系统 Vol. 27; no. 10; pp. 2822 - 2836
Main Authors 李树飞, 郑联语, 刘新玉, 王天睿
Format Journal Article
LanguageChinese
Published 北京航空航天大学 机械工程及自动化学院,北京 100191 01.10.2021
Subjects
增强现实眼镜;辅助装配;深度学习;线缆连接器;孔位检测;孔位排序
Online AccessGet full text
ISSN1006-5911
DOI10.13196/j.cims.2021.10.007

Cover

Abstract TP274; 为替代航空航天产品装配过程中人工判定线缆连接器组装结果的操作,提出一种增强现实(AR)眼镜辅助的线缆连接器装配状态智能检错方法.该智能检错方法包括自动检测连接器孔位、分布排序和可视化不匹配孔位三个环节.面向孔位检测,融合了特征金字塔网络架构与双向长短期记忆网络结构的孔位检测网络可以有效定位图像中孔位位置并识别其真实安装状态;在孔位分布排序流程中,对检测到的孔位进行聚类划分至不同圆环上,排序每层圆环上孔位的极角以获得编号;顺序遍历所有编号的孔位,比对每个孔位的理想安装结果和真实安装状态可得知错装导线孔位与漏装导线的孔位,并使用AR眼镜可视化型谱图高亮这些不匹配孔位.采用PASCAL VOC数据集的评价指标,以11种连接器的检错结果为例进行验证,提出的孔位检测网络的平均精度均值高达99.00％;同时孔位分布排序算法针对图像形变情况有较强的鲁棒性.
AbstractList TP274; 为替代航空航天产品装配过程中人工判定线缆连接器组装结果的操作,提出一种增强现实(AR)眼镜辅助的线缆连接器装配状态智能检错方法.该智能检错方法包括自动检测连接器孔位、分布排序和可视化不匹配孔位三个环节.面向孔位检测,融合了特征金字塔网络架构与双向长短期记忆网络结构的孔位检测网络可以有效定位图像中孔位位置并识别其真实安装状态;在孔位分布排序流程中,对检测到的孔位进行聚类划分至不同圆环上,排序每层圆环上孔位的极角以获得编号;顺序遍历所有编号的孔位,比对每个孔位的理想安装结果和真实安装状态可得知错装导线孔位与漏装导线的孔位,并使用AR眼镜可视化型谱图高亮这些不匹配孔位.采用PASCAL VOC数据集的评价指标,以11种连接器的检错结果为例进行验证,提出的孔位检测网络的平均精度均值高达99.00％;同时孔位分布排序算法针对图像形变情况有较强的鲁棒性.
Author 刘新玉
李树飞
王天睿
郑联语
AuthorAffiliation 北京航空航天大学 机械工程及自动化学院,北京 100191
AuthorAffiliation_xml – name: 北京航空航天大学 机械工程及自动化学院,北京 100191
Author_FL ZHENG Lianyu
WANG Tianrui
LI Shufei
LIU Xinyu
Author_FL_xml – sequence: 1
  fullname: LI Shufei
– sequence: 2
  fullname: ZHENG Lianyu
– sequence: 3
  fullname: LIU Xinyu
– sequence: 4
  fullname: WANG Tianrui
Author_xml – sequence: 1
  fullname: 李树飞
– sequence: 2
  fullname: 郑联语
– sequence: 3
  fullname: 刘新玉
– sequence: 4
  fullname: 王天睿
BookMark eNotj81Kw0AYRWdRwVr7BL6BkPhNkplJllLUCgU3ui7JZEYaNAWjKF1VtC4KdmWFSMnCIuhGBEEwRPs0-XsLI7q63Ls4l7OCan7fFwitYVCxji264am8dxyoGmhYrUYAVkN1DEAVYmG8jJpB0HOqSqjOCKmjdvoYpUmcT97S1yifJeV0VnyP0vFL_nCdx4s8uSkWUTZ5SsPnYj4qR7f5-CMbXmZhXFx9ZfNheRdm95_Z-3QVLUn7KBDN_2ygg-2t_VZb6ezt7LY2O0qAgTBFSBCMMYINil2TA3BLk4bkls1cabmmbmkadU3HACGkTZg0MKNC4w4FmxJD6A20_sc9t31p-4ddr3924lePXS_wPD4YXJz-ylfKwPQfEJRr5A
ClassificationCodes TP274
ContentType Journal Article
Copyright Copyright © Wanfang Data Co. Ltd. All Rights Reserved.
Copyright_xml – notice: Copyright © Wanfang Data Co. Ltd. All Rights Reserved.
DBID 2B.
4A8
92I
93N
PSX
TCJ
DOI 10.13196/j.cims.2021.10.007
DatabaseName Wanfang Data Journals - Hong Kong
WANFANG Data Centre
Wanfang Data Journals
万方数据期刊 - 香港版
China Online Journals (COJ)
China Online Journals (COJ)
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
DocumentTitle_FL Smart inspection for assembly states of connectors in wiring harness assisted by AR glasses
EndPage 2836
ExternalDocumentID jsjjczzxt202110007
GrantInformation_xml – fundername: 民用飞机专项科研资助项目
  funderid: (MJ-2017-G-70)
GroupedDBID 2B.
4A8
92I
93N
ALMA_UNASSIGNED_HOLDINGS
CDYEO
PSX
TCJ
ID FETCH-LOGICAL-s1057-ef0e77751461d8c00c92f4fc9a7df9d839226d8b40eefa57f4176e2cb60a654e3
ISSN 1006-5911
IngestDate Thu May 29 04:00:05 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 10
Keywords 增强现实眼镜;辅助装配;深度学习;线缆连接器;孔位检测;孔位排序
Language Chinese
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-s1057-ef0e77751461d8c00c92f4fc9a7df9d839226d8b40eefa57f4176e2cb60a654e3
PageCount 15
ParticipantIDs wanfang_journals_jsjjczzxt202110007
PublicationCentury 2000
PublicationDate 2021-10-01
PublicationDateYYYYMMDD 2021-10-01
PublicationDate_xml – month: 10
  year: 2021
  text: 2021-10-01
  day: 01
PublicationDecade 2020
PublicationTitle 计算机集成制造系统
PublicationTitle_FL Computer Integrated Manufacturing Systems
PublicationYear 2021
Publisher 北京航空航天大学 机械工程及自动化学院,北京 100191
Publisher_xml – name: 北京航空航天大学 机械工程及自动化学院,北京 100191
SSID ssib006563755
ssib023646381
ssib001102950
ssib051375755
ssib023167363
ssib036438063
ssib000459500
ssib002258428
Score 2.3625393
Snippet TP274; 为替代航空航天产品装配过程中人工判定线缆连接器组装结果的操作,提出一种增强现实(AR)眼镜辅助的线缆连接器装配状态智能检错方法.该智能检错方法包括自动检测连接...
SourceID wanfang
SourceType Aggregation Database
StartPage 2822
Title 增强现实眼镜辅助的线缆连接器装配状态智能检错方法
URI https://d.wanfangdata.com.cn/periodical/jsjjczzxt202110007
Volume 27
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVEBS
  databaseName: Inspec with Full Text
  issn: 1006-5911
  databaseCode: ADMLS
  dateStart: 20200701
  customDbUrl:
  isFulltext: true
  dateEnd: 99991231
  titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text
  omitProxy: false
  ssIdentifier: ssib000459500
  providerName: EBSCOhost
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnR3LahRBcIibix5EUfFNQPsUJs6rX8eZ3VmCGC8mkFuYnYcacAWzAdlTROMhYE5GiIQcDIJeRBAEQzRfs4_8hVU1s7MDySF6GWq7q-vR1dNVPdtdbRh3Yb5zNJepqTzlmZ6TcTOyY9eMXJlyrqKW4ngaee6hmF3w7i_yxYnaucqupdVOaybunniu5H-sCmVgVzwl-w-WLYlCAcBgX3iCheF5KhuzkDPfYTpEIKizwGehZCpkgUVVIVVJputYG2qmOcKhYkHIFEcc5TNfE47PlIcAEAmaBNSZEoTcJDoCKfvUSmvmK6zyXaKj8akaxB2aC0K2IEpFAJBRMMWUy4IGlmAri-TxsBZxBAsICFyWX4c5ipiJC_C1kThqJAk_VxYoBCQksFNMk9YAoAAaWfgWKQJ8AwICpsudzESmgTqhRBbTNjYC0XQ4RtEoNNYoVAbERWmabJzEsuCo1UgLqzCB0mOUvCAgm3ij_m5Av1a_uTh2uXsvf0uIdJ0U9lBbnywHzHwys192a15S0s4BSUCD-WK60mECx0s-OgJJxpRoyVw21UTrIUVZUMTRoUZyiJIidbxGUk79uJTTmHArvxytcHf4PYnrwt0V_jDP1TB6762qd1P5GfIiUoLIVJzohXFaJzccP32GKfEde4Z2UMpx0FFuBV1eWV6Ou92XHUTDP5vkGWPSARdt1YxJvzH34FF19aF5JZskoMM8Uz3GDdF0ZTUNSxVXjo9dO5j0oZJtDq9OAO9Tujf46SprXM9taC3p3uSyn4q8ZajgvePq0cG_dha1H1di1PkLxvlicTnl5zPFRWOi--SSMdv7tNs72B9sfu992x3sHBxt7Qz_rPc2vg4-vhnsHw4O3g4Pd_ubn3vbX4Z760fr7wYbP_trr_rb-8PXv_t7a0fvt_sffvV_bF02FprhfH3WLO5PMVfw9m4zzaxUSglLImEnKrasWDuZl8U6kkmmE1waOSJRLc9K0yziMvNsKVInbgkrEtxL3StGrf28nV41pmSagmNPoyzhmZekduQ4ia1ES0rs9kRdM-4Umi8V8-PK0nHLXj8V1g3j7Pidu2nUOi9W01sQ-Xdat4sR8Rcr8cHD
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=%E5%A2%9E%E5%BC%BA%E7%8E%B0%E5%AE%9E%E7%9C%BC%E9%95%9C%E8%BE%85%E5%8A%A9%E7%9A%84%E7%BA%BF%E7%BC%86%E8%BF%9E%E6%8E%A5%E5%99%A8%E8%A3%85%E9%85%8D%E7%8A%B6%E6%80%81%E6%99%BA%E8%83%BD%E6%A3%80%E9%94%99%E6%96%B9%E6%B3%95&rft.jtitle=%E8%AE%A1%E7%AE%97%E6%9C%BA%E9%9B%86%E6%88%90%E5%88%B6%E9%80%A0%E7%B3%BB%E7%BB%9F&rft.au=%E6%9D%8E%E6%A0%91%E9%A3%9E&rft.au=%E9%83%91%E8%81%94%E8%AF%AD&rft.au=%E5%88%98%E6%96%B0%E7%8E%89&rft.au=%E7%8E%8B%E5%A4%A9%E7%9D%BF&rft.date=2021-10-01&rft.pub=%E5%8C%97%E4%BA%AC%E8%88%AA%E7%A9%BA%E8%88%AA%E5%A4%A9%E5%A4%A7%E5%AD%A6+%E6%9C%BA%E6%A2%B0%E5%B7%A5%E7%A8%8B%E5%8F%8A%E8%87%AA%E5%8A%A8%E5%8C%96%E5%AD%A6%E9%99%A2%2C%E5%8C%97%E4%BA%AC+100191&rft.issn=1006-5911&rft.volume=27&rft.issue=10&rft.spage=2822&rft.epage=2836&rft_id=info:doi/10.13196%2Fj.cims.2021.10.007&rft.externalDocID=jsjjczzxt202110007
thumbnail_s http://utb.summon.serialssolutions.com/2.0.0/image/custom?url=http%3A%2F%2Fwww.wanfangdata.com.cn%2Fimages%2FPeriodicalImages%2Fjsjjczzxt%2Fjsjjczzxt.jpg