Optimization of the Neural Network Structure of the Bilevel Multi-Objective Generalized Quantum PSO Algorithm for Image Recognition

With the development of deep learning, the traditional approach of manually designing network archi-tectures and determining parameters inevitably loses its reliance on expert systems, which has brought significant challenges to our parameter configuration. To address this issue, we adopted an autom...

Full description

Saved in:
Bibliographic Details
Published inChinese Control Conference pp. 8541 - 8546
Main Authors Xu, Wenxue, Zhu, Qidan, Mou, Jinyou
Format Conference Proceeding
LanguageEnglish
Published Technical Committee on Control Theory, Chinese Association of Automation 28.07.2025
Subjects
Online AccessGet full text
ISSN1934-1768
DOI10.23919/CCC64809.2025.11179020

Cover

Abstract With the development of deep learning, the traditional approach of manually designing network archi-tectures and determining parameters inevitably loses its reliance on expert systems, which has brought significant challenges to our parameter configuration. To address this issue, we adopted an automated search architecture, reducing manpower while enhancing efficiency. Based on this, this paper proposes the Multi-Objective Generalized Quantum Particle Swarm Optimization (MOGQPSO) algorithm, which combines quantum behavior and Gaussian distribution characteristics, introducing a brand-new mode for the movement and update of particles in the search space. Simultaneously, a bilevel optimization algorithm is designed. A particle encoding scheme is utilized to effectively represent the CNN architecture to assist in optimization. Through multiple iterations of MOGQPSO, the optimal solutions for the upper and lower levels are sought. Superior upper-level solutions are selected for lower-level optimization, and the optimized parameters of the lower level are fed back to the upper level. The upper and lower levels cooperate and iterate continuously. Moreover, combined with the decoding method in NSGA-Net, the entire CNN architecture is jointly designed. Experimental results demonstrate that the multi-objective optimal solution set obtained by this algorithm has been significantly improved compared to traditional algorithms, achieving a reduction of nearly one million parameters while enhancing accuracy.
AbstractList With the development of deep learning, the traditional approach of manually designing network archi-tectures and determining parameters inevitably loses its reliance on expert systems, which has brought significant challenges to our parameter configuration. To address this issue, we adopted an automated search architecture, reducing manpower while enhancing efficiency. Based on this, this paper proposes the Multi-Objective Generalized Quantum Particle Swarm Optimization (MOGQPSO) algorithm, which combines quantum behavior and Gaussian distribution characteristics, introducing a brand-new mode for the movement and update of particles in the search space. Simultaneously, a bilevel optimization algorithm is designed. A particle encoding scheme is utilized to effectively represent the CNN architecture to assist in optimization. Through multiple iterations of MOGQPSO, the optimal solutions for the upper and lower levels are sought. Superior upper-level solutions are selected for lower-level optimization, and the optimized parameters of the lower level are fed back to the upper level. The upper and lower levels cooperate and iterate continuously. Moreover, combined with the decoding method in NSGA-Net, the entire CNN architecture is jointly designed. Experimental results demonstrate that the multi-objective optimal solution set obtained by this algorithm has been significantly improved compared to traditional algorithms, achieving a reduction of nearly one million parameters while enhancing accuracy.
Author Xu, Wenxue
Zhu, Qidan
Mou, Jinyou
Author_xml – sequence: 1
  givenname: Wenxue
  surname: Xu
  fullname: Xu, Wenxue
  email: zhuqidan@hrbeu.edu.cn
  organization: College of Intelligent Systems Science and Engineering, Harbin Engineering University,Harbin,China,150001
– sequence: 2
  givenname: Qidan
  surname: Zhu
  fullname: Zhu, Qidan
  organization: College of Intelligent Systems Science and Engineering, Harbin Engineering University,Harbin,China,150001
– sequence: 3
  givenname: Jinyou
  surname: Mou
  fullname: Mou, Jinyou
  organization: College of Intelligent Systems Science and Engineering, Harbin Engineering University,Harbin,China,150001
BookMark eNqFj8tOwzAQRQ0CiQb4AyTmBxLspHl4CRGvBQQo-8qESTrFsSvHLqJbfpwi0TWrszi6OroROzDWIGPngidpJoW8qOu6mFZcJilP80QIUUqe8j0Wyaoq80oUIt9nEyGzaSzKojpi0TguOS-4FNmEfTcrTwNtlCdrwHbgFwiPGJzSW_hP6z5g5l1ofXC481ekcY0aHoL2FDdvS2w9rRFu0eB2SBt8h-egjA8DPM0auNS9deQXA3TWwf2geoQXbG1v6Dd7wg47pUc8_eMxO7u5fq3vYkLE-crRoNzXfPcs-0f_ANjhVgQ
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.23919/CCC64809.2025.11179020
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 9887581615
9789887581611
EISSN 1934-1768
EndPage 8546
ExternalDocumentID 11179020
Genre orig-research
GroupedDBID 29B
6IE
6IF
6IK
6IL
6IN
AAJGR
AAWTH
ABLEC
ACGFS
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
OCL
RIE
RIL
ID FETCH-ieee_primary_111790203
IEDL.DBID RIE
IngestDate Wed Oct 15 14:21:29 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-ieee_primary_111790203
ParticipantIDs ieee_primary_11179020
PublicationCentury 2000
PublicationDate 2025-July-28
PublicationDateYYYYMMDD 2025-07-28
PublicationDate_xml – month: 07
  year: 2025
  text: 2025-July-28
  day: 28
PublicationDecade 2020
PublicationTitle Chinese Control Conference
PublicationTitleAbbrev CCC
PublicationYear 2025
Publisher Technical Committee on Control Theory, Chinese Association of Automation
Publisher_xml – name: Technical Committee on Control Theory, Chinese Association of Automation
SSID ssj0060913
Score 4.6025224
Snippet With the development of deep learning, the traditional approach of manually designing network archi-tectures and determining parameters inevitably loses its...
SourceID ieee
SourceType Publisher
StartPage 8541
SubjectTerms Accuracy
Bilevel optimization problem
Computational complexity
Computer architecture
Gaussian distribution
Image classification
Model compression
multi-objective optimization
Neural architecture search
Neural networks
Optimization
Particle swarm optimization
Quantum computation
Quantum computing
Title Optimization of the Neural Network Structure of the Bilevel Multi-Objective Generalized Quantum PSO Algorithm for Image Recognition
URI https://ieeexplore.ieee.org/document/11179020
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8JAEJ4IJ734wvhAMwevLfTBtj1qI0EPgKIJN8K2gyK0NYR64Oofd3ZLfUUTT9206baTSb5vMp3vK8C5FdmBYB43bGkHqlsVGYF0Y4Mk8-Ek8Cgaa7fPrug8uDfD1nAtVtdaGCLSw2dkqqX-lh9nUa5aZQ1L-ZdxfVOBiueLQqxVwq5QBpfFAJftBFbQCMNQuH5TiVHsllne-u0nKppD2tvQLZ9ejI7MzHwpzWj1w5jx36-3A7VPuR72P4hoFzYo3YOtL06D-_DWY2hI1ppLzCbIdR8qY47xnA96EhwH2ko2X1B5_ZIR45XmqEW6Rk8-F-CIa6vq6YpivM05NXmC_UEPL-aP2WK6fEqQK2G8Thiq8K4cUMrSGtTbV_dhx1AxjV4Km4tRGY5zANU0S-kQ0JNC-E0Rc5HruczsDI4e-WLsRC1LxA4dQe3XLY7_OH8Cmyo7qldq-3Wocpx0yiS_lGc6ue8FNqxn
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8JAEJ4oHtSLL4wP1D14baGvbXvURgI-AAUTboRtB0Vpawj1wNU_7uyW-oomnrpp020nk3zfZDrfV4BTIzR9TjyumcL0Zbcq1HxhRxoK4sOR72I4VG6fLd64ty_7Tn8hVldaGERUw2eoy6X6lh-lYSZbZVVD-pdRfbMMK45t204u1yqAl0uLy3yEy7R8w68GQcBtryblKKajFzd_-42KYpH6BrSK5-fDI896NhN6OP9hzfjvF9yE8qdgj3U-qGgLljDZhvUvXoM78NYmcIgXqkuWjhhVfkxacwwndFCz4KyrzGSzKRbXzwkzXnHClExXa4unHB7Zwqx6PMeI3WaUnCxmnW6bnU0e0ul49hgzqoVZMyawYnfFiFKalKFSv-gFDU3GNHjJjS4GRTjWLpSSNME9YK7g3KvxiMpc1yZuJ3h00eNDK3QMHlm4D-Vftzj44_wJrDZ6N9eD62br6hDWZKZk59T0KlCimPGIKH8mjlWi3wE0Ca-0
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Chinese+Control+Conference&rft.atitle=Optimization+of+the+Neural+Network+Structure+of+the+Bilevel+Multi-Objective+Generalized+Quantum+PSO+Algorithm+for+Image+Recognition&rft.au=Xu%2C+Wenxue&rft.au=Zhu%2C+Qidan&rft.au=Mou%2C+Jinyou&rft.date=2025-07-28&rft.pub=Technical+Committee+on+Control+Theory%2C+Chinese+Association+of+Automation&rft.eissn=1934-1768&rft.spage=8541&rft.epage=8546&rft_id=info:doi/10.23919%2FCCC64809.2025.11179020&rft.externalDocID=11179020