PyNeval: A Python Toolbox for Evaluating Neuron Reconstruction Performance

Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The lack of user-friendly software for calculating common metrics motivated us to develop a Python toolbox called PyNeval, which is the first open-...

Full description

Saved in:
Bibliographic Details
Published inFrontiers in neuroinformatics Vol. 15; p. 767936
Main Authors Zhang, Han, Liu, Chao, Yu, Yifei, Dai, Jianhua, Zhao, Ting, Zheng, Nenggan
Format Journal Article
LanguageEnglish
Published Switzerland Frontiers Research Foundation 28.01.2022
Frontiers Media S.A
Subjects
Online AccessGet full text
ISSN1662-5196
1662-5196
DOI10.3389/fninf.2021.767936

Cover

Abstract Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The lack of user-friendly software for calculating common metrics motivated us to develop a Python toolbox called PyNeval, which is the first open-source toolbox designed to evaluate reconstruction results conveniently as far as we know. The toolbox supports popular metrics in two major categories, geometrical metrics and topological metrics, with an easy way to configure custom parameters for each metric. We tested the toolbox on both synthetic data and real data to show its reliability and robustness. As a demonstration of the toolbox in real applications, we used the toolbox to improve the performance of a tracing algorithm successfully by integrating it into an optimization procedure.
AbstractList Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The lack of user-friendly software for calculating common metrics motivated us to develop a Python toolbox called PyNeval, which is the first open-source toolbox designed to evaluate reconstruction results conveniently as far as we know. The toolbox supports popular metrics in two major categories, geometrical metrics and topological metrics, with an easy way to configure custom parameters for each metric. We tested the toolbox on both synthetic data and real data to show its reliability and robustness. As a demonstration of the toolbox in real applications, we used the toolbox to improve the performance of a tracing algorithm successfully by integrating it into an optimization procedure.
Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The lack of a user-friendly software of calculating common metrics motivated us to develop a Python toolbox called PyNeval, which is the first open-source toolbox designed to evaluate reconstruction results conveniently as far as we know. The toolbox supports popular metrics in two major categories, geometrical metrics and topological metrics, with an easy way to configure custom parameters for each metric. We tested the toolbox on both synthetic data and real data to show its reliability and robustness. As a demonstration of the toolbox in real applications, we used the toolbox to improve the performance of a tracing algorithm successfully by integrating it into an optimization procedure.
Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The lack of user-friendly software for calculating common metrics motivated us to develop a Python toolbox called PyNeval, which is the first open-source toolbox designed to evaluate reconstruction results conveniently as far as we know. The toolbox supports popular metrics in two major categories, geometrical metrics and topological metrics, with an easy way to configure custom parameters for each metric. We tested the toolbox on both synthetic data and real data to show its reliability and robustness. As a demonstration of the toolbox in real applications, we used the toolbox to improve the performance of a tracing algorithm successfully by integrating it into an optimization procedure.Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The lack of user-friendly software for calculating common metrics motivated us to develop a Python toolbox called PyNeval, which is the first open-source toolbox designed to evaluate reconstruction results conveniently as far as we know. The toolbox supports popular metrics in two major categories, geometrical metrics and topological metrics, with an easy way to configure custom parameters for each metric. We tested the toolbox on both synthetic data and real data to show its reliability and robustness. As a demonstration of the toolbox in real applications, we used the toolbox to improve the performance of a tracing algorithm successfully by integrating it into an optimization procedure.
Author Zhang, Han
Zheng, Nenggan
Liu, Chao
Yu, Yifei
Zhao, Ting
Dai, Jianhua
AuthorAffiliation 3 Zhejiang Lab , Hangzhou , China
2 College of Computer Science and Technology, Zhejiang University , Hangzhou , China
4 Collaborative Innovation Center for Artificial Intelligence by MOE and Zhejiang Provincial Government (ZJU) , Hangzhou , China
1 Qiushiq Academy for Advanced Studies (QAAS), Zhejiang University , Hangzhou , China
5 Howard Hughes Medical Institute, Janelia Research Campus , Ashburn, VA , United States
AuthorAffiliation_xml – name: 3 Zhejiang Lab , Hangzhou , China
– name: 1 Qiushiq Academy for Advanced Studies (QAAS), Zhejiang University , Hangzhou , China
– name: 4 Collaborative Innovation Center for Artificial Intelligence by MOE and Zhejiang Provincial Government (ZJU) , Hangzhou , China
– name: 2 College of Computer Science and Technology, Zhejiang University , Hangzhou , China
– name: 5 Howard Hughes Medical Institute, Janelia Research Campus , Ashburn, VA , United States
Author_xml – sequence: 1
  givenname: Han
  surname: Zhang
  fullname: Zhang, Han
– sequence: 2
  givenname: Chao
  surname: Liu
  fullname: Liu, Chao
– sequence: 3
  givenname: Yifei
  surname: Yu
  fullname: Yu, Yifei
– sequence: 4
  givenname: Jianhua
  surname: Dai
  fullname: Dai, Jianhua
– sequence: 5
  givenname: Ting
  surname: Zhao
  fullname: Zhao, Ting
– sequence: 6
  givenname: Nenggan
  surname: Zheng
  fullname: Zheng, Nenggan
BackLink https://www.ncbi.nlm.nih.gov/pubmed/35153709$$D View this record in MEDLINE/PubMed
BookMark eNqNkU1vVCEUhompsR_6A9yYm7hxMyMfF7i4MGmaqjVNnZi6JsAcpnfCwAj3Vuffy_TWpnXligPvc14OL8foIKYICL0meM5Yp9772Ec_p5iSuRRSMfEMHREh6IwTJQ4e1YfouJQ1xoIKLl-gQ8YJZxKrI_R1sbuCWxM-NKfNYjfcpNhcpxRs-t34lJvzKo1m6OOquYIxV_U7uBTLkEc39HW7gFy5jYkOXqLn3oQCr-7XE_Tj0_n12ZfZ5bfPF2enlzPXtnyYdcJT2mFsCfeCEA7OGoYFB9VZQ71ytlYtlVUTgjvnba1haSRznknh2Qm6mHyXyaz1Nvcbk3c6mV7fHaS80iYPvQugrbVLZ1W9EZvWcmE8NZwAk050bQt7Lzp5jXFrdr9MCA-GBOt9yPouZL0PWU8h16aPU9N2tBtYOohDNuHJJE-V2N_oVbrVXccIo7wavLs3yOnnCGXQm744CMFESGPRVNBOyJZiVdG3_6DrNOZY891TrFVMtbhSbx5P9DDK33-uAJkAl1MpGfx_PPMPLlm8bg
Cites_doi 10.1523/ENEURO.0049-14.2014
10.1007/978-94-015-7744-1_2
10.1016/j.tcs.2004.12.030
10.3389/fnins.2012.00049
10.1109/MCSE.2011.37
10.1007/s12021-011-9117-y
10.1007/s12021-011-9104-3
10.1007/s12021-016-9310-0
10.1038/ncomms12142
10.1016/S0165-0270(98)00091-0
10.1186/1471-2105-13-S8-S7
10.1109/MCSE.2007.58
10.1016/j.neuron.2015.06.036
10.1007/s12021-011-9110-5
10.1016/j.neuron.2013.03.008
10.1038/nbt.1612
10.1007/s12021-011-9120-3
10.1007/s12021-010-9090-x
ContentType Journal Article
Copyright Copyright © 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng.
2022. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright © 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng. 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng
Copyright_xml – notice: Copyright © 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng.
– notice: 2022. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: Copyright © 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng. 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng
DBID AAYXX
CITATION
NPM
3V.
7XB
88I
8FE
8FH
8FK
ABUWG
AFKRA
AZQEC
BBNVY
BENPR
BHPHI
CCPQU
DWQXO
GNUQQ
HCIFZ
LK8
M2P
M7P
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
Q9U
7X8
5PM
ADTOC
UNPAY
DOA
DOI 10.3389/fninf.2021.767936
DatabaseName CrossRef
PubMed
ProQuest Central (Corporate)
ProQuest Central (purchase pre-March 2016)
Science Database (Alumni Edition)
ProQuest SciTech Collection
ProQuest Natural Science Journals
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
ProQuest Central Essentials
Biological Science Collection
ProQuest Central
Natural Science Collection
ProQuest One Community College
ProQuest Central
ProQuest Central Student
SciTech Premium Collection (Proquest)
Biological Sciences
Science Database
Biological Science Database
ProQuest Central Premium
ProQuest One Academic
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
ProQuest Central Basic
MEDLINE - Academic
PubMed Central (Full Participant titles)
Unpaywall for CDI: Periodical Content
Unpaywall
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
PubMed
Publicly Available Content Database
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Natural Science Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
Natural Science Collection
ProQuest Central Korea
Biological Science Collection
ProQuest Central (New)
ProQuest Science Journals (Alumni Edition)
ProQuest Biological Science Collection
ProQuest Central Basic
ProQuest Science Journals
ProQuest One Academic Eastern Edition
Biological Science Database
ProQuest SciTech Collection
ProQuest One Academic UKI Edition
ProQuest One Academic
ProQuest One Academic (New)
ProQuest Central (Alumni)
MEDLINE - Academic
DatabaseTitleList
PubMed

Publicly Available Content Database
CrossRef
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 3
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
– sequence: 4
  dbid: BENPR
  name: PROQUEST
  url: http://www.proquest.com/pqcentral?accountid=15518
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Anatomy & Physiology
EISSN 1662-5196
ExternalDocumentID oai_doaj_org_article_bbbdcb96f20a4b56af2a51e37c6844ef
10.3389/fninf.2021.767936
PMC8831325
35153709
10_3389_fninf_2021_767936
Genre Journal Article
GrantInformation_xml – fundername: ;
GroupedDBID ---
29H
2WC
53G
5GY
5VS
8FE
8FH
9T4
AAFWJ
AAKPC
AAYXX
ABUWG
ACGFO
ACGFS
ADBBV
ADRAZ
AEGXH
AENEX
AFKRA
AFPKN
AIAGR
ALMA_UNASSIGNED_HOLDINGS
AOIJS
ARCSS
AZQEC
BAWUL
BBNVY
BCNDV
BENPR
BHPHI
BPHCQ
CITATION
CS3
DIK
E3Z
F5P
GROUPED_DOAJ
GX1
HCIFZ
HYE
KQ8
LK8
M2P
M48
M7P
M~E
O5R
O5S
OK1
OVT
PGMZT
PIMPY
PQQKQ
PROAC
RNS
RPM
TR2
88I
ACXDI
C1A
CCPQU
DWQXO
GNUQQ
IAO
IEA
IHR
IPNFZ
ISR
NPM
RIG
3V.
7XB
8FK
PHGZM
PHGZT
PKEHL
PQEST
PQGLB
PQUKI
PRINS
Q9U
7X8
PUEGO
5PM
ADTOC
UNPAY
ID FETCH-LOGICAL-c445t-86f22800b15f6115ecba3065e98ba2f9cbe98427611665ccfb276eda73cf376f3
IEDL.DBID UNPAY
ISSN 1662-5196
IngestDate Fri Oct 03 12:51:09 EDT 2025
Sun Oct 26 03:47:50 EDT 2025
Thu Aug 21 13:51:09 EDT 2025
Fri Sep 05 09:23:21 EDT 2025
Mon Jun 30 09:51:21 EDT 2025
Thu Jan 02 22:54:59 EST 2025
Wed Oct 01 01:58:07 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords toolbox
neuron tracing
quantitative analysis
metric
PyNeval
neuron reconstruction
Language English
License Copyright © 2022 Zhang, Liu, Yu, Dai, Zhao and Zheng.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
cc-by
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c445t-86f22800b15f6115ecba3065e98ba2f9cbe98427611665ccfb276eda73cf376f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
Edited by: Andrew P. Davison, UMR9197 Institut des Neurosciences Paris Saclay (Neuro-PSI), France
Reviewed by: Hua Han, Institute of Automation, Chinese Academy of Sciences (CAS), China; John McAllister, Queen's University Belfast, United Kingdom
OpenAccessLink https://proxy.k.utb.cz/login?url=https://doi.org/10.3389/fninf.2021.767936
PMID 35153709
PQID 2623493940
PQPubID 4424404
ParticipantIDs doaj_primary_oai_doaj_org_article_bbbdcb96f20a4b56af2a51e37c6844ef
unpaywall_primary_10_3389_fninf_2021_767936
pubmedcentral_primary_oai_pubmedcentral_nih_gov_8831325
proquest_miscellaneous_2628674209
proquest_journals_2623493940
pubmed_primary_35153709
crossref_primary_10_3389_fninf_2021_767936
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2022-01-28
PublicationDateYYYYMMDD 2022-01-28
PublicationDate_xml – month: 01
  year: 2022
  text: 2022-01-28
  day: 28
PublicationDecade 2020
PublicationPlace Switzerland
PublicationPlace_xml – name: Switzerland
– name: Lausanne
PublicationTitle Frontiers in neuroinformatics
PublicationTitleAlternate Front Neuroinform
PublicationYear 2022
Publisher Frontiers Research Foundation
Frontiers Media S.A
Publisher_xml – name: Frontiers Research Foundation
– name: Frontiers Media S.A
References Peng (B15) 2011; 9
B10
Mayerich (B11) 2012; 13
Cannon (B4) 1998; 84
Gillette (B7); 9
B17
Gong (B8) 2016; 7
Oliphant (B12) 2007; 9
Acciai (B1) 2016; 14
Peng (B14) 2015; 87
Bille (B3) 2005; 337
Parekh (B13) 2013; 77
Halavi (B9) 2012; 6
B2
Wang (B20) 2011; 9
Zhao (B21) 2011; 9
Feng (B5) 2015; 2
Peng (B16) 2010; 28
Van Der Walt (B18) 2011; 13
Gillette (B6); 9
Van Laarhoven (B19) 1987
References_xml – volume: 2
  start-page: ENEURO.0049-14.2014
  year: 2015
  ident: B5
  article-title: neutube 1.0: a new design for efficient neuron reconstruction software based on the swc format
  publication-title: eNeuro
  doi: 10.1523/ENEURO.0049-14.2014
– start-page: 7
  volume-title: Simulated annealing: Theory and applications
  year: 1987
  ident: B19
  article-title: Simulated annealing
  doi: 10.1007/978-94-015-7744-1_2
– volume: 337
  start-page: 217
  year: 2005
  ident: B3
  article-title: A survey on tree edit distance and related problems
  publication-title: Theor. Comput. Sci
  doi: 10.1016/j.tcs.2004.12.030
– volume: 6
  start-page: 49
  year: 2012
  ident: B9
  article-title: Digital reconstructions of neuronal morphology: three decades of research trends
  publication-title: Front. Neurosci
  doi: 10.3389/fnins.2012.00049
– volume: 13
  start-page: 22
  year: 2011
  ident: B18
  article-title: The numpy array: a structure for efficient numerical computation
  publication-title: Comput. Sci. Eng
  doi: 10.1109/MCSE.2011.37
– volume: 9
  start-page: 233
  ident: B6
  article-title: The diadem metric: comparing multiple reconstructions of the same neuron
  publication-title: Neuroinformatics
  doi: 10.1007/s12021-011-9117-y
– volume: 9
  start-page: 303
  ident: B7
  article-title: Diademchallenge. org: a compendium of resources fostering the continuous development of automated neuronal reconstruction
  publication-title: Neuroinformatics
  doi: 10.1007/s12021-011-9104-3
– ident: B10
– volume: 14
  start-page: 353
  year: 2016
  ident: B1
  article-title: Automated neuron tracing methods: an updated account
  publication-title: Neuroinformatics
  doi: 10.1007/s12021-016-9310-0
– volume: 7
  start-page: 12142
  year: 2016
  ident: B8
  article-title: High-throughput dual-colour precision imaging for brain-wide connectome with cytoarchitectonic landmarks at the cellular level
  publication-title: Nat. Commun
  doi: 10.1038/ncomms12142
– ident: B2
– volume: 84
  start-page: 49
  year: 1998
  ident: B4
  article-title: An on-line archive of reconstructed hippocampal neurons
  publication-title: J. Neurosci Methods
  doi: 10.1016/S0165-0270(98)00091-0
– volume: 13
  start-page: S7
  year: 2012
  ident: B11
  article-title: Netmets: software for quantifying and visualizing errors in biological network segmentation
  publication-title: BMC Bioinformatics
  doi: 10.1186/1471-2105-13-S8-S7
– volume: 9
  start-page: 10
  year: 2007
  ident: B12
  article-title: Python for scientific computing
  publication-title: Comput. Sci. Eng
  doi: 10.1109/MCSE.2007.58
– volume: 87
  start-page: 252
  year: 2015
  ident: B14
  article-title: Bigneuron: large-scale 3d neuron reconstruction from optical microscopy images
  publication-title: Neuron
  doi: 10.1016/j.neuron.2015.06.036
– volume: 9
  start-page: 193
  year: 2011
  ident: B20
  article-title: A broadly applicable 3-d neuron tracing method based on open-curve snake
  publication-title: Neuroinformatics
  doi: 10.1007/s12021-011-9110-5
– volume: 77
  start-page: 1017
  year: 2013
  ident: B13
  article-title: Neuronal morphology goes digital: a research hub for cellular and system neuroscience
  publication-title: Neuron
  doi: 10.1016/j.neuron.2013.03.008
– ident: B17
– volume: 28
  start-page: 348
  year: 2010
  ident: B16
  article-title: V3d enables real-time 3d visualization and quantitative analysis of large-scale biological image data sets
  publication-title: Nat. Biotechnol
  doi: 10.1038/nbt.1612
– volume: 9
  start-page: 247
  year: 2011
  ident: B21
  article-title: Automated reconstruction of neuronal morphology based on local geometrical and global structural models
  publication-title: Neuroinformatics
  doi: 10.1007/s12021-011-9120-3
– volume: 9
  start-page: 103
  year: 2011
  ident: B15
  article-title: Proof-editing is the bottleneck of 3d neuron reconstruction: the problem and solutions
  publication-title: Neuroinformatics
  doi: 10.1007/s12021-010-9090-x
SSID ssj0062657
Score 2.2672143
Snippet Quality assessment of tree-like structures obtained from a neuron reconstruction algorithm is necessary for evaluating the performance of the algorithm. The...
SourceID doaj
unpaywall
pubmedcentral
proquest
pubmed
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
StartPage 767936
SubjectTerms Algorithms
Design
metric
neuron reconstruction
neuron tracing
Neuroscience
PyNeval
Quality control
quantitative analysis
Software
toolbox
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3NaxQxFA_Si15ErR-jVVIoHpSxs_mOt7W0lB7KHlroLSTZRIVtpmCL7n_ve5nZbReFXnob5oUh_F4-fm_y8nuE7MXAveXKtMFE2wo1N623grVzzpJO2gebapbvqTo-FycX8uJOqS_MCRvkgQfg9kMI8xisyqzzIkjlM_NykriOygiRMq6-nbGrYGpYg4GlSz2cYUIIZvdzAXdBMMgmX7SCEak2dqEq1v8_hvlvouTjm3Lll7_9YnFnFzp6Rp6O9JFOh24_J49SeUG2pwVC58sl_UhrQmf9U75NTmbLUxTz_kqndLZEjQB61veL0P-hwFTp4ajzXb7TqtBRKIait4KydHZ7p-AlOT86PDs4bsfSCW0UQl63BvBiwAXDRGYFpC_F4LFGfLImeJZtDPAkmAabUjLGHOA5zb3mMcOSk_krslX6kt4Qmnjk0evksU4xBGgeFdY6H6LE7_jYkE8rKN3VoJDhILJA3F3F3SHubsC9Id8Q7HVDFLeuL8DlbnS5u8_lDdlZucqNM-6XY8DjhMU67w3ZXZthruABiC-pv6ltjNKCdbYhrwfPrnvCgdhxjRa94fONrm5ays8fVY_bGNS_lA35vB4d9yPx9iGQeEeeMLyO0U1aZnbIFoyQ9B5I0nX4UOfDX9hUEzg
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: ProQuest Central
  dbid: BENPR
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwhV3daxQxEA_1-qAvRa0fq1UiiA_K2r0kmw9B5CpXSh-OQ1ro25Jks1U4s1dt0fvvncnu3nko-hZ2wpLMTCYzyeQ3hLz0jlvDpc6d9iYXsta5NYLlNWdBBWWdCSnLdyZPzsXpRXmxQ2bDWxhMqxxsYjLUdevxjPyQwT4tDNbx_rC8yrFqFN6uDiU0bF9aoX6fIMZukV2GyFgjsns0nc0_DbYZvPdSdXebEJqZwyaCGCFIZOO3SoKmyq3dKYH4_83z_DOB8vZNXNrVD7tY_LY7Hd8le71bSSedHtwjOyHeJ_uTCCH11xV9RVOiZzpB3yen89UMQb7f0QmdrxA7gJ617cK1Pyl4sHTa43_HS5qQOyLFEHUDNEvnm7cGD8j58fTs40nel1TIvRDlda5lg_g3hRuXjQRnMHhnsXZ8MNpZ1hjvoCWYApqUpfeNg3aoreK-AVPU8IdkFNsYHhMauOfeqmCxfjEEbhaR1wrrfIn_sT4jrwdWVssOOaOCiAP5XiW-V8j3quN7Ro6Q2euOCHqdPrTfLqt-DVXOudo7A1MorHCltA2z5Thw5aUWIjQZORhEVfUr8Xu10ZuMvFiTYQ3hxYiNob1JfbRUghUmI486ya5HwsHh4wopakvmW0PdpsQvnxNOt9aIi1lm5M1aO_7PiSf_nsRTcofhA4xinDN9QEYg-_AM3KJr97zX9V8seA-v
  priority: 102
  providerName: ProQuest
– databaseName: Scholars Portal Journals: Open Access
  dbid: M48
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3daxQxEA-1PuiLqPVja5UI0gdl616SzYcgckpLKVjuoQd9W5JcthXO7PULu_-9M9m9rYcH-hZ2Qsj-MtmZ2Ul-Q8g777g1XOrcaW9yIWc6t0awfMZZUEFZZ0I65XssD6fi6LQ83SDL7HkP4NXa0A7rSU0v53u3F-0X2PCfMeIEe_uxjiCGUI-N9pQEfZO7i4sc60ph_rUvsnGP3AfbZbC4w3cx5BnAm09coCMpISQDZezynutHXbFcieB_nVf69-HKBzdxYdtfdj7_w3IdPCaPepeTjjsdeUI2QnxKtsYRwu2fLd2l6RBo-ru-RY4m7TESgH-iYzppkVeAnjTN3DW3FLxbut9zg8czmlg9IsXw9Y6Elk7u7iE8I9OD_ZNvh3lfbiH3QpTXuZY1cuMUblTWEhzF4J3FuvLBaGdZbbyDlmAKZFKW3tcO2mFmFfc1fKZq_pxsxiaGl4QG7rm3KlisbQxBnUVWtsI6X-I41mfk_RLKatGxalQQjSDuVcK9QtyrDveMfEWwh45IiJ0eNJdnVb-_KufczDsDr1BY4Uppa2bLUeDKSy1EqDOys1yqaqlkFQPfTxisDZ-Rt4MY9hcmTWwMzU3qo6USrDAZedGt7DATDs4gVyhRK2u-MtVVSfxxnji8tUbOzDIjHwbt-DcS2_8xy1fkIcMbGsUoZ3qHbIIChNfgN127N0n1fwMi7hiA
  priority: 102
  providerName: Scholars Portal
Title PyNeval: A Python Toolbox for Evaluating Neuron Reconstruction Performance
URI https://www.ncbi.nlm.nih.gov/pubmed/35153709
https://www.proquest.com/docview/2623493940
https://www.proquest.com/docview/2628674209
https://pubmed.ncbi.nlm.nih.gov/PMC8831325
https://doi.org/10.3389/fninf.2021.767936
https://doaj.org/article/bbbdcb96f20a4b56af2a51e37c6844ef
UnpaywallVersion publishedVersion
Volume 15
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAFT
  databaseName: Open Access Digital Library
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: KQ8
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html
  providerName: Colorado Alliance of Research Libraries
– providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: DOA
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVBFR
  databaseName: Free Medical Journals
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: DIK
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: http://www.freemedicaljournals.com
  providerName: Flying Publisher
– providerCode: PRVFQY
  databaseName: GFMER Free Medical Journals
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: GX1
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: http://www.gfmer.ch/Medical_journals/Free_medical.php
  providerName: Geneva Foundation for Medical Education and Research
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: M~E
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVAQN
  databaseName: PubMed Central
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: RPM
  dateStart: 20070101
  isFulltext: true
  titleUrlDefault: https://www.ncbi.nlm.nih.gov/pmc/
  providerName: National Library of Medicine
– providerCode: PRVFZP
  databaseName: Scholars Portal Journals: Open Access
  customDbUrl:
  eissn: 1662-5196
  dateEnd: 20250131
  omitProxy: true
  ssIdentifier: ssj0062657
  issn: 1662-5196
  databaseCode: M48
  dateStart: 20110801
  isFulltext: true
  titleUrlDefault: http://journals.scholarsportal.info
  providerName: Scholars Portal
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3db9MwELegfYAXvsZHYFRGQjyAUhLH8QdvHeqYJlFVaJXKU2S7DiCKM2mtoPz13DlZt8Ik4MWyck5kn-_iO_v8O0KeO1sYXQiVWuV0ysVCpUZzli4K5qWXxmofo3wn4mjGj-flvAOLxrswl87vwXnSr-sAjAY3juVDKUCWxHXSFyWY3T3Sn02mo4_oUAkBDhWIUntqefV7O-tOhOe_yqb8MzTyxjqcms13s1xeWncOb7cRW2cRrhDDTb4O1ys7dD9_A3P8pyHdIbc665OOWnG5S675cI_sjQJ43t829AWN8aBxo32PHE83E8QCf0NHdLpBiAF60jRL2_ygYOjScQcTHj7RCPARKHqyF3i0dHpxJeE-mR2OT94epV3mhdRxXq5SJWqEyclsXtYCbEbvrMEU814ra1itnYUaZxJoQpTO1RbqfmFk4Wr4Y9XFA9ILTfCPCPWFK5yR3mCaY_DvDAK0Zca6Er9jXEJens9LddoCbFTgmCCnqsipCjlVtZxKyAHO3LYhYmPHB8DfqlO1ylq7cFbDEDLDbSlMzUyZ-0I6oTj3dUL2z-e96hT2rGJgBnKNaeIT8mxLBlXD8xMTfLOObZSQnGU6IQ9bMdn2pAC7sJBIkTsCtNPVXUr48jnCeSuF8JllQl5tRe3vnHj8X62fkJsMr21kecrUPumBKPinYEyt7ID0D8aT6YdB3IyA8t08h_I9V4NOwX4BaAwgtg
linkProvider Unpaywall
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwEB6V9lAuCCiPlAJGAg6g0MRxnASpQlvYavtgtUJbqbdgO05B2iYLbVX2z_HbmHGSXVYgOPVmxZbljGfs-WzPNwDPjY5UFsnU16nJfCGL1FeZ4H4RcZvYROnMule-Qzk4Fgcn8ckK_OxiYehZZbcmuoW6qA2dkW9z3KdFRnm8302_-ZQ1im5XuxQaqk2tUOw4irE2sOPQzq4Qwp3v7H_A-X7B-V5__H7gt1kGfCNEfOGnsiRKmECHcSnRP7JGK0qnbrNUK15mRmNJcIT7oZSxMaXGsi1UEpkSrbOMsN8bsCZwdAj-1nb7w9Gnbi9AtBAnzV0qQsFsu6xQbRCU8vBNItEy5NJu6JIG_M3T_fPB5vplNVWzKzWZ_LYb7t2GW60by3qN3t2BFVvdhY1ehRD-bMZeMvew1J3Yb8DBaDYkUvG3rMdGM-IqYOO6nuj6B0OPmfVbvvHqlDmmkIoRJF4Q27LRIrbhHhxfi3Dvw2pVV_YhMBuZyKjEKsqXjEBREdNboLSJqR9lPHjViTKfNkwdOSIcknvu5J6T3PNG7h7skrDnDYlk232ov5_mrc3mWuvC6Ax_IVBCx1KVXMWhjRIjUyFs6cFWN1V5a_nn-UJPPXg2r0abpYsYVdn60rVJZSJ4kHnwoJnZ-UgidDCjhGqSpTlfGupyTfX1i-MFT1Pi4Yw9eD3Xjv9LYvPfP_EU1gfjj0f50f7w8BHc5BT8EYQ-T7dgFfXAPkaX7EI_afWewefrNrVf-GxMgw
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3db9MwED-NTQJeEDA-AhsYCXgAhaaO4ySTJtSxVvtAVYU2aW-Z7TgDqSSFbRr5F_mruHOSlgoET3uzYstyznf2_ezz7wBeGh2qNJSJrxOT-kLmia9Swf085Da2sdKpdVG-Y7l3LA5OopMV-Nm9haGwym5NdAt1Xhk6I-9x3KdFSnm8e0UbFjHZHb2fffMpgxTdtHbpNFSbZiHfdnRj7SOPQ1tfIZw7397fxbl_xfloePRhz28zDvhGiOjCT2RB9DCB7keFRF_JGq0otbpNE614kRqNJcER-veljIwpNJZtruLQFGipRYj93oA1uvzCRWJtZziefOr2BUQOUdzcqyIsTHtFiSqEAJX338USrUQu7YwugcDfvN4_gzdvXZYzVV-p6fS3nXF0F-60Li0bNDp4D1ZseR_WByXC-a81e81ckKk7vV-Hg0k9JoLxLTZgk5p4C9hRVU119YOh98yGLfd4ecYca0jJCB4vSG7ZZPHO4QEcX4twH8JqWZX2MTAbmtCo2CrKnYygURHrW6C0iagfZTx404kymzWsHRmiHZJ75uSekdyzRu4e7JCw5w2JcNt9qL6fZa39Zlrr3OgUfyFQQkdSFVxFfRvGRiZC2MKDjW6qsnYVOM8WOuvBi3k12i9dyqjSVpeuTSJjwYPUg0fNzM5HEqKzGcZUEy_N-dJQl2vKL58dR3iSECdn5MHbuXb8XxJP_v0Tz-Emmlz2cX98-BRuc3oHEvR9nmzAKqqB3UTv7EI_a9Wewel1W9ovL2dQsg
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Lb9QwELZge4ALr_IIFGQkxAGUJeu3uS2oVdXDag9dqZwi2-sUxOJU6q5g-fXMOOm2C5WAm5Vxong8E88Xj78h5FXw3FmuTOlNsKVQc1M6K1g55yzqqJ23MWf5TtThTBydyJOeLBrPwlzZvwfwZN81CRQNMI6NhlqBLambZEdJCLsHZGc2mY4_IaBSCgAVmFK3a3n9fVvrTqbnvy6m_DM18tYqnbn1d7dYXFl3Du52GVvnma4Q002-DldLPww_fyNz_Kch3SN3-uiTjjtzuU9uxPSA7I4TIO9va_qa5nzQ_KN9lxxN1xPkAn9Px3S6RooBety2C9_-oBDo0v2eJjyd0kzwkSgi2Us-Wjq9PJLwkMwO9o8_HpZ95YUyCCGXpVEN0uRUfiQbBTFjDN5hiflojXesscFDSzANMqVkCI2Hdpw7zUMDX6yGPyKD1Kb4hNDIAw9OR4dljgHfOSRoq5wPEp_jQkHeXMxLfdYRbNQATFBTddZUjZqqO00V5APO3KYjcmPnC6Dfune12ns_D97CEConvFSuYU6OItdBGSFiU5C9i3mve4c9rxmEgcJimfiCvNyIwdVw_8Sl2K5yH6O0YJUtyOPOTDZvwiEu5BolesuAtl51W5K-fM503sYgfaYsyNuNqf1dE0__q_czcpvhsY1qVDKzRwZgCvE5BFNL_6J3o19VMRxc
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=PyNeval%3A+A+Python+Toolbox+for+Evaluating+Neuron+Reconstruction+Performance&rft.jtitle=Frontiers+in+neuroinformatics&rft.au=Zhang%2C+Han&rft.au=Liu%2C+Chao&rft.au=Yu%2C+Yifei&rft.au=Dai%2C+Jianhua&rft.date=2022-01-28&rft.issn=1662-5196&rft.eissn=1662-5196&rft.volume=15&rft.spage=767936&rft_id=info:doi/10.3389%2Ffninf.2021.767936&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1662-5196&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1662-5196&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1662-5196&client=summon