A correlation study between automated program repair and test-suite metrics
Automated program repair is increasingly gaining traction, due to its potential to reduce debugging cost greatly. The feasibility of automated program repair has been shown in a number of works, and the research focus is gradually shifting toward the quality of generated patches. One promising direc...
Saved in:
| Published in | Empirical software engineering : an international journal Vol. 23; no. 5; pp. 2948 - 2979 |
|---|---|
| Main Authors | , , , , |
| Format | Journal Article |
| Language | English |
| Published |
New York
Springer US
01.10.2018
Springer Nature B.V |
| Subjects | |
| Online Access | Get full text |
| ISSN | 1382-3256 1573-7616 |
| DOI | 10.1007/s10664-017-9552-y |
Cover
| Abstract | Automated program repair is increasingly gaining traction, due to its potential to reduce debugging cost greatly. The feasibility of automated program repair has been shown in a number of works, and the research focus is gradually shifting toward the quality of generated patches. One promising direction is to control the quality of generated patches by controlling the quality of test-suites used for automated program repair. In this paper, we ask the following research question: “Can traditional test-suite metrics proposed for the purpose of software testing also be used for the purpose of automated program repair?” We empirically investigate whether traditional test-suite metrics such as statement/branch coverage and mutation score are effective in controlling the reliability of generated repairs (the likelihood that repairs cause regression errors). We conduct the largest-scale experiments of this kind to date with real-world software, and for the first time perform a correlation study between various test-suite metrics and the reliability of generated repairs. Our results show that in general, with the increase of traditional test suite metrics, the reliability of repairs tend to increase. In particular, such a trend is most strongly observed in statement coverage. Our results imply that the traditional test suite metrics proposed for software testing can also be used for automated program repair to improve the reliability of repairs. |
|---|---|
| AbstractList | Automated program repair is increasingly gaining traction, due to its potential to reduce debugging cost greatly. The feasibility of automated program repair has been shown in a number of works, and the research focus is gradually shifting toward the quality of generated patches. One promising direction is to control the quality of generated patches by controlling the quality of test-suites used for automated program repair. In this paper, we ask the following research question: “Can traditional test-suite metrics proposed for the purpose of software testing also be used for the purpose of automated program repair?” We empirically investigate whether traditional test-suite metrics such as statement/branch coverage and mutation score are effective in controlling the reliability of generated repairs (the likelihood that repairs cause regression errors). We conduct the largest-scale experiments of this kind to date with real-world software, and for the first time perform a correlation study between various test-suite metrics and the reliability of generated repairs. Our results show that in general, with the increase of traditional test suite metrics, the reliability of repairs tend to increase. In particular, such a trend is most strongly observed in statement coverage. Our results imply that the traditional test suite metrics proposed for software testing can also be used for automated program repair to improve the reliability of repairs. |
| Author | Böhme, Marcel Yi, Jooyong Tan, Shin Hwei Mechtaev, Sergey Roychoudhury, Abhik |
| Author_xml | – sequence: 1 givenname: Jooyong orcidid: 0000-0002-7215-0855 surname: Yi fullname: Yi, Jooyong email: j.yi@innopolis.ru organization: Institute of Technologies and Software Development, Innopolis University – sequence: 2 givenname: Shin Hwei surname: Tan fullname: Tan, Shin Hwei organization: School of Computing, National University of Singapore – sequence: 3 givenname: Sergey surname: Mechtaev fullname: Mechtaev, Sergey organization: School of Computing, National University of Singapore – sequence: 4 givenname: Marcel surname: Böhme fullname: Böhme, Marcel organization: School of Computing, National University of Singapore – sequence: 5 givenname: Abhik surname: Roychoudhury fullname: Roychoudhury, Abhik organization: School of Computing, National University of Singapore |
| BookMark | eNp9kE1LAzEURYNUsFZ_gLuA62iSyeeyFL-w4EbXITPzpkxpZ2qSQebfmzqCIOjqZXFP3n3nHM26vgOErhi9YZTq28ioUoJQpomVkpPxBM2Z1AXRiqlZfheGk4JLdYbOY9xSSq0Wco6el7jqQ4CdT23f4ZiGesQlpA-ADvsh9XufoMaH0G-C3-MAB98G7LsaJ4iJxKFNgPeQQlvFC3Ta-F2Ey--5QG_3d6-rR7J-eXhaLdekKpRNpIISRFlDZbUygpnGFLzxwpTKWK58wRojtbE1txyYtQ1AyaURVSFqm7NlsUDX07-51fuQa7htP4Qur3ScaqmyEKFySk-pKvQxBmhc1aavK1Pw7c4x6o7m3GTOZXPuaM6NmWS_yENo9z6M_zJ8YmLOdhsIP53-hj4BbPqD2A |
| CitedBy_id | crossref_primary_10_1145_3505247 crossref_primary_10_1145_3510418 crossref_primary_10_1145_3688834 crossref_primary_10_3390_electronics12102254 crossref_primary_10_1109_TDSC_2023_3308897 crossref_primary_10_1145_3511096 crossref_primary_10_1145_3680466 crossref_primary_10_1109_ACCESS_2021_3136138 crossref_primary_10_1007_s10664_018_9619_4 crossref_primary_10_1145_3360004 crossref_primary_10_1145_3447265 crossref_primary_10_1109_TSE_2022_3218264 |
| Cites_doi | 10.1109/TSE.2014.2312918 10.1109/TSE.2016.2560811 10.1098/rspl.1895.0041 10.1093/biomet/33.3.239 10.1109/TSE.2006.83 10.1007/s10664-005-3861-2 10.1109/TEVC.2010.2083669 10.1109/TSE.2010.62 10.1109/TSE.1976.233818 10.1016/j.jss.2013.10.042 10.1007/s11219-013-9208-0 10.1007/978-1-4757-5939-6_19 10.1109/ICSE.2012.6227211 10.1145/2884781.2884872 10.1007/978-3-642-14107-2_26 10.1109/ASE.2009.15 10.1109/ASE.2008.32 10.1145/1368088.1368222 10.1109/ICSE.2012.6227186 10.1145/2610384.2628058 10.1145/1831708.1831715 10.1145/2786805.2786811 10.1145/2568225.2568265 10.1109/ICSE.2013.6606623 10.1145/2786805.2786825 10.1145/2666356.2594337 10.1007/978-3-642-19835-9_15 10.1145/581396.581397 10.1109/ICST.2010.66 10.1145/2950290.2950295 10.1109/ICSE.2015.63 10.1109/ASE.2013.6693094 10.1145/2568225.2568254 10.1109/TSE.2011.104 10.1109/ICSM.2013.29 10.1145/1065010.1065036 10.1109/ASE.2015.60 10.1007/11537328_2 10.1145/2771783.2771791 10.1145/2884781.2884807 10.1007/11513988_23 10.1145/1134285.1134299 10.1109/ICSE.2013.6606626 10.1145/781131.781148 10.1109/ICSE.2013.6606576 10.1145/1993498.1993558 10.1145/2491411.2491430 10.1007/978-3-540-24721-0_20 10.1145/1629575.1629585 10.1109/ICST.2014.40 10.1109/ISSRE.2015.7381813 10.1145/1572272.1572280 10.1145/2837614.2837617 |
| ContentType | Journal Article |
| Copyright | Springer Science+Business Media, LLC 2017 Copyright Springer Science & Business Media 2018 |
| Copyright_xml | – notice: Springer Science+Business Media, LLC 2017 – notice: Copyright Springer Science & Business Media 2018 |
| DBID | AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D |
| DOI | 10.1007/s10664-017-9552-y |
| DatabaseName | CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Computer and Information Systems Abstracts |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1573-7616 |
| EndPage | 2979 |
| ExternalDocumentID | 10_1007_s10664_017_9552_y |
| GroupedDBID | -4Z -59 -5G -BR -EM -Y2 -~C .86 .DC .VR 06D 0R~ 0VY 199 1N0 1SB 2.D 203 28- 29G 2J2 2JN 2JY 2KG 2LR 2P1 2VQ 2~H 30V 4.4 406 408 409 40D 40E 5GY 5QI 5VS 67Z 6NX 78A 8FE 8FG 8TC 8UJ 95- 95. 95~ 96X AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANZL AAOBN AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYOK AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJCF ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACIWK ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACSNA ACZOJ ADHHG ADHIR ADIMF ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFIE AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFEXP AFGCZ AFKRA AFLOW AFQWF AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN B-. BA0 BBWZM BDATZ BENPR BGLVJ BGNMA BSONS CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 EBLON EBS EIOEI EJD ESBYG FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNWQR GQ6 GQ7 GQ8 GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X I~Z J-C J0Z JBSCW JCJTX JZLTJ KDC KOV KOW L6V LAK LLZTM M4Y M7S MA- N2Q NB0 NDZJH NPVJJ NQJWS NU0 O9- O93 O9G O9I O9J OAM P19 P62 P9O PF0 PT4 PT5 PTHSS Q2X QOK QOS R4E R89 R9I RHV RNI RNS ROL RPX RSV RZC RZE RZK S0W S16 S1Z S26 S27 S28 S3B SAP SCJ SCLPG SCO SDH SDM SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 T16 TSG TSK TSV TUC U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7S Z7V Z7X Z7Z Z81 Z83 Z86 Z88 Z8M Z8N Z8P Z8R Z8T Z8U Z8W Z92 ZMTXR ~EX AAPKM AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADHKG AEZWR AFDZB AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP ATHPR AYFIA CITATION PHGZM PHGZT PQGLB PUEGO 7SC 8FD JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c369t-cebe4bdec9768418f832fa48b68926a31f85789d292e199feeb2584c34d9f83b3 |
| IEDL.DBID | U2A |
| ISSN | 1382-3256 |
| IngestDate | Fri Jul 25 12:25:41 EDT 2025 Wed Oct 01 04:12:35 EDT 2025 Thu Apr 24 23:04:17 EDT 2025 Fri Feb 21 02:35:46 EST 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 5 |
| Keywords | Automated program repair Correlation Test suite Empirical evaluation |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c369t-cebe4bdec9768418f832fa48b68926a31f85789d292e199feeb2584c34d9f83b3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0002-7215-0855 |
| PQID | 2075610046 |
| PQPubID | 326341 |
| PageCount | 32 |
| ParticipantIDs | proquest_journals_2075610046 crossref_citationtrail_10_1007_s10664_017_9552_y crossref_primary_10_1007_s10664_017_9552_y springer_journals_10_1007_s10664_017_9552_y |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2018-10-01 |
| PublicationDateYYYYMMDD | 2018-10-01 |
| PublicationDate_xml | – month: 10 year: 2018 text: 2018-10-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York – name: Dordrecht |
| PublicationSubtitle | An International Journal |
| PublicationTitle | Empirical software engineering : an international journal |
| PublicationTitleAbbrev | Empir Software Eng |
| PublicationYear | 2018 |
| Publisher | Springer US Springer Nature B.V |
| Publisher_xml | – name: Springer US – name: Springer Nature B.V |
| References | Andrews, Briand, Labiche, Namin (CR1) 2006; 32 Pei, Furia, Nordio, Wei, Meyer, Zeller (CR41) 2014; 40 Xuan, Martinez, Demarco, Clement, Marcote, Durieux, Berre, Monperrus (CR56) 2017; 43 CR39 CR38 CR36 CR35 CR34 CR33 CR32 CR31 CR30 Kendall (CR22) 1945; 33 CR2 Pearson (CR40) 1895; 58 CR4 CR3 CR6 CR5 CR8 CR7 CR9 CR49 CR48 CR47 CR46 CR45 CR44 CR43 CR42 Debroy, Wong (CR12) 2014; 90 CR19 CR17 CR16 Miller, Spooner (CR37) 1976; 2 CR15 CR14 CR57 CR11 CR10 CR54 CR53 CR52 CR51 CR50 White, Arcuri, Clark (CR55) 2011; 15 Do, Elbaum, Rothermel (CR13) 2005; 10 Le Goues, Forrest, Weimer (CR28) 2013; 21 Jia, Harman (CR18) 2011; 37 CR29 CR27 CR26 CR25 CR24 CR23 CR21 CR20 9552_CR20 DR White (9552_CR55) 2011; 15 9552_CR21 9552_CR24 9552_CR23 9552_CR7 9552_CR26 9552_CR8 9552_CR25 9552_CR5 9552_CR6 9552_CR27 9552_CR29 9552_CR9 W Miller (9552_CR37) 1976; 2 H Do (9552_CR13) 2005; 10 9552_CR51 9552_CR50 9552_CR53 9552_CR52 9552_CR11 9552_CR10 9552_CR54 9552_CR57 9552_CR15 9552_CR14 9552_CR17 9552_CR16 Y Jia (9552_CR18) 2011; 37 9552_CR19 9552_CR3 9552_CR4 9552_CR2 MG Kendall (9552_CR22) 1945; 33 C Le Goues (9552_CR28) 2013; 21 9552_CR42 9552_CR44 JH Andrews (9552_CR1) 2006; 32 9552_CR43 9552_CR46 K Pearson (9552_CR40) 1895; 58 9552_CR45 9552_CR48 9552_CR47 9552_CR49 V Debroy (9552_CR12) 2014; 90 Y Pei (9552_CR41) 2014; 40 9552_CR31 9552_CR30 9552_CR33 9552_CR32 9552_CR35 J Xuan (9552_CR56) 2017; 43 9552_CR34 9552_CR36 9552_CR39 9552_CR38 |
| References_xml | – ident: CR45 – ident: CR49 – ident: CR4 – ident: CR39 – ident: CR16 – ident: CR51 – volume: 40 start-page: 427 issue: 5 year: 2014 end-page: 449 ident: CR41 article-title: Automated fixing of programs with contracts publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2014.2312918 – ident: CR35 – ident: CR29 – ident: CR54 – ident: CR8 – ident: CR25 – ident: CR42 – ident: CR21 – ident: CR46 – ident: CR19 – ident: CR15 – ident: CR50 – volume: 43 start-page: 34 issue: 1 year: 2017 end-page: 55 ident: CR56 article-title: Nopol: Automatic repair of conditional statement bugs in Java programs publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2016.2560811 – ident: CR11 – volume: 58 start-page: 240 year: 1895 end-page: 242 ident: CR40 article-title: Note on regression and inheritance in the case of two parents publication-title: Proc Royal Soc Lond doi: 10.1098/rspl.1895.0041 – ident: CR9 – ident: CR57 – ident: CR32 – ident: CR36 – ident: CR5 – volume: 33 start-page: 239 issue: 3 year: 1945 end-page: 251 ident: CR22 article-title: The treatment of ties in ranking problems publication-title: Biometrika doi: 10.1093/biomet/33.3.239 – ident: CR26 – ident: CR43 – volume: 32 start-page: 608 issue: 8 year: 2006 end-page: 624 ident: CR1 article-title: Using mutation analysis for assessing and comparing testing coverage criteria publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2006.83 – volume: 10 start-page: 405 issue: 4 year: 2005 end-page: 435 ident: CR13 article-title: Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact publication-title: Empir Softw Eng doi: 10.1007/s10664-005-3861-2 – ident: CR47 – volume: 15 start-page: 515 issue: 4 year: 2011 end-page: 538 ident: CR55 article-title: Evolutionary improvement of programs publication-title: IEEE Trans Evol Comput doi: 10.1109/TEVC.2010.2083669 – ident: CR14 – ident: CR2 – volume: 37 start-page: 649 issue: 5 year: 2011 end-page: 678 ident: CR18 article-title: An analysis and survey of the development of mutation testing publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2010.62 – ident: CR53 – ident: CR30 – ident: CR10 – ident: CR33 – ident: CR6 – volume: 2 start-page: 223 issue: 3 year: 1976 end-page: 226 ident: CR37 article-title: Automatic generation of floating-point test data publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.1976.233818 – ident: CR27 – ident: CR23 – volume: 90 start-page: 45 year: 2014 end-page: 60 ident: CR12 article-title: Combining mutation and fault localization for automated program debugging publication-title: J Syst Softw doi: 10.1016/j.jss.2013.10.042 – ident: CR44 – ident: CR48 – ident: CR3 – ident: CR38 – ident: CR52 – ident: CR17 – ident: CR31 – ident: CR34 – volume: 21 start-page: 421 issue: 3 year: 2013 end-page: 443 ident: CR28 article-title: Current challenges in automatic software repair publication-title: Softw Qual J doi: 10.1007/s11219-013-9208-0 – ident: CR7 – ident: CR24 – ident: CR20 – ident: 9552_CR34 doi: 10.1007/978-1-4757-5939-6_19 – ident: 9552_CR26 doi: 10.1109/ICSE.2012.6227211 – ident: 9552_CR31 doi: 10.1145/2884781.2884872 – volume: 90 start-page: 45 year: 2014 ident: 9552_CR12 publication-title: J Syst Softw doi: 10.1016/j.jss.2013.10.042 – ident: 9552_CR47 doi: 10.1007/978-3-642-14107-2_26 – volume: 15 start-page: 515 issue: 4 year: 2011 ident: 9552_CR55 publication-title: IEEE Trans Evol Comput doi: 10.1109/TEVC.2010.2083669 – ident: 9552_CR10 doi: 10.1109/ASE.2009.15 – volume: 10 start-page: 405 issue: 4 year: 2005 ident: 9552_CR13 publication-title: Empir Softw Eng doi: 10.1007/s10664-005-3861-2 – ident: 9552_CR49 doi: 10.1109/ASE.2008.32 – ident: 9552_CR14 doi: 10.1145/1368088.1368222 – ident: 9552_CR48 doi: 10.1109/ICSE.2012.6227186 – ident: 9552_CR5 doi: 10.1145/2610384.2628058 – ident: 9552_CR2 doi: 10.1145/1831708.1831715 – ident: 9552_CR52 – ident: 9552_CR30 doi: 10.1145/2786805.2786811 – ident: 9552_CR57 doi: 10.1145/2568225.2568265 – volume: 37 start-page: 649 issue: 5 year: 2011 ident: 9552_CR18 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2010.62 – ident: 9552_CR39 doi: 10.1109/ICSE.2013.6606623 – ident: 9552_CR25 – ident: 9552_CR51 doi: 10.1145/2786805.2786825 – ident: 9552_CR33 doi: 10.1145/2666356.2594337 – ident: 9552_CR16 doi: 10.1007/978-3-642-19835-9_15 – ident: 9552_CR20 doi: 10.1145/581396.581397 – ident: 9552_CR11 doi: 10.1109/ICST.2010.66 – ident: 9552_CR53 doi: 10.1145/2950290.2950295 – ident: 9552_CR35 doi: 10.1109/ICSE.2015.63 – ident: 9552_CR54 doi: 10.1109/ASE.2013.6693094 – ident: 9552_CR45 doi: 10.1145/2568225.2568254 – ident: 9552_CR27 doi: 10.1109/TSE.2011.104 – ident: 9552_CR44 doi: 10.1109/ICSM.2013.29 – volume: 33 start-page: 239 issue: 3 year: 1945 ident: 9552_CR22 publication-title: Biometrika doi: 10.1093/biomet/33.3.239 – volume: 21 start-page: 421 issue: 3 year: 2013 ident: 9552_CR28 publication-title: Softw Qual J doi: 10.1007/s11219-013-9208-0 – ident: 9552_CR15 doi: 10.1145/1065010.1065036 – volume: 2 start-page: 223 issue: 3 year: 1976 ident: 9552_CR37 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.1976.233818 – ident: 9552_CR21 doi: 10.1109/ASE.2015.60 – volume: 43 start-page: 34 issue: 1 year: 2017 ident: 9552_CR56 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2016.2560811 – ident: 9552_CR8 doi: 10.1007/11537328_2 – ident: 9552_CR50 – ident: 9552_CR46 doi: 10.1145/2771783.2771791 – ident: 9552_CR36 doi: 10.1145/2884781.2884807 – ident: 9552_CR19 doi: 10.1007/11513988_23 – ident: 9552_CR4 doi: 10.1145/1134285.1134299 – ident: 9552_CR23 doi: 10.1109/ICSE.2013.6606626 – volume: 40 start-page: 427 issue: 5 year: 2014 ident: 9552_CR41 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2014.2312918 – ident: 9552_CR29 doi: 10.1145/781131.781148 – volume: 58 start-page: 240 year: 1895 ident: 9552_CR40 publication-title: Proc Royal Soc Lond doi: 10.1098/rspl.1895.0041 – ident: 9552_CR6 doi: 10.1109/ICSE.2013.6606576 – ident: 9552_CR43 doi: 10.1145/1993498.1993558 – ident: 9552_CR7 doi: 10.1145/2491411.2491430 – ident: 9552_CR17 doi: 10.1007/978-3-540-24721-0_20 – ident: 9552_CR42 doi: 10.1145/1629575.1629585 – ident: 9552_CR3 doi: 10.1109/ICST.2014.40 – ident: 9552_CR24 doi: 10.1109/ISSRE.2015.7381813 – ident: 9552_CR38 doi: 10.1145/1572272.1572280 – ident: 9552_CR32 doi: 10.1145/2837614.2837617 – ident: 9552_CR9 – volume: 32 start-page: 608 issue: 8 year: 2006 ident: 9552_CR1 publication-title: IEEE Trans Softw Eng doi: 10.1109/TSE.2006.83 |
| SSID | ssj0009745 |
| Score | 2.3402236 |
| Snippet | Automated program repair is increasingly gaining traction, due to its potential to reduce debugging cost greatly. The feasibility of automated program repair... |
| SourceID | proquest crossref springer |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 2948 |
| SubjectTerms | Automation Compilers Computer Science Correlation analysis Debugging Interpreters Maintenance Patches (structures) Programming Languages Reliability Repair Software Engineering/Programming and Operating Systems Software testing |
| Title | A correlation study between automated program repair and test-suite metrics |
| URI | https://link.springer.com/article/10.1007/s10664-017-9552-y https://www.proquest.com/docview/2075610046 |
| Volume | 23 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVLSH databaseName: SpringerLink Journals customDbUrl: mediaType: online eissn: 1573-7616 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0009745 issn: 1382-3256 databaseCode: AFBBN dateStart: 19970301 isFulltext: true providerName: Library Specific Holdings – providerCode: PRVAVX databaseName: SpringerLINK - Czech Republic Consortium customDbUrl: eissn: 1573-7616 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0009745 issn: 1382-3256 databaseCode: AGYKE dateStart: 19970101 isFulltext: true titleUrlDefault: http://link.springer.com providerName: Springer Nature – providerCode: PRVAVX databaseName: SpringerLink Journals (ICM) customDbUrl: eissn: 1573-7616 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0009745 issn: 1382-3256 databaseCode: U2A dateStart: 19970101 isFulltext: true titleUrlDefault: http://www.springerlink.com/journals/ providerName: Springer Nature |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwED1Bu7DwjSiUygMTyFLjOG48RqilooKJSmWKHMeRkCBFTTr033NOHAIIkJjj3PDs873Tnd8BXIZGY_ZvFNV-gAkKZ4YqPeJUZYmxb2cSVqnt3z-I6ZzfLYKFe8ddNN3uTUmyuqk_PXYTwnZM2JJjwOhmG7qBVfPCQzxnUau0O6omE1ttPepjQG9KmT-Z-BqMWob5rShaxZrJPuw6kkiielcPYMvkh7DXDGAgzh-PYBYRbadr1P1spJKKJa7ziqh1uUQ6alLierDICkPP84qoPCVIMEtarJFvklc7U0sXxzCfjB9vptRNR0BYhSypRvh5khotbS3NCzP0zUzxMBGhZEL5XhaiN8qUSWY8KTODOTSyDe3zVOLaxD-BTr7MzSkQ9HomRh4aMpiNZTwZKumbTPNhqjLtBT0YNjDF2kmH2wkWL3EremyRjRHZ2CIbb3pw9fHLW62b8dfifoN97FyoiBmSGWH17EQPrpv9aD__auzsX6vPYQcpUK1w6_WhU67W5gJpRpkMoBvdPs3Gg-p4vQOf9cvl |
| linkProvider | Springer Nature |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT8JAEJ4oHPQiPiOKugdPmhK6XZbukRgQ5XGCBE_NdrtNjAoGygF_vbPtVpSoCeduN-3Mzs43mZlvAK59rTD619JRXh0DFEa1I1WDOTIOtemdCWnKtt8f8M6IPY7rY9vHPc-r3fOUZHpTf2t249xUTJiUY506y20oMoxPaAGKzfunbmvFtdtIZxMbdj3HQ5eeJzN_2-SnO1phzLW0aOpt2iUY5t-ZFZm8VBdJWFUfaxSOG_7IPuxZ9Ema2XE5gC09OYRSPtmBWEM_gm6TKDO2IyuUIykHLbElXUQukiniXB0RW9xFZujTnmdETiKCyDVx5gsEsuTNDOtS82MYtVvDu45jxy6gvrhIHIV6ZWGklTBJOteP0ehjyfyQ-4Jy6bmxj2YuIiqodoWINQbnCGOUxyKBa0PvBAqT6USfAsHrhPKGixtpDPNiFtak8HSsWC2SsXLrZajl0g-U5SQ3ozFegxWbshFWgMIKjLCCZRluvl55zwg5_ltcyVUaWNucBxRREjdEebwMt7mGVo__3Oxso9VXsNMZ9ntB72HQPYddxFkZja5bgUIyW-gLxDJJeGnP7ifmV-pL |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELWgSIiFb0ShgAcmkEXjOG48VkBVKFQMVOpmOY4tIUFaNenQf885cSggQGKOc8PZ53unO7-H0HlsNFT_RhEdRlCgMGqI0h1GlE2MezuT0JJt_3HI-yN2P47GXuc0r6fd65Zk9abBsTRlxdU0tVefHr5x7qYnXPsxomSxitaY40mAAz2i3SXrbqdUKXY8eySE5F63NX8y8TUxLdHmtwZpmXd622jTA0bcrXZ4B62YbBdt1WIM2MfmHhp0sXZKG9VsGy5pY7GfwsJqXkwAmpoU-3ksPIM09DLDKksxgM2C5HPAnvjN6WvpfB-NerfP133ilRLAxVwURMNWsCQ1Wri-WhBbiFOrWJzwWFCuwsDGEJkipYKaQAhroJ4G5KFDlgpYm4QHqJFNMnOIMNwAlHcCMGSgMrMsaSsRGqtZO1VWB1ETtWs3Se1pxJ2axatcEiA7z0rwrHSelYsmuvj4ZVpxaPy1uFX7XvpwyiUFYMMdtx1vost6P5affzV29K_VZ2j96aYnH-6Gg2O0AcioIr4NWqhRzObmBNBHkZyWJ-wd69LReQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+correlation+study+between+automated+program+repair+and+test-suite+metrics&rft.jtitle=Empirical+software+engineering+%3A+an+international+journal&rft.au=Yi%2C+Jooyong&rft.au=Tan%2C+Shin+Hwei&rft.au=Mechtaev%2C+Sergey&rft.au=B%C3%B6hme%2C+Marcel&rft.date=2018-10-01&rft.issn=1382-3256&rft.eissn=1573-7616&rft.volume=23&rft.issue=5&rft.spage=2948&rft.epage=2979&rft_id=info:doi/10.1007%2Fs10664-017-9552-y&rft.externalDBID=n%2Fa&rft.externalDocID=10_1007_s10664_017_9552_y |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1382-3256&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1382-3256&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1382-3256&client=summon |