The role of domain knowledge in document selection from search results
It is a frequently seen scenario that when people are not familiar with their search topics, they use a simple keyword search, which leads to a large amount of search results in multiple pages. This makes it difficult for users to pick relevant documents, especially given that they are not knowledge...
Saved in:
Published in | Journal of the American Society for Information Science and Technology Vol. 70; no. 11; pp. 1236 - 1247 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
Hoboken, USA
John Wiley & Sons, Inc
01.11.2019
Wiley Periodicals Inc |
Subjects | |
Online Access | Get full text |
ISSN | 2330-1635 2330-1643 |
DOI | 10.1002/asi.24199 |
Cover
Abstract | It is a frequently seen scenario that when people are not familiar with their search topics, they use a simple keyword search, which leads to a large amount of search results in multiple pages. This makes it difficult for users to pick relevant documents, especially given that they are not knowledgeable of the topics. To explore how systems can better help users find relevant documents from search results, the current research analyzed document selection behaviors of users with different levels of domain knowledge (DK). Data were collected in a laboratory study with 35 participants each searching on four tasks in the genomics domain. The results show that users with high and low DK levels selected different sets of documents to view; those high in DK read more documents and gave higher relevance ratings for the viewed documents than those low in DK did. Users with low DK tended to select documents ranking toward the top of the search result lists, and those with high in DK tended to also select documents ranking down the search result lists. The findings help design search systems that can personalize search results to users with different levels of DK. |
---|---|
AbstractList | It is a frequently seen scenario that when people are not familiar with their search topics, they use a simple keyword search, which leads to a large amount of search results in multiple pages. This makes it difficult for users to pick relevant documents, especially given that they are not knowledgeable of the topics. To explore how systems can better help users find relevant documents from search results, the current research analyzed document selection behaviors of users with different levels of domain knowledge (DK). Data were collected in a laboratory study with 35 participants each searching on four tasks in the genomics domain. The results show that users with high and low DK levels selected different sets of documents to view; those high in DK read more documents and gave higher relevance ratings for the viewed documents than those low in DK did. Users with low DK tended to select documents ranking toward the top of the search result lists, and those with high in DK tended to also select documents ranking down the search result lists. The findings help design search systems that can personalize search results to users with different levels of DK. |
Author | Liu, Jingjing Zhang, Xiangmin |
Author_xml | – sequence: 1 givenname: Jingjing surname: Liu fullname: Liu, Jingjing email: jingjing@sc.edu organization: University of South Carolina – sequence: 2 givenname: Xiangmin surname: Zhang fullname: Zhang, Xiangmin email: ae9101@wayne.edu organization: Wayne State University |
BookMark | eNp9UMtOwzAQtFCRKKUH_sASJw5p_UoTH6uKQqVKHChny3Y2NCWJi52o6t_jUsQBCU67s5qZ1cw1GrSuBYRuKZlQQthUh2rCBJXyAg0Z5yShM8EHPztPr9A4hB0hhBKZp4wO0XKzBexdDdiVuHCNrlr83rpDDcUb4AgKZ_sG2g4HqMF2lWtx6V0TofZ2iz2Evu7CDbosdR1g_D1H6HX5sFk8Jevnx9Vivk4sF6lMhDYcZGFIahgYSYxlkGZaa5FnWubGzojkmTYALDV5JuIl57RgYlaWBEjJR-ju7Lv37qOH0Kmd630bXyrGYyohqRSRdX9mWe9C8FCqva8a7Y-KEnVqSsWm1FdTkTv9xbVVp085O6-r-j_Foarh-Le1mr-szopPKyh8AQ |
CitedBy_id | crossref_primary_10_1108_AJIM_09_2021_0252 crossref_primary_10_1002_asi_24863 crossref_primary_10_1002_asi_24771 crossref_primary_10_1002_pra2_280 crossref_primary_10_1002_asi_24418 crossref_primary_10_1007_s42001_022_00196_2 crossref_primary_10_1177_00368504231150427 crossref_primary_10_1080_02763869_2023_2193122 |
Cites_doi | 10.1145/1753326.1753386 10.1016/j.ipm.2012.04.001 10.1145/1357054.1357062 10.1145/2009916.2010128 10.1145/1099554.1099622 10.1016/j.ipm.2011.04.005 10.1007/s10791-015-9269-8 10.1002/asi.20180 10.1002/(SICI)1097-4571(199802)49:2<115::AID-ASI3>3.0.CO;2-T 10.1145/1390334.1390447 10.1145/1835449.1835457 10.1016/S0306-4573(02)00031-6 10.1002/asi.10367 10.1108/00220410910983083 10.1002/asi.21078 10.1007/s10791-008-9076-6 10.1145/544220.544232 10.1002/(SICI)1097-4571(1999)50:2<98::AID-ASI2>3.0.CO;2-L 10.1007/978-3-319-44564-9_4 10.1117/12.722549 10.1145/1498759.1498819 10.1002/asi.23218 10.1136/jamia.2009.002733 10.1002/asi.10281 10.1080/01621459.1961.10482090 10.1016/j.chb.2004.03.040 10.1108/00220410410568151 10.1002/(SICI)1097-4571(199304)44:3<161::AID-ASI5>3.0.CO;2-8 |
ContentType | Journal Article |
Copyright | 2019 ASIS&T |
Copyright_xml | – notice: 2019 ASIS&T |
DBID | AAYXX CITATION 7SC 8FD E3H F2A JQ2 L7M L~C L~D |
DOI | 10.1002/asi.24199 |
DatabaseName | CrossRef Computer and Information Systems Abstracts Technology Research Database Library & Information Sciences Abstracts (LISA) Library & Information Science Abstracts (LISA) ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Library and Information Science Abstracts (LISA) ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
DatabaseTitleList | CrossRef Technology Research Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering Library & Information Science |
EISSN | 2330-1643 |
EndPage | 1247 |
ExternalDocumentID | 10_1002_asi_24199 ASI24199 |
Genre | article |
GrantInformation_xml | – fundername: IMLS funderid: #LG 06‐07‐0105‐07 |
GroupedDBID | .4I 0R~ 1OC 33P 3SF 52U 5VS AAESR AAEVG AAHHS AAHQN AAMNL AANHP AANLZ AAONW AASGY AAWTL AAXRX AAYCA AAZKR ABCUV ABJNI ABLJU ACAHQ ACBWZ ACCFJ ACCZN ACFBH ACGFS ACHQT ACPOU ACRPL ACXBN ACXQS ACYXJ ADBBV ADEOM ADIZJ ADKYN ADMGS ADNMO ADOZA ADXAS ADZMN AEEZP AEIGN AEIMD AENEX AEQDE AEUQT AEUYR AFBPY AFFPM AFGKR AFKRA AFPWT AFWVQ AFZJQ AHBTC AHQJS AIMQZ AITYG AIURR AIWBW AJBDE AJXKR AKVCP ALAGY ALMA_UNASSIGNED_HOLDINGS ALUQN ALVPJ AMBMR AMYDB ATUGU AUFTA AZFZN AZVAB BDRZF BGLVJ BHBCM BMNLL BMXJE BNHUX BPHCQ BRXPI BY8 CCPQU D-F DCZOG DRFUL DRSTM EBO EBS EBU EIHBH EJD ELW F00 F01 F04 G-S G.N GODZA HGLYW I-F K60 K6~ K7- LATKE LEEKS LH4 LIQON LITHE LOXES LUTES LW6 LYRES MEWTI MK~ ML~ MRFUL MRSTM MSFUL MSSTM MXFUL MXSTM NF~ O66 O9- P2W PQBIZ PQBZA PQEDU PQQKQ PROAC QB0 ROL SUPJJ TH9 WBKPD WIH WIK WOHZO WXSBR WYISQ WZISG AAYXX ADMLS AEYWJ AGHNM AGQPQ AGYGG CITATION PHGZM PHGZT PMKZF -~X .3N .DC .GA 05W 10A 1OB 3WU 4ZD 50Y 50Z 51W 51X 52M 52N 52O 52P 52S 52T 52W 52X 53G 5GY 66C 6PF 702 77K 7PT 7SC 7WY 8-0 8-1 8-3 8-4 8-5 8FD 8UM 8VB 930 A03 ABCQN ABEML ABIJN ABPPZ ACSCC ALSLI ARAPS AZBYB BAFTC BENPR BKOMP BROTX CS3 D-E DR2 DU5 E3H F2A F5P GUQSH H.T H.X HCIFZ HZ~ IX1 JQ2 K1G L7M LAW LC2 LC3 LP6 LP7 L~C L~D M0C M0F M2O MK4 N04 N05 OIG P2X P4D Q.N Q11 QRW QWB R.K RX1 UB1 V2E W8V WH7 WQJ XG1 XPP XV2 XZL ZL0 ~IA ~WT |
ID | FETCH-LOGICAL-c3459-4ab3e9db05b2eb90bc2e57aaa487a98bc60937abee25b8748bc831d246ff0e0f3 |
ISSN | 2330-1635 |
IngestDate | Wed Aug 13 09:41:14 EDT 2025 Thu Apr 24 23:07:46 EDT 2025 Tue Jul 01 03:09:24 EDT 2025 Wed Jan 22 16:37:59 EST 2025 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 11 |
Language | English |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-c3459-4ab3e9db05b2eb90bc2e57aaa487a98bc60937abee25b8748bc831d246ff0e0f3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
PQID | 2301049194 |
PQPubID | 26268 |
PageCount | 12 |
ParticipantIDs | proquest_journals_2301049194 crossref_primary_10_1002_asi_24199 crossref_citationtrail_10_1002_asi_24199 wiley_primary_10_1002_asi_24199_ASI24199 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | November 2019 |
PublicationDateYYYYMMDD | 2019-11-01 |
PublicationDate_xml | – month: 11 year: 2019 text: November 2019 |
PublicationDecade | 2010 |
PublicationPlace | Hoboken, USA |
PublicationPlace_xml | – name: Hoboken, USA – name: Hoboken |
PublicationTitle | Journal of the American Society for Information Science and Technology |
PublicationYear | 2019 |
Publisher | John Wiley & Sons, Inc Wiley Periodicals Inc |
Publisher_xml | – name: John Wiley & Sons, Inc – name: Wiley Periodicals Inc |
References | 1998; 49 2009; 65 2016; 19 2013; 49 2004; 60 2007; 6538 2011 2010 2010; 17 2009; 60 1993; 44 2009 2008 2005; 21 2005 2003; 39 2002 1961; 56 2003; 54 2009; 12 2004; 55 2015; 66 2005; 10 2016 2014 2012; 48 1999; 50 2005; 56 e_1_2_8_28_1 e_1_2_8_29_1 e_1_2_8_24_1 e_1_2_8_25_1 e_1_2_8_26_1 e_1_2_8_27_1 Kreyszig E. (e_1_2_8_15_1) 2011 e_1_2_8_3_1 e_1_2_8_2_1 e_1_2_8_4_1 e_1_2_8_7_1 e_1_2_8_6_1 e_1_2_8_9_1 e_1_2_8_8_1 e_1_2_8_20_1 e_1_2_8_21_1 e_1_2_8_22_1 e_1_2_8_23_1 e_1_2_8_17_1 e_1_2_8_18_1 e_1_2_8_19_1 e_1_2_8_13_1 e_1_2_8_14_1 e_1_2_8_16_1 Zhang X. (e_1_2_8_31_1) 2005; 10 e_1_2_8_32_1 e_1_2_8_10_1 e_1_2_8_11_1 Corder G.W. (e_1_2_8_5_1) 2014 e_1_2_8_12_1 e_1_2_8_30_1 |
References_xml | – year: 2011 – volume: 48 start-page: 136 year: 2012 end-page: 153 article-title: User relevance criteria choices and the information search process publication-title: Information Processing and Management – year: 2009 – volume: 6538 start-page: 65380V year: 2007 article-title: Effects of prior knowledge on the effectiveness of a hybrid user model for information retrieval publication-title: Proceedings of SPIE – year: 2005 – volume: 60 start-page: 1423 issue: 7 year: 2009 end-page: 1447 article-title: Effects of domain knowledge on reference search with the PubMed database: An experimental study publication-title: Journal of the American Society for Information Science and Technology – volume: 10 start-page: 217 issue: 2 year: 2005 article-title: Domain knowledge, search behavior, and search effectiveness of engineering and science students publication-title: Information Research – volume: 12 start-page: 1 issue: 1 year: 2009 end-page: 15 article-title: TREC genomics special issue overview publication-title: Information Retrieval – volume: 50 start-page: 98 issue: 2 year: 1999 end-page: 114 article-title: A cognitive model of document use during a research project. Study II. Decisions at the reading and citing stages publication-title: Journal of the American Society for Information Science – volume: 55 start-page: 246 issue: 3 year: 2004 end-page: 258 article-title: The effects of domain knowledge on search tactic formulation publication-title: Journal of the American Society for Information Science and Technology – year: 2016 – volume: 60 start-page: 673 issue: 6 year: 2004 end-page: 690 article-title: Subject knowledge improves interactive query expansion assisted by a thesaurus publication-title: Journal of Documentation – year: 2014 – year: 2010 – volume: 66 start-page: 980 issue: 5 year: 2015 end-page: 1000 article-title: Predicting users' domain knowledge in information retrieval using multiple regression analysis of search behaviors publication-title: Journal of the Association for Information Science and Technology – volume: 49 start-page: 198 year: 2013 end-page: 212 article-title: Assessing user‐specific difficulty of documents publication-title: Information Processing and Management – volume: 65 start-page: 719 issue: 5 year: 2009 end-page: 744 article-title: Examination of relevance criteria choices and the information search process publication-title: Journal of Documentation – volume: 17 start-page: 229 issue: 3 year: 2010 end-page: 236 article-title: An overview of MetaMap: Historical perspective and recent advances publication-title: Journal of the American Medical Informatics Association – volume: 49 start-page: 115 issue: 2 year: 1998 end-page: 133 article-title: A cognitive model of document use during a research project. Study I. Document selection publication-title: Journal of the American Society for Information Science – volume: 19 start-page: 189 issue: 1 year: 2016 end-page: 224 article-title: How users search and what they search for in the medical domain publication-title: Information Retrieval Journal – volume: 54 start-page: 836 issue: 9 year: 2003 end-page: 854 article-title: Do nondomain experts enlist the strategies of domain experts? publication-title: Journal of the American Society for Information Science and Technology – year: 2002 – year: 2008 – volume: 21 start-page: 195 year: 2005 end-page: 209 article-title: The effects and interaction of spatial visualization and domain expertise on information seeking publication-title: Computers in Human Behavior – volume: 56 start-page: 52 issue: 293 year: 1961 end-page: 64 article-title: Multiple comparisons among means publication-title: Journal of the American Statistical Association – volume: 44 start-page: 161 issue: 3 year: 1993 end-page: 174 article-title: Effects on search experience and subject knowledge on the search tactics of novice and experience searchers publication-title: Journal of the American Society for Information Science – volume: 56 start-page: 861 issue: 8 year: 2005 end-page: 871 article-title: The effects of expertise and feedback on search term selection and subsequent learning publication-title: Journal of the American Society for Information Science and Technology – volume: 39 start-page: 445 issue: 3 year: 2003 end-page: 463 article-title: Changes of search terms and tactics while writing a research proposal: A longitudinal case study publication-title: Information Processing & Management – ident: e_1_2_8_13_1 doi: 10.1145/1753326.1753386 – ident: e_1_2_8_21_1 doi: 10.1016/j.ipm.2012.04.001 – ident: e_1_2_8_8_1 doi: 10.1145/1357054.1357062 – ident: e_1_2_8_4_1 doi: 10.1145/2009916.2010128 – ident: e_1_2_8_16_1 doi: 10.1145/1099554.1099622 – ident: e_1_2_8_23_1 doi: 10.1016/j.ipm.2011.04.005 – ident: e_1_2_8_19_1 doi: 10.1007/s10791-015-9269-8 – ident: e_1_2_8_10_1 doi: 10.1002/asi.20180 – ident: e_1_2_8_27_1 doi: 10.1002/(SICI)1097-4571(199802)49:2<115::AID-ASI3>3.0.CO;2-T – ident: e_1_2_8_3_1 doi: 10.1145/1390334.1390447 – volume-title: Nonparametric statistics: A step‐by‐step approach year: 2014 ident: e_1_2_8_5_1 – ident: e_1_2_8_17_1 doi: 10.1145/1835449.1835457 – volume-title: Advanced engineering mathematics year: 2011 ident: e_1_2_8_15_1 – ident: e_1_2_8_25_1 doi: 10.1016/S0306-4573(02)00031-6 – ident: e_1_2_8_30_1 doi: 10.1002/asi.10367 – ident: e_1_2_8_24_1 doi: 10.1108/00220410910983083 – ident: e_1_2_8_26_1 doi: 10.1002/asi.21078 – ident: e_1_2_8_11_1 doi: 10.1007/s10791-008-9076-6 – ident: e_1_2_8_14_1 doi: 10.1145/544220.544232 – ident: e_1_2_8_28_1 doi: 10.1002/(SICI)1097-4571(1999)50:2<98::AID-ASI2>3.0.CO;2-L – ident: e_1_2_8_20_1 doi: 10.1007/978-3-319-44564-9_4 – volume: 10 start-page: 217 issue: 2 year: 2005 ident: e_1_2_8_31_1 article-title: Domain knowledge, search behavior, and search effectiveness of engineering and science students publication-title: Information Research – ident: e_1_2_8_18_1 doi: 10.1117/12.722549 – ident: e_1_2_8_29_1 doi: 10.1145/1498759.1498819 – ident: e_1_2_8_32_1 doi: 10.1002/asi.23218 – ident: e_1_2_8_2_1 doi: 10.1136/jamia.2009.002733 – ident: e_1_2_8_7_1 doi: 10.1002/asi.10281 – ident: e_1_2_8_9_1 doi: 10.1080/01621459.1961.10482090 – ident: e_1_2_8_6_1 doi: 10.1016/j.chb.2004.03.040 – ident: e_1_2_8_22_1 doi: 10.1108/00220410410568151 – ident: e_1_2_8_12_1 doi: 10.1002/(SICI)1097-4571(199304)44:3<161::AID-ASI5>3.0.CO;2-8 |
SSID | ssj0001098521 ssj0011510 |
Score | 2.3717604 |
Snippet | It is a frequently seen scenario that when people are not familiar with their search topics, they use a simple keyword search, which leads to a large amount of... |
SourceID | proquest crossref wiley |
SourceType | Aggregation Database Enrichment Source Index Database Publisher |
StartPage | 1236 |
SubjectTerms | Documents Information retrieval Ranking Searches Searching Topics |
Title | The role of domain knowledge in document selection from search results |
URI | https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fasi.24199 https://www.proquest.com/docview/2301049194 |
Volume | 70 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
journalDatabaseRights | – providerCode: PRVEBS databaseName: Business Source Ultimate customDbUrl: eissn: 2330-1643 dateEnd: 20241001 omitProxy: false ssIdentifier: ssj0001098521 issn: 2330-1635 databaseCode: AKVCP dateStart: 20140101 isFulltext: true titleUrlDefault: https://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=bsu providerName: EBSCOhost – providerCode: PRVEBS databaseName: Inspec with Full Text customDbUrl: eissn: 2330-1643 dateEnd: 20241001 omitProxy: false ssIdentifier: ssj0001098521 issn: 2330-1635 databaseCode: ADMLS dateStart: 20140101 isFulltext: true titleUrlDefault: https://www.ebsco.com/products/research-databases/inspec-full-text providerName: EBSCOhost – providerCode: PRVWIB databaseName: Wiley Online Library - Core collection (SURFmarket) issn: 2330-1635 databaseCode: DR2 dateStart: 19860101 customDbUrl: isFulltext: true eissn: 2330-1643 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0011510 providerName: Wiley-Blackwell |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3NT9swFLe6cuEybWLT2ABZaIdJU5jjjzg-ogFiE9thgNRbFDsOYoJ2WpsL_wT_Mi_-alCLxHaJWtdy1Pd-8fvIez8j9FHVwoIhtpkE_zjjkjWZpo3OpGasAItHjHXVFj-L00v-fSImo9H9oGqpW-gDc7e2r-R_tApjoNe-S_YfNJsWhQH4DPqFK2gYrs_WcSwPbGa3EOR_TjkyV-Y6M5172T93p924qsK-nSSkOiDS7m48k9Ma_9T1nCyV5-oRQ_OS32XCrtBn3lcT9GfXnQMIWMbf0ToO89MTgOXVbaD9DlmHXIX2u2QRVst6Vmo3KWMkA3fPv7S2wzHPzBQ3YH9ySARaPthOe2qYgWkGX0Su3fY9jWw9vz4Ah8QfuPSYWjtNEk9O8yTA59_cTy_QBpVFQcdo4_Dox9n5Mm1HVClcN1_6e5GvitAvaenHXs4ydBkGQM6DuXiFXgbV4kOPo9doZKdb6AQwhHsM4VmLPYZwwhCGLxFDOGEI9xjCHkM4YOgNujw5vvh6moWzNTLDuFAZrzWzqtFEaGq1ItpQK2Rd1xDA1qrUpiDguNbaWip0KTmMlCxvKC_alljSsrdoPJ1N7TuEWWkpbfJSF-B8aymVaAx4sS1viZGWq230KcqiMoF4vj__5KbylNm0ArFVTmzbaD9N_ePZVtZN2okCrcLDOK8gks4h2M0Vh9s5IT-9QBW1_P75Uz-gzeVjsIPGi7-d3QV3dKH3AkT2ICD7RR8AriaKfQ |
linkProvider | EBSCOhost |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+role+of+domain+knowledge+in+document+selection+from+search+results&rft.jtitle=Journal+of+the+Association+for+Information+Science+and+Technology&rft.au=Liu%2C+Jingjing&rft.au=Zhang%2C+Xiangmin&rft.date=2019-11-01&rft.pub=John+Wiley+%26+Sons%2C+Inc&rft.issn=2330-1635&rft.eissn=2330-1643&rft.volume=70&rft.issue=11&rft.spage=1236&rft.epage=1247&rft_id=info:doi/10.1002%2Fasi.24199&rft.externalDBID=10.1002%252Fasi.24199&rft.externalDocID=ASI24199 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2330-1635&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2330-1635&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2330-1635&client=summon |