Abstract
Discovery layer systems allow library users to obtain search results from multiple library resources and view results in a consistent format. The implementation of a discovery layer is expected to simplify users’ workflow of searching for scholarly information. Previous studies on discovery layer systems focused on functionality and content, but not quality of search results from the user’s perspective. The objective of this study was to obtain users’ assessment of search results of a discovery layer system (Ex Libris Primo®) and compare that with a widely used scholarly search tool (Google Scholar). Results showed that Primo’s search results relevancy is comparable to Google Scholar, but it received significantly lower usability and preference ratings. A number of usability issues of Primo were also identified from the study. Results of the study are used to improve the interface of Primo and adjust relevancy ranking options. The empirical method of search results assessment and feedback collection used in this study can be extended to similar user-centered system implementation and evaluation efforts.
Keywords
discovery layer, Google Scholar, search results, relevance, user-centered evaluation
Date of this Version
2013
DOI
10.1007/978-3-642-39253-5_34
Recommended Citation
Zhang, Tao, "User-Centered Evaluation of a Discovery Layer System with Google Scholar" (2013). Libraries Faculty and Staff Scholarship and Research. Paper 111.
http://dx.doi.org/10.1007/978-3-642-39253-5_34
Comments
This is the author’s accepted manuscript version of Zhang, T. (2013). User-Centered Evaluation of a Discovery Layer System with Google Scholar. In A. Marcus (Ed.), Design, User Experience, and Usability. Web, Mobile, and Product Design (Vol. 8015, pp. 313–322). Berlin, Heidelberg: Springer Berlin Heidelberg. http://dx.doi.org/10.1007/978-3-642-39253-5_34. The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-642-39253-5_34.