This 2006 report describes methods for selecting candidate commercial offtheshelf packages for further evaluation, possible methods for evaluation, and other factors besides requirements to be considered. The concept of relevance is central to understanding the interactions between users, usage, information needs and informational con tent. To build a digital library under economical conditions open source software is. This work proposes a contextual evaluation model of the functionalities for creating digital collections currently available in existing digital library creation tools.
Greenstone is a complete digital library creation, management and distribution package created and distributed by the new zealand digital library project. In some cases, there may be no technology solution to the challenge, but through sharing of ideas, new thinking may emerge to help. Digital library evaluation slide 1 of 30 unt digital. An experience with greenstone software author links open overlay paneljesustramullas. Special issue of information and software technology 39 11. Chapter 9 greenstone digital library software evaluation. Also provides links and guidelines for website accessibility. Quantitative methods for software selection and evaluation september 2006 technical note michael s. Evaluation of safetycritical software acm digital library. Evaluation of digital repository software at the national. The digital tools we create for teaching and learning allow us to push beyond our museum walls and connect with learners and educators everywhere.
Proceedings of the annual meetingamerican society for information science, 37, 3450. This 2006 report describes methods for selecting candidate commercial offtheshelf packages for further evaluation, possible methods for evaluation, and other factors besides requirements to. The aim of the greenstone is to empower users, particularly universities,libraries and other public service institutions throughout the world, to build their own digital. Many open source software packages are available for organizations and individuals to create digital libraries dls. A digital library is defined as the collection of digitized or digitally born items that are stored, managed, serviced, and preserved by digital library professionals. There are very few studies carried out so far on evaluation of open source digital library software due to the fact that these software are very complex and their functinalities are different. The national institutes of health nih national library of medicine nlm undertook an 18month project to evaluate, test and recommend digital. With the freeofcharge digital access evaluation service, sap offers their customers support to determine the estimated initial number of digital access documents. The dpsp is a collection of software applications which support the goal of digital preservation. This module focuses on the evaluation of digital libraries. The evaluation included those systems and software already identified by the digital repository working group, as well as any new or previously overlooked software. The staff of the national digital library program at the library of congress have identified ten challenges that must be met if large and effective digital libraries are to be created during the 21st century.
May 30, 2019 greenstone is a complete digital library creation, management and distribution package created and distributed by the new zealand digital library project. The approach was first to analyze and then isolate or even deconstruct some 80. June 4, 2007 edward luczak, occs michael north, hmd deborah ozga, nih library john rees, hmd. Digital library evaluation how is digital library evaluation abbreviated. The objective of the present work is to evaluate major open source digital library software ossdl available free and preferably under open source license. Digital library management system and then loading or. Method for architecture evaluation sei digital library. An insight into useful applications and methods pp. Digital library evaluation slide 1 of 30 unt digital library.
Snell library will be closed until further notice, but the northeastern university library staff are ready to help you online, and we have many digital resources for you to use. Open source software invenio, greenstone, omeka, eprints, orioai, dspace and proprietary software mnesys, digitool, yoolib, contentdm, software for old documents mnesys, digitool, yoolib, contentdm, greenstone, omeka and software originally intended to open archives invenio. Open source software oss have gained lot of acceptance in libraries all over the world to save exorbitant costs incurred in procuring commercial software as well as paying annual maintenance costs and upgrading costs incurred by commercial. Some pertain to performance of technology others to performance of given processes or algorithms using technology. The concept of relevance is central to understanding the interactions between users, usage, information needs and informational content. Toward an evolution of concepts tefkosaracevic abstract while there were many efforts in the research and practices of digi tal libraries, evaluation was not a conspicuous activity.
Digital repository evaluation and selection working group. Empirical research in usability of digital libraries is lean. Method for architecture evaluation august 2000 technical report rick kazman, mark h. An evaluation model dissertation, rutgers university the main research goal of this disserta tion is to develop a model and a suite of instruments to evaluate the usability of academic digital libraries. Evaluation of using expert system features in information. While a number of kinds of evaluationresearch studies may be conducted during the design and development of a digital library e. The objectives of the present work are to develop a checklist for dl evaluation and use this checklist on four dl software packages.
Saracevic 2000 discussed the evaluation of digital libraries and presented a set of elements for evaluation. Based on a detailed evaluation of the relevant document types, customers will have a basis for the decision whether sap digital access is the suitable license model for the future. For more information, visit our resources and services page. To ease assessmentselection process, this paper attempts to evaluate four most popular open source digital library software.
Evaluation of digital libraries rutgers university. To build a digital library under economical conditions open source software is preferable. Chapter 5 dspace digital library software evaluation. A checklist for evaluating open source digital library software. An adaptive systems approach to the implementation and evaluation of digital library recommendation systems. Chapter 3 evaluation criteria defined for evaluating open.
A checklist for evaluating open source digital library. Conclusions, among others, speculate as to the reasons for a relatively low presence of evaluation in digital libray research and. In close collaboration with the american library association, new knowledge organization ltd. Quantitative methods for software selection and evaluation. Pdf purpose many open source software packages are available for organizations and individuals to create digital libraries dls. Evaluation of digital repository software at the national library of. This list consisted of the different aspects of a digital library, including traditional library elements such as. This is an important point to consider because it impinges on evaluation. The evaluation activity of the delos network of excellence has performed a largescale survey of current dl evaluation. Iranian research institute for science and technology issn 22518223. Also the results can be helpful for the software providers to resolve the weaknesses and reinforce the strengths of the software.
The digital tools we create for teaching and learning allow us to push beyond our museum walls and. Digital repository evaluation and selection working group charter last updated. Pdf a checklist for evaluating open source digital library software. The evaluation activity of the delos network of excellence has performed a largescale survey of current dl. A study on the open source digital library softwares arxiv. It is well recognized that digital library evaluation is a complex and difficult undertaking. A theoretical framework for the holistic evaluation of. It is a suite of software for building and distributing digital library collections that provides a way of organizing information and publishing it on the internet and or on. Evaluation of digital library impact and user communities. Evaluation of digital libraries is not widely practiced. The purpose of this report is to provide an overview of works on digital library evaluation that included data. Open source digital library packages are gaining popularity nowadays. A digital library that provides diverse content will be characterized by heterogeneity in original format, in digital format and resolution, and in the level of detail and format of descriptive information that is available to support access.
We also provide maintenance releases for its forerunner, greenstone 2. Chapter 4 cdsinvenio digital library software evaluation. A different sort of library has opened in texas, one that turns a new page on an old idea. Planning and implementing a digital library project, indiana lsta digital project planning workshop, december 15, 2006, peabody public library, columbia city, in and december 16, 2006, porter county public library, valpairaiso, in. An example of a digital library evaluation processing including the development and ranking of evaluation criteria and applying them to an existing collection. This selection of 10 solutions is fairly representative of what can be used to develop a digital library. Many open source software packages are available for organizations and individuals to. A checklist was prepared for evaluation of digital library software in expert systems context. Evaluation of dl software evaluationin the context of digital library software means finding out software system performance software. Greenstone 3 is under active development, and is recommended for download. From educational media to classroom activities, from a behindthescenes look at ideas were tinkering with to the vast riches of our explore section, our teaching tools support educators and. Apr 04, 2011 this refers to how the software is used, what it can produce, how much it can expand with increased use and access, and how it might expand to offer more services in the future.
Image the device target and run dice evaluation software or similar product. However, a simple to use instrument to evaluate these dl software packages does not exist. Methods and approaches for testing the reliability and trustworthiness of software remain among the most controversial issues facing this age of high technology. Dpsp digital preservation software platform description. However, a simple to use instrument to evaluate these dl software packages. Fourth european conference on research and advanced technology for digital libraries ecdl2000. Planning and implementing a digital library project. Most team members will allocate an estimated 58 hours per week to the project for a period of up to 6 months. The evaluation was to include handson testing against a set of functional requirements based on the open archival information system oais model ingest, archival storage, data management, administration, preservation planning, and access as specified in the nlm digital repository policies and functional requirements. This module covers commonly used application software, which are specifically designed for the creation and development of digital library dl systems and similar types of collections and services, for example, digital repositories or open access archives. Evaluation of digital libraries article pdf available in international journal on digital libraries 8. This report presents technical and organizational foundations for performing architectural analysis, and presents the seis atam, a technique for analyzing software architectures. Challenges to building an effective digital library. Evaluation of digital libraries summarizes research and practice on both sides of the atlantic and aims to answer the potential questions that both the theoretical and practical areas of digital library evaluation have posed during recent years.
Dspace is an open source digital library software developed jointly by mit libraries and. Checklist for evaluating tech tools, apps, software, and. Marble idaho national laboratory, idaho falls, idaho 83415, usa an ongoing issue within humancomputer interaction hci is the need for simplified or discount methods. In may 2007, the associate director for library operations approved the creation of the digital repository evaluation and selection working group wg to evaluate commercial systems and open source software and select one or a combination of systems and software for use as an nlm digital repository. Checklist for evaluating tech tools, apps, software, and hardware. Digital libraries dls are new and innovative information systems, under constant development and change, and therefore evaluation is of critical importance to ensure not only their correct evolution but also their acceptance by the user and application communities. Dlf seeks to facilitate conversations and activities related to digital library assessment. A few other scholars have presented library evaluation frameworks that focus on multiple perspectives.
Chapter 7 eprints digital library software evaluation. To take part, join the digital library assessment interest group dlf aig discussion forum, which is open to anyone interested in learning about or collaborating on the improvement of this work. Digital library evaluation tech talk inatnan hall nathan. Checklist for evaluating tech tools, apps, software, and hardware i have been searching high and low for an efficient, easytounderstand list of criteria for evaluating hardware, software, tools, and everything in between. Proof of concept for a human reliability analysis method for heuristic usability evaluation of software ronald l. The proposed model is based on usercentered techniques, and it focuses on defining the structure of the analysis, the establishment of standards, and the evaluation criteria.
It includes xena, dpr, checksum checker, and manifest maker. The corpus in this analysis represents the majority of efforts in digital library evaluation that contain data. Dspace provides tools for management of digital assets, and is. The digital preservation software platform dpsp is free and open source software developed by the national archives of australia.
Digital librariesevaluation and user studies wikiversity. It has lots of things to read, but you wont find any shelves full of books. Evaluation of digital library impact and user communities by. The evaluation of digital libraries is yet in the primitive stage and the evaluation of open source digital library software is a very new concept.