Category: Digital Repositories

DigitalPreservationEurope Publishes Report on Copyright and Privacy Issues for Cooperating Repositories

DigitalPreservationEurope has published PO3.4: Report on the Legal Framework on Repository Infrastructure Impacting on Cooperation Across Member States.

Here's excerpt from the "Introduction."

The focus of this paper is the legal framework for the management of content of cooperating repositories. The focus will be on the regulation of copyright and protection of personal data. That copyright is important when managing data repositories is common knowledge. However, there is an increasing tendency among authors not only to deposit their published scientific work, scientific articles, dissertations or books, but also the underlying data. In addition to this ordinary publicly available sources like internet web pages contain personal data, often of a sensitive nature. Due to this emergent trend repositories will have to comply with the rules governing the use and protection of personal data, especially in the medical and social sciences.

The scenario is the following:

  • National repositories acquire material from different sources and in different formats.
  • The repositories cooperate with repositories in other countries in the preservation of data.
  • There is some degree of specialisation, some repositories specialise on preserving certain formats and other repositories on the preservation of other formats.

This paper describes the legal framework regulating the two decisive actions which have to take place if this scenario is to become a reality:

  1. The reproduction of data
  2. The transfer of data to other repositories

Other copyright issues like the rules concerning communication with the public and the protection of databases will also be touched upon.

Boston Public Library/Open Content Alliance Contract Made Public

Boston Public Library has made public its digitization contract with the Open Content Alliance.

Some of the most interesting provisions include the intent of the Internet Archive to provide perpetual free and open access to the works, the digitization cost arrangements (BPL pays for transport and provides bibliographic metadata, the Internet Archive pays for digitization-related costs), the specification of file formats (e.g., JPEG 2000, color PDF, and various XML files), the provision of digital copies to BPL (copies are available immediately after digitization for BPL to download via FTP or HTTP within 3 months), and use of copies (any use by either party as long as provenance metadata and/or bookplate data is not removed).

Open-Source IRStats Released: Use Statistics for EPrints and DSpace

Eprints.org has released IRStats, an open source use statistics analysis package that analyzes both EPrints (versions 2 and 3) and DSpace (beta functionality) logs. The software is under a BSD license, and it requires Perl, awstats, MySQL, Maxmind Organisation Database, ChartDirector, and a CGI-capable Web server.

A description of IRStats features is available as well as examples of its use. For additional information on the project, see "Introduction to IRS."

DSpace 1.5 Alpha Released

The 1.5 alpha version of the popular DSpace repository software has been released.

Here's an excerpt from "DSpace 1.5 Alpha with Experimental Binary Distribution" by Richard Jones:

There are big changes in this code base, both in terms of functionality and organisation. First, we are now using Maven to manage our build process, and have carved the application into a set of core modules which can be used to assemble your desired DSpace instance. . . .

The second big and most exciting thing is that Manakin is now part of our standard distribution, and we want to see it taking over from the JSP UI over the next few major releases. . . .

In addition to this, we have an Event System which should help us start to decouple tightly integrated parts of the repository. . . . Browsing is now done with a heavily configurable system . . . . Tim Donohue's much desired Configurable Submission system is now integrated with both JSP and Manakin interfaces and is part of the release too.

Further to this we have a bunch of other functionality including: IP Authentication, better metadata and schema registry import, move items from one collection to another, metadata export, configurable multilingualism support, Google and html sitemap generator, Community and Sub-Communities as OAI Sets, and Item metadata in XHTML head ‹meta› elements.

Library of Congress and Xerox Team Up to Build Large JPEG 2000 Image Repository

The Library of Congress and Xerox will work together to build a repository of around 1 million JPEG 2000 images of public domain works.

Here's an excerpt from the press release:

The two organizations are studying the potential of using the JPEG 2000 format in large repositories of digital cultural heritage materials such as those held by the Library and other federal agencies. The eventual outcome may be leaner, faster systems that institutions around the country can use to store their riches and to make their collections widely accessible.

The project, designed to help develop guidelines and best practices for digital content, is especially relevant to the Library’s National Digital Information Infrastructure and Preservation Program, which has been working with several other federal agencies on digitization standards.

The trial will include up to 1 million digitized, public domain prints, photographs, maps and other content from the Library’s extraordinary collections. Scientists in the Xerox Innovation Group will work with these materials to create an image repository that they will use to develop and test approaches for the management of large image collections.

The images to be used from the Library’s collection are already digitized (primarily in TIFF format), but JPEG 2000, a newer format for representing and compressing images, could make them easier to store, transfer and display. According to Michael Stelmach, manager of Digital Conversion Services in the Library’s Office of Strategic Initiatives, JPEG 2000 holds promise in the areas of visual presentation, simplified file management and decreased storage costs. It offers rich and flexible support for metadata, which can describe the image and provide information on the provenance, intellectual property and technical data relating to the image itself.

Xerox scientists will develop the parameters for converting TIFF files to JPEG 2000 and will build and test the system, then turn over the specifications and best practices to the Library of Congress. The specific outcome will be development of JPEG 2000 profiles, which describe how to use JPEG 2000 most effectively to represent photographic content as well as content digitized from maps. The Library plans to make the results available on a public Web site.

A Study of Curation and Preservation Issues in the eCrystals Data Repository and Proposed Federation

JISC's eBank UK project, which is now in phase three, has released A Study of Curation and Preservation Issues in the eCrystals Data Repository and Proposed Federation, which addresses key issues related to the establishment of the eCrystals Federation.

Here's an excerpt from "eBank Phase 3: Transitioning to the eCrystals Federation" that explains the overall project:

This project will progress the establishment of a global Federation of data repositories for crystallography by performing a scoping study into the feasibility of constructing a network of data repositories: the eCrystals Federation. The Federation approach is presented as an innovative domain model to promote Open Access to data more widely and to facilitate take-up.

It builds on the work of the eBank project, and has links to Repository for the Laboratory (R4L), SPECTRa and SMART Tea projects in chemistry. The Federation will contribute to the development of a digital repository e-infrastructure for research and will inform the Repository Support Project. . . .

In Phase 3, partners will assess organisational issues and promote advocacy, examine interoperability associated with research workflow and data deposit, harmonise the metadata application profiles from repositories operating on different platforms (EPrints, DSpace & ReciprocalNet), investigate aggregation issues arising from harvesting metadata from repositories situated within the information environments developed in other countries (EU, USA & Australia) and scope the issues of the Federation of institutional archives interoperating with an international subject archive (IUCr).

Brewster Kahle on Libraries Going Open

Brewster Kahle's "Libraries Going Open" document provides some details on where the Internet Archive and the Open Content Alliance are going with projects involving mass digitization of microfilm, mass digitization of journals, ILL of scanned out-of-print books, scanning books on demand, and other areas.

RUBRIC Toolkit: Institutional Repository Solutions Released

The RUBRIC Project has released the RUBRIC Toolkit: Institutional Repository Solutions.

Here's an excerpt from RUBRIC Toolkit: About the RUBRIC Project and the Toolkit page:

The RUBRIC Toolkit is a legacy of the RUBRIC Project, reflecting the discussions, investigation, phases, processes, issues and experiences surrounding the implementation of an Institutional Repository (IR). The sections are based on the collaborative experience of the eight Australian and New Zealand Universities involved in the project.

The content for the RUBRIC Toolkit developed organically and collaboratively in the project wiki over an extended period of time. It was then refined and developed. Project members have populated the Toolkit with useful resources and tools that can be used by other Project Managers and Institutions implementing an IR.

The RUBRIC Toolkit was released in October 2007 and will continue to be updated until the end of the RUBRIC Project in December 2007. As such the Toolkit captures the "best" of available advice, experience and outcomes available for IR development in 2007 and provides links to further reading wherever possible.

Digital Archive for Architecture: CDWA for DSpace

The Art Institute of Chicago has developed the Digital Archive for Architecture (DAArch) to support the use of the Categories for the Description of Works of Art (CDWA) metadata schema in DSpace. The software runs under BSD/UNIX/Linux; is written in Java, JSP, PHP; utilizes PostgreSQL, and is under a BSD License.

Muradora 1.0, a Fedora Front-End, Released

DRAMA (Digital Repository Authorization Middleware Architecture) has released Muradora 1.0, a Fedora front-end that provides identity control (via Shibboleth), authorization (via XACML), and other functions. DRAMA is a sub-project of RAMP (Research Activityflow and Middleware Priorities Project). A Live DVD image simplifies installation.

Here’s an excerpt from the fedora-commons-users posting:

  • "Out-of-the-box" or customized deployment options
  • Intuitive access control editor allows end-users to specify their own access control criteria without editing any XML.
  • Hierarchical enforcement of access control policies. Access control can be set at the collection level, object level or datastream level.
  • Metadata input and validation for any well-formed metadata schema using XForms (a W3C standard). New metadata schemas can be supported via XForms scripts (no Muradora code modification required).
  • Flexible and extensible architecture based on the well known Java Spring enterprise framework.
  • Multiple deployments of Muradora (each customized for their own specific purpose) can talk to the one instance of Fedora.
  • Freely available as open source software (Apache 2 license). All dependent software is also open source.

The Lowdown on the MITH/Rice University Our Americas Archive Project

The Maryland Institute for Technology in the Humanities has posted a description of its IMLS-funded Our Americas Archive Project.

Here's an excerpt:

Rice University, in partnership with the Maryland Institute for Technology in the Humanities (MITH) at the University of Maryland has received a three-year National Leadership Grant from the Institute of Museum and Library Services (IMLS) in the amount of $979,578 for the Our Americas Archive Project (OAAP), with an additional $980,613 provided in cost share by the institutions. The project will develop an innovative approach to helping users search, browse, analyze, and share content from distributed online collections. OAAP will incorporate recent Web 2.0 technologies to help users discover and use relevant source materials in languages other than English and will improve users’ ability to find relevant materials using domain-specific vocabulary searches. Two online collections of materials in English and Spanish, The Early Americas Digital Archive (EADA), and a new digital archive of materials to be developed at Rice, will provide an initial corpus for testing the tools. Rice principle investigators, Geneva Henry (Executive Director, Digital Library Initiative) and Caroline Levander (HRC Director), along with MITH co-PI Neil Fraistat are undertaking this innovative digital humanities project with a view to supporting scholarly inquiry into the Americas from a hemispheric perspective. As Geneva Henry says, “our goal is to develop new ways of doing research as well as new objects of study—to create a new, interactive community of scholarly inquiry.”

Two significant online collections of materials in English and Spanish supporting the interdisciplinary field of hemispheric American Studies—Maryland’s Early Americas Digital Archive (EADA) [http://www.mith2.umd.edu/eada/] and a new digital archive of multilingual materials being developed at Rice [http://rudr.rice.edu/handle/1911/9219]—provide an initial corpus for developing and testing these new digital tools. The two multilingual archives illustrate the complex politics and histories that characterize the American hemisphere, but they also provide unique opportunities to further digital research in the humanities. Geographic visualization as well as new social tagging and tag cloud cluster models are just some of the new interface techniques that the Our Americas Archive Partnership will develop with the goal of creating innovative research pathways. As Caroline Levander comments, “we see this as a first step in furthering scholarly dialogue and research across borders by making hemispheric material available open access worldwide. Our goal is to further develop innovative research tools that will help generate a collaborative, transnational research community.” Ralph Bauer, MITH Fellow, general editor of the Early Americas Digital Archive, and collaborator on the project adds, “the added digital materials and tools to navigate seamlessly through these two collections is enabling new forms of scholarship. Because the OAAP makes available materials that are dispersed in different geographic locations, it facilitates collaboration and intellectual exchange among an international audience. The digital medium offers rich opportunities for multicultural exchanges and is therefore uniquely suited for a hemispheric approach to history.”

Sun Preservation and Archiving Special Interest Group Formed

Sun has formed the Sun PASIG (Sun Preservation and Archiving Special Interest Group).

Here's an excerpt from the press release:

Addressing the need for better collaboration on best practices around global standards in large data set and metadata preservation, the Sun PASIG will help provide support for organizations challenged with preserving and archiving important research and cultural heritage materials. Founding members of the Sun PASIG include The Alberta Library, The British Library, Johns Hopkins University, University of Oxford, Stanford University, The Texas Digital Library, and other leading global libraries and universities. . . .

At globally located semi-annual meetings, group members will share knowledge of storage technology trends, services-oriented architecture and software code, and discuss best practices of both commercial and community-developed solutions. Working groups will hold discussions on architectures, use cases and business drivers, storage, access and security, and operating policies, with the goal of providing common case studies and solutions for digital archiving. The Sun PASIG will focus on both collaborating with leading institutions in the EPrints, Fedora, and DSpace communities to create replicable solutions and exchanging expertise on global developments around the Open Archival Information System (OAIS) architecture model.

"Libraries and universities around the world face a common problem: how to best capture and archive valuable knowledge. Global discussion is the first step towards finding solutions that meet institutions' individualized preservation needs," said Michael Keller, University Librarian, Director of Academic Information Resources, Stanford University. "With the formation of Sun PASIG, we are looking forward to working with our peers to discover and create the best digital preservation options available, from infrastructure to interfaces."

DCMI Scholarly Communications Community

The Dublin Core Metadata Initiative has established the DCMI Scholarly Communications Community, which currently includes a mailing list and a wiki.

Here's an excerpt from the home page:

The DCMI Scholarly Communications Community is a forum for individuals and organisations to exchange information, knowledge and general discussion on issues relating to using Dublin Core for describing research papers, scholarly texts, data objects and other resources created and used within scholarly communications. This includes providing a forum for discussion around the Eprints Application Profile, also known as the Scholarly Works Application Profile (SWAP) and for other existing and future application profiles created to describe items of scholarly communication.

Podcasts about the Long-Term Use of Research Data

Podcasts about the Long-Term Use of Research Data

The Australian Partnership for Sustainable Repositories has released MP3 and PDF files from its Long-lived Collections: The Future of Australia's Research Data Presentations symposium.

Here are selected MP3 files:

Blue Ribbon Task Force on Sustainable Digital Preservation and Access

Fran Berman, director of the San Diego Supercomputer Center, and Brian Lavoie, a research scientist at OCLC, have been named co-chairs of a Blue Ribbon Task Force on Sustainable Digital Preservation and Access, which is being funded by the National Science Foundation and the Andrew W. Mellon Foundation. The Library of Congress, the National Archives and Records Administration, the Council on Library and Information Resources, and JISC will also be involved in the task force.

Here's an excerpt from the press release:

Berman and co-chair Brian Lavoie . . . will convene an international group of prominent leaders to develop actionable recommendations on economic sustainability of digital information for the science and engineering, cultural heritage, academic, public, and private sectors. The Task Force is expected to meet over the next two years and gather testimony from a broad set of thought leaders in preparation for the Task Force’s Final Report. . . .

The Task Force will bring together a group of national and international leaders who will focus attention on this critical grand challenge of the Information Age. Task Force members will represent a cross-section of fields and disciplines including information and computer sciences, economics, entertainment, library and archival sciences, government, and business. Over the next two years, the Task Force will convene a broad set of international experts from the academic, public and private sectors who will participate in quarterly panels and discussions. . . .

In its final report, the Task Force is charged with developing a comprehensive analysis of current issues, and actionable recommendations for the future to catalyze the development of sustainable resource strategies for the reliable preservation of digital information. During its tenure, the Task Force also will produce a series of articles about the challenges and opportunities of digital information preservation, for both the scholarly community and the public.

Review of the Jorum Workflow Report Released

JISC has signed off on the Review of the Jorum Workflow report, and it has been released. Jorum is a UK digital repository of learning and teaching materials.

Here's an excerpt from the "Executive Summary":

The report begins by providing an overview of the original Jorum Workflow model (section 3.2) and illustrates how it was implemented into the Jorum repository software (section 3.3). A general review of the original model is then provided by discussing feedback received from major stakeholders in the Jorum Workflow process (section 3.4), and the section is concluded by exploring specific issues and modifications made to the original design (section 3.5).

Section 4 considers workflow research being undertaken by similar projects involved with learning object repositories. The projects discussed in this section are included due to their focus on learning objects repositories and similarities and relevance to Jorum. Conclusions and recommendations from these projects are then considered under potential new developments and strategies for the Jorum workflow, which is presented in the penultimate section of the report (section 5).

The final section of this report reflects on the Jorum workflow review and conclusions made by existing research. Finally, recommendations are provided to indicate potential areas of development and project monitoring.

Irish Virtual Research Library and Archive Repository Launched

The University College Dublin has launched the Irish Virtual Research Library and Archive Repository.

Here's an excerpt from the press release:

VRLA is a digital archive containing a number of digitised collections from UCD’s holdings, of use and interest to Irish humanities researchers. The IVRLA has developed a sophisticated interface enabling users to browse, search, tag and cite digital objects and view or download them in a variety of file formats. This interface sits on top of an open source repository architecture that functions as the IVRLA’s base content store. An elaborate collection model has been developed ensuring all content is viewed within context and structure. This model is particularly suited for organic primary source collections and enables hierarchy and sub-division in how objects are arranged and held within collections.

Contact the Senate about the NIH Public Access Policy by 9/28/07

The Alliance for Taxpayer Access, whose membership includes major library associations, has issued a new call to action about the NIH Public Access Policy that urges interested parties to contact their Senators by Friday, September 28, 2007. You can easily contact your senators using the ALA Action Alert Web form with my cut-and-paste version of ALA/ATA text or you can fax your Senators using the fax numbers in the press release (use the below link to get to the full press release)

Here's an excerpt from the press release:

As the Senate considers Appropriations measures for the 2008 fiscal year this fall, please take a moment to remind your Senators of your strong support for public access to publicly funded research and – specifically – ensuring the success of the National Institutes of Health (NIH) Public Access Policy by making deposit mandatory for researchers.

Earlier this summer, the House of Representatives passed legislation with language that directs the NIH to make this change (http://www.taxpayeraccess.org/media/release07-0720.html). The Senate Appropriations Committee approved a similar measure (http://www.taxpayeraccess.org/media/release07-0628.html). Now, as the Appropriations process moves forward, it is critically important that our Senators are reminded of the breadth and depth of support for enhanced public access to the results of NIH-funded research. Please take a moment to weigh in with your Senator now. . . .

Feel free to draw upon the following talking points:

  • American taxpayers are entitled to open access on the Internet to the peer-reviewed scientific articles on research funded by the U.S. government. Widespread access to the information contained in these articles is an essential, inseparable component of our nation's investment in science.
  • The Fiscal Year 2008 Labor/HHS Appropriations Bill reported out of committee contains language directing the National Institutes of Health (NIH) to change its Public Access Policy so that it requires NIH-funded researchers to deposit copies of agency-funded research articles into the National Library of Medicine’s online archive.
  • Over the more than two years since its implementation, the NIH's current voluntary policy has failed to achieve any of the agency's stated goals, attaining a deposit rate of less than 5% by individual researchers. A mandate is required to ensure deposit in NIH’s online archive of articles describing findings of all research funded by the agency.
  • We urge the Senate to support the inclusion of language put forth in the Labor/HHS Appropriations bill directing the NIH to implement a mandatory policy and ensuring free, timely access to all research articles stemming from NIH-funded research – without change – in any appropriate vehicle.

(We’ll be making additional resources for patient advocates – including the recording of our August 30 Web cast and specific talking points – available shortly as well.

Leslie Carr on What to Do with Dead Repositories

In his "Decommissioning Repositories" posting, EPrints guru Leslie Carr grapples with the issue of what to do with repositories that have served their purpose and that no one wants to maintain.

Here's an excerpt:

But now the party's over, there is no more funding, and none of the partner institutions has offered to keep the repository going in perpetuity. Not even the hosting institution or the ex-manager wants to keep their repositories going. We know that even if we don't turn them off their hosting hardware will fail in a few of years. That sounds like very bad news because a repository is supposed to be forever! Was it irresponsible to create these repositories in the first place? Should it be forbidden to create a public repository whose life is guaranteed to be less than a decade? Or perhaps that should be factored into the original policy-making—"this repository and all its contents are guaranteed up to 31st December 2017 but not after." If that were machine readable then the community could have decided whether they want to mirror the collection, or selected bits of it.

Source: Carr, Leslie. "Decommissioning Repositories." RepositoryMan, 10 September 2007.

Peter Murray-Rust Presentation on the Scientific E-Thesis

Peter Murray-Rust's presentation at Caltech on "The Power of the Scientific eThesis" is now available. (You may be asked to install an ActiveX control by MediaSite; you can run the presentation without it.)

Source: Smart, Laura J. "Peter Murray-Rust at Caltech." Repositories for the Rest of Us, 7 September 2007.

AONS: Scanning Repositories for Obsolete Digital Formats

The APSR AONS II project has released a beta version of the Automatic Obsolescence Notification System (AONS).

Here's an excerpt from the announcement on apsr_announcements:

Users can register with the service by providing a URL to a repository's format scan summary. The AONS service will display the summary and allow a repository manager to compare the formats of items in their repository with information from format registries such as PRONOM and Library of Congress. These registries flag any formats that are likely to become obsolete. Repository managers can then make curation decisions about any items at risk, such as upgrading their formats.

By downloading and installing an AONS locally, an institution can also take advantage of a pilot risk metrics implementation. . . .

The AONS software is the result of the AONS II project funded under APSR and developed by David Pearson, David Levy and Matthew Walker from the National Library of Australia (NLA) with an administrative user interface developed by David Berriman at ANU.

The software is able to be downloaded from Sourceforge at http://sourceforge.net/projects/aons and a mailing list is also available for support and feedback. As this is a beta release we welcome feedback to the Sourceforge mailing list to inform our testing which will continue until mid-September.

Please try out the pilot service by sending an email to cosi@apsr.edu.au to register with the service, and tell us which institution you are from. . . .

Portico Studying E-Book Preservation

Portico is launching a e-Book preservation study, which will last the rest of the year.

Here's an excerpt from the press release:

In response to several requests from publishers and libraries, Portico is conducting a study in order to assess how to extend its archival infrastructure and service to respond to the emerging need to preserve e-books. During the study we will analyze the structure and preservation needs of e-books and determine what adjustments to Portico's existing, operational and technological infrastructure and the economic model developed to support e-journal preservation might be required in order to respond to this new genre. Portico's e-journal archiving service was developed through a pilot project that drew heavily upon engagement with publisher and library pilot participants. We anticipate that a similar process will be essential in understanding how best to respond to the challenges of e-book preservation. . . .

The current participants in the E-Book Preservation study include:

Publishers

  • American Math Society
  • Elsevier
  • Morgan Claypool
  • Taylor and Francis

Libraries

  • Case Western Reserve University
  • Cornell University Library
  • McGill University
  • SOLINET
  • Texas University Libraries
  • University College of London
  • Yale University Library