Digital Curation & Digital Preservation

"Scaling Up Digital Preservation Workflows With Homegrown Tools and Automation"

At NC State University Libraries, the Special Collections Research Center leverages an integrated system of locally developed applications and open-source technologies to facilitate the long-term preservation of digitized and born-digital archival assets. These applications automate many previously manual tasks, such as creating access derivatives from preservation scans and ingest into preservation storage. They have allowed us to scale up the number of digitized assets we create and publish online; born-digital assets we acquire from storage media, appraise, and package; and total assets in local and distributed preservation storage. The origin of these applications lies in scripted workflows put into use more than a decade ago, and the applications were built in close collaboration with developers in the Digital Library Initiatives department between 2011 and 2023. This paper presents a strategy for managing digital curation and preservation workflows that does not solely depend on standalone and third-party applications. It describes our iterative approach to deploying these tools, the functionalities of each application, and sustainability considerations of managing in-house applications and using Academic Preservation Trust for offsite preservation.

https://tinyurl.com/4mjpzth2

"An Analysis of the Effects of Sharing Research Data, Code, and Preprints on Citations"

In this study, we investigate whether adopting one or more Open Science practices leads to significantly higher citations for an associated publication, which is one form of academic impact. We use a novel dataset known as Open Science Indicators, produced by PLOS and DataSeer, which includes all PLOS publications from 2018 to 2023 as well as a comparison group sampled from the PMC Open Access Subset. In total, we analyze circa 122’000 publications. We calculate publication and author-level citation indicators and use a broad set of control variables to isolate the effect of Open Science Indicators on received citations. We show that Open Science practices are adopted to different degrees across scientific disciplines. We find that the early release of a publication as a preprint correlates with a significant positive citation advantage of about 20.2% (±.7) on average. We also find that sharing data in an online repository correlates with a smaller yet still positive citation advantage of 4.3% (±.8) on average. However, we do not find a significant citation advantage for sharing code. Further research is needed on additional or alternative measures of impact beyond citations. Our results are likely to be of interest to researchers, as well as publishers, research funders, and policymakers.

https://doi.org/10.1371/journal.pone.0311493

University of Illinois Urbana-Champaign: "Research Data Service Extended Review"

Building upon the first 5-year review in 2019, this report presents an extended review of the Research Data Service at the University of Illinois Urbana-Champaign from 2018-2023, assessing its current efforts and future directions.

https://hdl.handle.net/2142/124781

"Metrics to Increase Data Usage Understanding and Transparency "

Data metrics are essential to assess the impact of data repositories’ holdings and to understand the research practices of the community that they serve. These metrics are useful for reporting to funders, to inform community engagement strategies, and to direct and sustain repository services. In turn, communicating these metrics to the user community conveys transparency and elicits their trust in data sharing. However, because data metrics are time-sensitive and context-dependent, tracking, interpreting, and communicating them is challenging. In this work we introduce data usage analyses including benchmarking and grouping, developed to better assess the impact of the DesignSafe Data Depot, a natural hazards data repository. Make Data Count compliant metrics are analysed in relation to research methods, sub-disciplines, natural hazard types, and time, to learn what data is being used, what influences data usage, and to establish realistic usage expectations. Results are interpreted in relation to the research and publication practices of the community and to natural hazard events. In addition, we introduce strategies to clearly communicate dataset metrics to users.

https://doi.org/10.2218/ijdc.v18i1.929

"Video Game Preservationists Have Lost a Legal Fight to Study Games Remotely"

When video game scholars want to study games that are no longer on sale, they sometimes have to drive many hours to do it legally — and that won’t be changing anytime soon. The US Copyright Office has just denied a request from video game preservationists to let libraries, archives and museums temporarily lend individuals some virtual, remotely accessible copies of those works.

https://tinyurl.com/3sb37jn6

Institutionally Based Research Data Services: Current Developments and Future Direction

The Summit for Academic Institutional Readiness in Data Sharing (STAIRS) was a multi-phased project that brought together a diverse group of representatives from academic institutions across the United States who support research data sharing efforts. Building off preliminary assessment work and a virtual learning series, this was a unique chance to discuss the opportunities and challenges in supporting researchers’ data sharing needs within and across institutions. This report captures the details of the project, including the preliminary assessment work as well as the summit. Following a description of the broad themes and overarching takeaways from this multi-phased effort, we conclude with next steps and future directions for the academic data services community.

https://tinyurl.com/3v8b5xc3

"Research Data Policy: A Library and Information Science Publishers’ Perspective"

Apart from the common features identified in the literature, the authors found numerous distinct research data policy features of publishers, such as deposition of data sets, division of research data policy types, and sharing of research code. Furthermore, institutional publishers with research data policies have more rigid features for the execution of research data policy features since their beneficiaries are uniform, in contrast to the varied nature of journals’ and publishers’ authors.

https://doi.org/10.1007/s11135-024-01994-8

"Data Curation Maturity Model"

The Data Curation Maturity Model (DCMM) enhances the effectiveness of data curation activities with its innovative, mathematically quantifiable matrix approach, specifically tailored to meet the dynamic needs of data curation. By integrating focus area maturity models with specific curation requirements, the DCMM provides a structured progression framework that allows organizations to visualize and measure their advancements in data management. This model not only elevates data quality and reproducibility across various research domains but also establishes a new standard for strategic, targeted improvement in data curation practices.

https://tinyurl.com/yb8am8ba

"Supporting Data Discovery: Comparing Perspectives of Support Specialists and Researchers Authors"

Purpose: Much of the research in data discovery is centered on the users’ viewpoint, frequently overlooking the perspective of those who develop and maintain the discovery infrastructure. Our goal is to conduct a comparative study on research data discovery, examining both support specialists’ and researchers’ views by merging new analysis with prior research insights.

Methods: This work summarizes the studies the authors have conducted over the last seven years investigating the data discovery practices of support specialists from different disciplines. Although support specialists were not the main target of some of these studies, data about their perspectives was collected. Our corpus comprises in-depth interviews with 6 social science support specialists, interviews with 19 researchers and 3 support specialists from multiple disciplines, a global survey with 1630 researchers and 47 support specialists, and a use case analysis of 25 support specialists. In the analysis section, we juxtapose the fresh insights on support specialists’ views with the already documented perspectives of researchers for a holistic understanding. The latter is primarily discussed in the literature review, with references made in the analysis section to draw comparisons.

Results: We found that support specialists’ views on data discovery are not entirely different from those of the researchers. There are, however, some differences that we have identified, most notably the interconnection of data discovery with general web search, literature search, and social networks. . . .

We conclude by proposing recommendations for different types of support work to better support researchers’ data discovery practices.

https://doi.org/10.5334/dsj-2024-048

"IOP Publishing Study Reveals Varied Adoption and Barriers in Open Data Sharing Among Physical Research Communities"

Environmental scientists are the most open with their research data, yet legal constraints related to third-party ownership often limit their ability to follow the Findability, Accessibility, Interoperability, and Reusability (FAIR) principles. Physicists are also willing to share data but have concerns about the accessibility and understanding of the formats used. Engineering and materials scientists face the most significant barriers to sharing FAIR data due to concerns over confidentiality and sensitivity.

https://tinyurl.com/2s3jjzft

"The Paradox of Competition: How Funding Models Could Undermine the Uptake of Data Sharing Practices"

Although beneficial to scientific development, data sharing is still uncommon in many research areas. Various organisations, including funding agencies that endorse open science, aim to increase its uptake. However, estimating the large-scale implications of different policy interventions on data sharing by funding agencies, especially in the context of intense competition among academics, is difficult empirically. Here, we built an agent-based model to simulate the effect of different funding schemes (i.e., highly competitive large grants vs. distributive small grants), and varying intensity of incentives for data sharing on the uptake of data sharing by academic teams strategically adapting to the context. Our results show that more competitive funding schemes may lead to higher rates of data sharing in the short term, but lower rates in the long-term, because the uncertainty associated with competitive funding negatively affects the cost/benefit ratio of data sharing. At the same time, more distributive grants do not allow academic teams to cover the costs and time required for data sharing, limiting uptake. Our findings suggest that without support services and infrastructure to minimise the costs of data sharing and other ancillary conditions (e.g., university policy support, reputational rewards and benefits of data sharing for academic teams), it is unlikely that funding agencies alone can play a leading role for the uptake of data sharing. Therefore, any attempt to reform reward and recognition systems towards open science principles should carefully consider the potential impact of their proposed policies and their long-term side effects.

https://doi.org/10.31222/osf.io/gb4v2

"National Archives Updates Digital Preservation Framework"

Last week the National Archives released a major update to its Digital Preservation Framework, an open resource and data set on GitHub that provides guidance and risk assessments for digital file formats. refer to caption Enlarge NASA Computers, September 12, 1986. Photo by Martin Brown. National Archives, Records of the National Aeronautics and Space Administration. View in National Archives Catalog The release marks a significant update to the Framework, adding new and revised questions to address additional risk factors to digital formats that have emerged since its initial release four years ago. The updated Framework is more user friendly and more transparent about the National Archives’ digital preservation process and its electronic holdings. . . .

The update comes after months of collaborative work with other digital formats specialists. The National Archives shared a draft of the updated Framework for public comment this past May, and this latest release incorporates feedback from colleagues throughout the agency and federal government, as well as international colleagues.

Since its debut, the Framework has become a widely consulted resource for the digital preservation community around the globe. The Framework was additionally released as Linked Open Data in 2022.

https://tinyurl.com/bdehy8yj

"Changes to Data Management and Sharing (DMS) Plan Progress Reporting and the Submission of Revised DMS Plans Are Coming on October 1"

On October 1, NIH is adding several new Data Management and Sharing (DMS) questions to Research Performance Progress Reports (RPPRs) and updating the process for submitting revised DMS Plans to NIH for review. In brief:

As mentioned in a May 2024 Guide Notice, NIH is including several new questions about DMS activities in RPPRs submitted on or after October 1, 2024 (See Guide Notice NOT-OD-24-175). For awards for which the NIH DMS Policy applies, recipients will now be asked:

Whether data has been generated or shared to date

What repositories any data was shared to and under what unique digital identifier

If data has not been generated and/or shared per the award’s DMS Plan, why and what corrective actions have or will be taken to comply with the plan

If significant changes to the DMS Plan are anticipated in the coming year, recipients will be asked to explain them and provide a revised DMS Plan for approval.

NIH is updating the processes for submitting requests to revise a DMS Plan through the Just in Time (JIT) Module, the Prior Approval Module, and the RPPR Module in eRA Commons (See Guide Notice NOT-OD-24-176).

https://tinyurl.com/4mxwtn8k

"Knowledge Infrastructures are Growing Up: The Case for Institutional (Data) Repositories 10 Years After the Holdren Memo"

Institutional data repositories are uniquely positioned to support researchers in sharing scholarly outputs. As funding agencies develop and institute policies for research data access and sharing, institutional data repositories have emerged as a critical feature in ecosystems for data stewardship and sharing. We show that institutional data repositories can meet and exceed the requirements and recommendations of federal data policy, thereby maximizing the benefits of data sharing. We present results of a mixed-method study which explores the adoption and usage of institutional repositories to share data from 2017 to 2023. Data from two previous studies were combined with data collected in 2023 on the data sharing solutions of Association of Research Libraries member institutions in the United States and Canada. The analysis of the aggregated data indicates that data stewardship has increased in both institutional repositories and institutional data repositories with an increase in complementary infrastructure to support data sharing. We then conduct an “infrastructural inversion” (Bowker & Star, 1999) to ‘surface invisible work’ of making data repositories function well, and demonstrate that institutional data repositories have advantages for providing sustainable stewardship, curation, and sharing of research data. Finally, we show that institutional data repositories may produce additional benefits through established infrastructure, local interoperability, and control.

https://doi.org/10.5334/dsj-2024-046

"A Proposal for a FAIR Management of 3D Data in Cultural Heritage: The Aldrovandi Digital Twin Case"

n this article we analyse 3D models of cultural heritage with the aim of answering three main questions: what processes can be put in place to create a FAIR-by-design digital twin of a temporary exhibition? What are the main challenges in applying FAIR principles to 3D data in cultural heritage studies and how are they different from other types of data (e.g. images) from a data management perspective? We begin with a comprehensive literature review touching on: FAIR principles applied to cultural heritage data; representation models; both Object Provenance Information (OPI) and Metadata Record Provenance Information (MRPI), respectively meant as, on the one hand, the detailed history and origin of an object, and – on the other hand – the detailed history and origin of the metadata itself, which describes the primary object (whether physical or digital); 3D models as cultural heritage research data and their creation, selection, publication, archival and preservation. We then describe the process of creating the Aldrovandi Digital Twin, by collecting, storing and modelling data about cultural heritage objects and processes. We detail the many steps from the acquisition of the Digital Cultural Heritage Objects (DCHO), through to the upload of the optimised DCHO onto a web-based framework (ATON), with a focus on open technologies and standards for interoperability and preservation. Using the FAIR Principles for Heritage Library, Archive and Museum Collections as a framework, we look in detail at how the Digital Twin implements FAIR principles at the object and metadata level. We then describe the main challenges we encountered and we summarise what seem to be the peculiarities of 3D cultural heritage data and the possible directions for further research in this field.

https://arxiv.org/abs/2407.02018

"Digital Provenance"

This article introduces, defines and analyzes the concept of digital provenance. I begin by comparing provenance, data provenance and digital provenance, focusing on research literature in archival studies, digital preservation and media archeology. The remainder of the article is divided into two parts, first examining three dimensions of digital provenance and then considering how digital provenance might be of use in the four main archival functions.

https://doi.org/10.1007/s10502-024-09462-w

Research Data Alliance: Recommendations on Data Versioning

We often say that “A is a version of B” but do not explain what we mean by “version”. We imply that B was somehow derived from A or that they share a common ancestor. But how is B related to A? How do they differ? Do they differ in content or format? What is the significance of this difference? While this sounds like a question about the provenance of a dataset, it goes beyond that and asks questions about the identity of a digital object and the intellectual and creative work it embodies.

The Research Data Alliance Data Versioning Working Group (https://www.rd-alliance.org/groups/data-versioning-ig/) collected over forty use cases of versioning practices for data and software and published a set of principles distilled from the group’s analysis of them. These Principles define terminology that helps us differentiate different types of versioning and thus allow us to address the use cases more precisely. In follow-up discussions, we learned that the Principles are too abstract to apply to the operation of data repositories or to guide the citation of digital resources. Therefore, this document aims to translate the Principles into actionable recommendations for data versioning.

https://doi.org/10.5281/zenodo.13743876

"Software Management Plans – Current Concepts, Tools, and Application"

The present article is a review of the state of the art about software management plans (SMPs). It provides a selection of questionnaires, tools and application cases for SMPs from a European (German) point of view, and discusses the possible connections of SMPs to other aspects of software sustainability, such as metadata, FAIR4RS principles or machine-actionable SMPs. The aim of our publication is to provide basic knowledge to start diving into the subject and a handout for infrastructure providers who are about to establish/develop a SMP service in one’s own institution.

https://doi.org/10.5334/dsj-2024-043

Paywall: "Ephemeral Geodata: An Impending Digital Dark Age"

Despite the unprecedented rate of geospatial data (“geodata”) generation, we are paradoxically creating a potential “dark age” in geospatial knowledge due to a failure to archive it. In the twentieth century, map libraries systematically collected and preserved government-issued maps. However, many have not expanded to include digital formats, which have replaced paper maps in most domains. Compounding this issue is the prevailing practice among government data providers to continuously update public data without adequately preserving previous iterations, thus overwriting the historical record.

https://doi.org/10.1080/15420353.2024.2398542

Internet Archive: "New Feature Alert: Access Archived Webpages Directly through Google Search"

In a significant step forward for digital preservation, Google Search is now making it easier than ever to access the past. Starting today, users everywhere can view archived versions of webpages directly through Google Search, with a simple link to the Internet Archive’s Wayback Machine. . . .

To access this new feature, conduct a search on Google as usual. Next to each search result, you’ll find three dots—clicking on these will bring up the “About this Result” panel. Within this panel, select “More About This Page” to reveal a link to the Wayback Machine page for that website.

Through this direct link, you’ll be able to view previous versions of a webpage via the Wayback Machine, offering a snapshot of how it appeared at different points in time.

https://tinyurl.com/ms749s28

"3D Data Long-Term Preservation in Cultural Heritage"

The report explores the challenges and strategies for preserving 3D digital data in cultural heritage. It discusses the issue of technological obsolescence, emphasising the need for ustainable storage solutions and ongoing data management strategies. Key topics include understanding technological obsolescence, the lifecycle of digital content, digital continuity, data management plans (DMP), FAIR principles, and the use of public repositories. The report also covers the importance of metadata in long-term digital preservation, including types of metadata and strategies for building valuable metadata. It examines the evolving standards and interoperability in 3D format preservation and the importance of managing metadata and paradata. The document provides a comprehensive overview of the challenges and solutions for preserving 3D cultural heritage data in the long term.

https://arxiv.org/abs/2409.04507

"What Needs to be Learned by U.S. Cultural Heritage Professionals? Results from the Digital Preservation Outreach & Education Network"

With the current proliferation of training opportunities available in digital preservation, this study asks: what are the most in demand digital preservation instruction topics? To answer this question, we did a qualitative content analysis of 168 Professional Development Support applications received by the Digital Preservation Outreach and Education Network (DPOE-N) between September 2020 and December 2023. The study finds that the management of digital records and metadata/cataloging standards were the most requested training topics, and that general and broadly applicable skills tend to be the most sought after. This indicates that there is a continuing need to provide education focusing on the core elements of digital preservation and knowledge, and that we have not moved on yet to a place where cultural heritage professionals are solely seeking skills in more advanced or specialized digital preservation topics.

https://doi.org/10.1515/pdtc-2024-0024

Paywall: British Library: "User-Centred Collecting for Emerging Formats"

This paper provides an overview of the work conducted at legal deposit libraries to better understand access requirements for emerging formats, from a user’s perspective and with a focus on web-based interactive narratives. . . . It also considers how existing tools and methodologies, such as web archiving, can be adapted and built to support the collection of emerging formats. Finally, it delves into different research projects conducted at the British Library around archiving and performing quality assurance for interactive narratives, collecting contextual information, and lessons learnt from exhibiting born-digital content in a physical space.

https://doi.org/10.1080/13614568.2024.2389101

Paywall: "Research on the Generation Mechanism and Action Mechanism of Scientific Data Reuse Behavior"

Specifically, this study takes scientific data reuse attitudes as a breakthrough to discuss the factors that influence researchers’ scientific data reuse attitudes and the extent to which these factors influence scientific data reuse behaviors. It also further explores the impact of scientific data reuse behavior on research and innovation performance and the moderating effect of scientific data services on scientific data reuse behavior.

https://doi.org/10.1016/j.acalib.2024.102921

"Artificial Intelligence Assisted Curation of Population Groups in Biomedical Literature "

Curation of the growing body of published biomedical research is of great importance to both the synthesis of contemporary science and the archiving of historical biomedical literature. Each of these tasks has become increasingly challenging given the expansion of journal titles, preprint repositories and electronic databases. Added to this challenge is the need for curation of biomedical literature across population groups to better capture study populations for improved understanding of the generalizability of findings. To address this, our study aims to explore the use of generative artificial intelligence (AI) in the form of large language models (LLMs) such as GPT-4 as an AI curation assistant for the task of curating biomedical literature for population groups. We conducted a series of experiments which qualitatively and quantitatively evaluate the performance of OpenAI’s GPT-4 in curating population information from biomedical literature. Using OpenAI’s GPT-4 and curation instructions, executed through prompts, we evaluate the ability of GPT-4 to classify study ‘populations’, ‘continents’ and ‘countries’ from a previously curated dataset of public health COVID-19 studies.

Using three different experimental approaches, we examined performance by: A) evaluation of accuracy (concordance with human curation) using both exact and approximate string matches within a single experimental approach; B) evaluation of accuracy across experimental approaches; and C) conducting a qualitative phenomenology analysis to describe and classify the nature of difference between human curation and GPT curation. Our study shows that GPT-4 has the potential to provide assistance in the curation of population groups in biomedical literature. Additionally, phenomenology provided key information for prompt design that further improved the LLM’s performance in these tasks. Future research should aim to improve prompt design, as well as explore other generative AI models to improve curation performance. An increased understanding of the populations included in research studies is critical for the interpretation of findings, and we believe this study provides keen insight on the potential to increase the scalability of population curation in biomedical studies.

https://doi.org/10.2218/ijdc.v18i1.950