Twitter’s ubiquity, its adoption by nearly a quarter of a billion users in the last 16 years, and its status as a de facto public archive, has made it a gold mine of information, says Thomas [senior analyst at the Institute for Strategic Dialogue].
"In one sense, this actually represents an enormous opportunity for future historians—we’ve never had the capacity to capture this much data about any previous era in history," she explains. But that enormous scale presents a huge storage problem for organizations.
For eight years, the US Library of Congress took it upon itself to maintain a public record of all tweets, but it stopped in 2018, instead selecting only a small number of accounts’ posts to capture. "It never, ever worked," says William Kilbride, executive director of the Digital Preservation Coalition. The data the library was expected to store was too vast, the volume coming out of the firehose too great. "Let me put that in context: it’s the Library of Congress. They had some of the best expertise on this topic. If the Library of Congress can’t do it, that tells you something quite important," he says.
| Research Data Publication and Citation Bibliography | Research Data Sharing and Reuse Bibliography | Research Data Curation and Management Bibliography | Digital Scholarship |
