Ingest Strategies for Digital Libraries: the Challenges of Handling Portable Objects

Increasingly we have come to think of institutional repositories as the primary storage and access locations for the deluge of digital materials. However, we continue to employ portable physical carriers for the storage and transfer of digital information, from portable hard drives, USB and Flash drives, through to DVD-ROMs, CD-ROMs and floppy disks. As concerns about the fragility and obsolescence of physical carriers continues to mount, it is likely that digital material will increasingly be transferred back to digital repository systems where curation of these objects will be simplified. The department of Humanities Advanced Technology and Information Institute (HATII) at the University of Glasgow ran the Packaged Object Ingest Project (POIP) to investigate the requirements, procedures and challenges that arise from ingesting digital objects on portable media into a repository. The Packaged Object Ingest Project provides a first step towards defining best practice for ingest from portable carriers. The work that lies behind this paper was carried out under ERPANET, a project funded by the EU under the FPS programme. The challenges of ingest from portable carriers should not be underestimated. A range of material was selected, designed to provide a realistic testbed. We studied a variety of published and unpublished CD-ROMs, published and unpublished 3.5” floppy disks, and unpublished 5.25” disks. We found the content and variations in production often posed challenging intellectual issues. How should we catalogue and store objects containing complex multimedia software applications or those containing seemingly unrelated collections of documents? Particularly with floppy disks, we encountered examples where the collections spanned multiple disks. What is the most appropriate way to catalogue these objects and retain the collection's provenance? The increased reliance on networked storage and delivery along with the rate of technological change means hardware obsolescence is a tangible risk. We wished to investigate which issues associated with ingest were unique to physical carriers as opposed to network delivered content.