WP23 Storage solutions: amending the DoW

The idea is to use this page to amend the text for the WP description in the DoW. Please edit this wiki page directly, and use the "insert" and "delete" mark-up to show changes, as illustrated:

Here is some unchanged text.
<ins>Here is some text to be inserted.</ins>
<del>Here is some text to be deleted.</del>
Here is some more unchanged text

Start month End month WP leader
11 26 ESA


Storage is a central component in any preservation solution, and requires special functionalities in order to adequately address the need of a preservation system. Partners’ needs for storage may vary substantially, e.g. in required capacity, number of objects, size of a typical object, geographical locations. Furthermore, depending on the nature of the data and its usage pattern, performance needs may vary greatly.

New technological approaches are required that meet the legal, business, cost, and scalability requirements of the ‘digital age’ for long-term digital information retention. Recent advances in solutions for Storage-as-a-Service, whereby storage is supplied by a storage provider in a pay-per-use mode, raise the option to adopt new technical solutions such as Cloud Storage as the basic storage for preservation systems. Such solutions are typically not enterprise in nature. A key aspect is to identify whether such technologies can not only address the cost and scalability needs, but also become a platform for trusted storage, addressing auditability, provenance and a desired level for data integrity.

The objective of this workpackage is to identify and compare partners’ needs in terms of digital objects preservation and their available and currently used storage approaches and technical solutions. The workpackage will identify the conditions under which external storage services would be used by partners, and will furthermore compare different external storage services and their fitness to preserve digital objects in terms of cost, legal, policy and business needs

* Possibly to rephrase into:

Generally, the context for this WP work relies on the fact that storage is an essential component in any digital preservation solution.

The objective of this workpackage is to highlight i) examples of storage solutions adopted or envisaged at some of WP23 partners premises, underlining aspects of digital preservation, and ii) research carried on about massive storage systems with respect to digital preservation, by some of WP23. This WP work will analyse such storage services primarily with respect to their any fitness to preserve digital objects. For this, WP partners will also provide information about cost parameters, law and policy related issues whenever available, in support of such analysis. Overall, due to their affiliation status and nature, different partners will give very different perspective about storage needs towards digital preservation. Finally, aspects related to data integrity, provenance information availability, and storage auditability are considered part of this WP work.

Description of work and role of partners

Task 2310 Storage solutions

Compare and contrast storage solutions implemented, planned or researched by consortium partners, and others e.g. Storage Networking Industry Association (SNIA) Data Task Force 100 Year Archive Requirements Survey [13]. Focus on dimensions such as: how long is the data preserved for, complexity of data, scalability, cost, availability, and legal regulations.

Task 2320 Evaluation and recommendation for storage solutions

This task will identify and recommend storage solutions for the long term. It will compare and survey commercial and non-commercial storage providers in terms of their cost model, validity of technology, trustworthiness, etc. For some storage providers, there is a potential risk of 'data lock in' since once the data is stored and managed it can be very difficult to migrate the data out and move it to a different solution. The task will investigate interoperability among different providers, and options to migrate data in and out of external providers.

* Possibly to rephrase into:

Task 2310 Storage solutions

Revise relevant examples of storage solutions adopted or envisaged at some of WP23 partners premises. The focus will be on key aspects leading to digital preservation, including main limitations.

Task 2320 Evaluation and recommendation for storage solutions

Summarise the outcomes of Task 2310 work and draft out a set of recommendations for ensuring digital presevration at storage resources level.

List of deliverables

  • D23.1 Storage solutions report (M26)

Description of deliverables

D23.1) Storage solutions report: This report will summarise the options available for storage, including in-house and use of external storage providers. It will summarise the evaluations of these against cost, reliability, preservation capabilities, technology lock-in etc. [month 26]

* Possibly to rephrase into:

D23.1) Storage solutions report: This report will summarise the work done in WP23. [month 26]

Further revisions in response to feedback from Project Officer 12th/14th December

-- SimonLambert - 2012-10-16

Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r4 - 2012-12-15 - SimonLambert
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback