Linear Tape File System


The Linear Tape File System is a file system that allows files stored on magnetic tape to be accessed in a similar fashion to those on disk or removable flash drives. It requires both a specific format of data on the tape media and software to provide a file system interface to the data.
The technology, based around a self-describing tape format developed by IBM, was adopted by the LTO Consortium in 2010.

History

has been used for over 50 years, but typically did not hold file metadata in a form easy to access or modify independent of the file content data. Often external databases were used to maintain file metadata to hold this data but these external databases were generally not designed for interoperability and tapes might or might not contain an index of their content. In Unix-like systems, there is the tar interoperable standard, but this is not well-suited to allow modification of file metadata independent of modifying file content data - and does not maintain a central index of files nor provide a filesystem interface or characteristics.
LTFS technology was first implemented by IBM as a prototype running on Linux and Mac OS X during 2008/2009. This prototype was demonstrated at NAB 2009. Based on feedback from this initial demonstration and experience within IBM the filesystem was overhauled in preparation for release as a product. The LTFS development team worked with the vendors of LTO tape products to build support and understanding of the LTFS format and filesystem implementation leading up to the public release.
The LTFS Format Specification and filesystem implementation were released on April 12, 2010 with the support of IBM, HP, Quantum, and the LTO Consortium.
LTFS v2.0.0 was released in March 2011, improving the text to clarify and remove ambiguity. It also added support for sparse files; persistent file identifiers; virtual extended attributes for filesystem metadata and control - and defined minimum and recommended blocksize values for LTFS volumes, for compatibility across various HBA hardware implementations.

Format specification

The standard defines the LTFS Format requirements for interchanged media that claims LTFS compliance. It defines the data format, independent of the physical storage media and the software commands format, to make data truly interchangeable. The ISO standard was
prepared by SNIA. It is based on LTFS v2.2, and was adopted to ISO by a joint technical committee ISO/IEC JTC 1 Information Technology.
The SNIA workgroup continues to develop LTFS and release updates. Version 2.0.0 defines rules for how the version number may change in future, and how compatibility is maintained across varying implementations. All implementations must:
VersionPublishedConforming Software
1.0April 2010IBM Long Term File System v1.0.0, v1.0.1
HP Linear Tape File System v1.0.0, v1.1.0
2.0.0March 2011IBM Linear Tape File System - Single Drive Edition v1.2.0,
Oracle StorageTek Linear Tape File System, Open Edition v1.0.0
2.1.0October 2012
2.2.0December 2013
2.3.0March 2014 v2.3.0 Revision 4
2.4.0December 2017 v2.4.0
2.5.0May 2019 v2.5.0

SNIA Technical Work Group

In August 2012, SNIA announced that it was forming a TWG to continue technical development of the specification. LTFS Format Specification v 2.1 is the baseline for the technical work and standards accreditation process; SNIA LTFS TWG members include HP, IBM, Oracle and Quantum.

Nature

While LTFS can make a tape appear to behave like a disk, it does not change the fundamentally sequential nature of tape. Files are always appended to the end of the tape. If a file is modified and overwritten or removed from the volume, the associated tape blocks used are not freed up, they are simply marked as unavailable and the used volume capacity is not recovered. Data is only deleted and capacity recovered if the whole tape is reformatted.
In spite of these disadvantages, there are several uses cases where LTFS formatted tape is superior to disk and other data storage technologies. While LTO seek times can range from 10 to 100 seconds, the streaming data transfer rate can match or exceed disk data transfer rates. Additionally, LTO cartridges are easily transportable and hold far more data than any other removable data storage format. The ability to copy a large file or a large selection of files to an LTFS formatted tape, allows easy exchange of data to a collaborator, or the saving of an archival copy.
Since LTFS is an open standard, LTFS formatted tapes are usable by a wide variety of computing systems.

Implementations

IBM Linear Tape File System - Single Drive Edition

The IBM Linear Tape File System - Single Drive Edition,, allows tapes to be formatted as an LTFS volume, and for these volumes to be mounted - and users and applications access files and directories stored on the tape directly, including drag-and-drop of files.

Operating systems supported by IBM LTFS-SDE

The IBM Linear Tape File System - Library Edition product allows LTFS volumes to be used in a tape library. Each LTFS-formatted tape cartridge in the library appears as a separate folder under the filesystem mount point and the user or application can navigate into each of these folders to access the files stored on each tape. The LTFS-LE software automatically controls the tape library robotics to load and unload the necessary LTFS volumes.

Operating systems supported by IBM LTFS-LE

's free open source StorageTek Linear Tape File System, Open Edition software is claimed to be the first to store 8.5TB on a single cartridge. It supports Oracle’s midrange StorageTek LTO 5 and LTO 6 tape drives from HP and IBM as well as Oracle’s StorageTek T10000C and T10000D tape drives.

Oracle's StorageTek Linear Tape File System, Library Edition

Oracle’s StorageTek LTFS-LE software offering supports the StorageTek SL8500 Modular Library System, the StorageTek SL3000 Modular Library System, and the StorageTek SL150 Modular Tape.

HP Linear Tape File System

The HP Linear Tape File System is HP's implementation. It is a free open source software application.

Operating systems supported by HP LTFS

Quantum Corporation provides an LTFS product with Windows, Linux and Mac OS X support.
The Scalar LTFS Appliance is a file system that presents a Quantum tape library as an NAS share. This appliance makes files viewable as if they resided on a local disk and allows users to drag and drop files directly to and from a tape cartridge.

LTFS compatible products

Enterprise Drives