Client Technical Specialist

IBM System Storage Linear Tape File System (LTFS)

Reviso: 19/02/2013

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Agenda

O volume de informao atual

O que LTFS Requerimentos
Tape Libraries Drives Operating System

Implementaes
Alguns casos de uso

Leve para casa

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Agenda

O volume de informao atual

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Inmeras fontes geram dados em curva exponencial

Requerimentos de storage crescem 20-40% anualmente
1,800 1,600 1,400

Exabytes

1,200
1,000 800 600 400 200 0 2005 2006 2007 2008 2009 2010

RFID,
Digital TV,

MP3 players, Digital cameras,

Camera phones, VoIP, Medical imaging, Laptops,
smart meters, multi-player games,
Satellite images, GPS, ATMs, Scanners,
Sensors, Digital radio, DLP theaters, Peer - to - peer, Email, Instant messaging, Videoconferencing, CAD/CAM, Toys, Industrial machines, Security systems, Appliances Telematics ,

2011

rich midia

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Rich Mdia cria novos requerimentos em armazenamento

Diferentes tipos e caractersticas dos dados
Dados de negcios (tradicional) Transacional, documentos, emails, banco de dados, backups Rich-mdia Video, imagens, contedo digital
Imagens, video: Maior componente de crescimento
1,800 1,600 1,400

Exabytes

1,200 1,000 800 600 400 200 0 2005 2006 2007 2008 2009 2010

Gerenciamento e acesso ao contedo rich-mdia diferente

Tradicional
Regulamento Conformidade Disaster Recovery de dados crticos Processos

RFID,
Digital TV,
Camera phones, VoIP, Medical imaging, Laptops,
smart meters, multi-player games, Satellite images, GPS, ATMs, Scanners,
Sensors, Digital radio, DLP theaters, Peer - to - peer, Email, Instant messaging, Videoconferencing, CAD/CAM, Toys, Industrial machines, Security systems, Appliances Telematics ,

MP3 players, Digital cameras,

2011

Rich-mdia
Longo prazo de reteno Proteo do contedo Distribuio do contedo Acesso dirio 24 horas
Indstria da Mdia e Entretenimento usa digital workflows

Fonte Wikipedia: O termo mdia possui vrios significados: meios de comunicao (jornal, tv, internet, rdio, etc) meios de armazenamento (CD, fita, disco, etc) Multi-mdia referencia mltiplos formatos de contedo texto, imagem, vdeo, audio, interatividade, etc Rich-mdia sinonimo de multi-mdia interativa
5

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Caractersticas de arquivos rich-mdia

Grande volume/quantidade de dados Iniciativas de contedo sendo digitalizado
E o crescimento de contedo constante

Acesso ao contedo
com ferramentas de Workflow Rede WAN/LAN

Reteno por longo prazo 10 - 50+ anos

Caracteristicas dos Containers Rich-Midia

Independente de aplicativos

Independente de gerenciamento de contedo Portabilidade: distribuio de contedo para muitos usurios Proteo contra perdas ou contedo corrompido Independente de indces em sistemas

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Vantagens da tecnologia de fita

Baixo custo por Gigabyte

Aprox. US$ 10 Cent / GB

Baixo TCO (Total Cost of Ownership)

Baixo consumo de energia

Alto desempenho em I/Os sequenciais

Escala linear adicionando-se tape drives

Proteo permanente WORM Armazenamento por longo perodo de tempo Facil armazenagem
Fora do site de produo E local de contingncia

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Oportunidades rich-mdia
Digitalizao de filmes Novas produes de filmes Transmisses de programas
TV, Radio

Sistemas de Vigilncia rea Mdica

Videos ultrasom 3D, 4D Raio-X So arquivos de alta-resoluo Geofsicos Desenho-Engenharia Cientficos, Governamentais

Documentos

Backup
Reteno longo-prazo para DR/Compliance

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Qual seria o valor da tecnologia LTFS ?

A fita tem seu valor
$/GB preo por gigabyte muito baixo Watt/GB green storage Portabilidade habilidade de gerenciar archive em outro site Escalabilidade facil adio de espao (compra do cartucho) Proteo de investimento geraes de LTO (cartuchos de at 32TB comprimido)

MASexistem alguns inibidores:

Dificuldade devido aplicaes proprietrias

Aplicaes de fita proprietrias requerem compromisso para o futuro (suporte e leitura) Software de archiving requer um banco de dados para recuperar o contedo. Distribuio e Import/export de fitas

Soluo: LTFS Resolve os inibidores

Formato da fita LTO no proprietria Estrutura dos dados da fita auto-descritvel Suporte Linux, Mac, Windows Facil distribuio Intercambivel entre diferentes Sistemas Movimento de arquivos entre file system de disco (drag/drop)
This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Agenda

O volume de informao atual

O que LTFS

10

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS baseia-se em 2 parties na fita

1.Partitioning LTO-5 tapes in two partitions
Partition 1: Index Partition is small(2 wraps, 37.5 GB) Partition 2: Data Partition fills the remainder of the tape Approved by LTO consortium

11

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS usa um formato aberto da fita

2.Open LTFS Format which is written to tape
Describes layout and data format of index and data partitions Index holds the file metadata and the mapping from files to data extents Meta data is based on XML schema Data extend is a set of sequential logical blocks used to store file data Developed and disclosed by IBM

SG24-5946 IBM System Storage Tape Library Guide for Open Systems
12

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS possui o software aberto

3.Open source LTFS software
Externalizes the LTO-5 tape as file system Software uses two partitions on LTO-5 tape to write LTFS format Available on Linux, Mac OS X and Windows

13

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS Easy Exchange of Data Share Data across Platforms

sem necessdade de uso de softwares de backup e archiving o usurio pode realizar o movimento de arquivos entre o LTFS e outros file systems das plataforma Windows, Linux e MacOS
14

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Example: LTFS Mounted on Linux

proporciona a fita a se comportar como se fosse um disk drive
Files can be accessed on tape directly from any application via LTFS

15

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Processo de gravao

LTFS tape after formatting

Index Partition
VOL1 Label LTFS Label Index

Index#0

Label includes volume label and LTFS label

Data Partition
VOL1 Label LTFS Label Index

New files are written to data partition

Index on Index Partition updated File1 and File2 written to Data Partition

Index Partition

VOL1 Label

LTFS Label

Index

Index1 is written to data partition

Data Partition

VOL1 Label

LTFS Label

Index

File1

File2

One index file on index partition and multiple index files on data partition

Assure integrity Includes reference to F1 and F2 Back-pointers to Index 0 Allows rollback to any version of the index

Index Partition

VOL1 Label

LTFS Label

Index

Data Partition

VOL1 Label

LTFS Label

Index

File1

File2

Index#1

16

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Onde reside o arquivo em fita?

When creating a LTFS tape rules can be specified for file placement Files matching a rule are placed on index partition Allows faster access

Rules are based on:

Size of files: all files less then 10 MB File name pattern: all files ending with *.pdf

File 3 gravado

17

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

File Delete / Modify

When a file is deleted, the pointer to the file in the Index file is deleted
When a file is partially modified, the pointer to the file in the Index file is modified
Original data is still remained on the cartridge New data is appended at the end of data partition Data itself is not deleted

Delete File.1 Modify File.3

VOL1 Label

LTFS Label

Index

VOL1 Label

LTFS Label

Index

Index1

18

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Agenda

O volume de informao atual

O que LTFS Requerimentos
Tape Libraries Drives Operating System

19

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS-SDE (Single Drive Edition)

Files and directories show up on desktop, directory listing Drag-and-drop files to/from tape, double-click to open Runs from any application that can access disk files

Linux Example

MacOS Example
TS2250 TS2350

20

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS-SDE Support
Linux computers Supported operating systems (i386 and x86_64 only)
Red Hat Enterprise Linux Server 5.4 and 5.5 Novell SUSE Linux Enterprise Server 11 Service Pack 1

Atualizaao de Fev/2012

Apple Mac computersSupported operating systems

Mac OS X 10.5.6 Leopard (32-bit) Mac OS X 10.6.7 Snow Leopard (32-bit)

Windows Supported operating systems

Windows 7 Professional Service Pack 1 (SP1) (32-bit and 64-bit) Windows Server 2008 R2 Service Pack 1 (SP1) (64-bit)

TS2250 TS2350

Observaes
Write-once, read-many (WORM) media are not supported. IBM LTO Ultrium 5 tape drives support only Free download under: http://www-03.ibm.com/systems/storage/tape/ltfs/index.html

21

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

LTFS Library Edition

LTFS supports the following IBM tape libraries:

IBM System IBM System IBM System IBM System IBM System

Storage TS2900 Tape Autoloader (LTO 5 tape drive only) Storage TS3100 Tape Library (LTO 5 tape drive only) Storage TS3200 Tape Library (LTO 5 tape drive only) Storage TS3310 Tape Library (LTO 5 tape drive only) Storage TS3500 Tape Library (LTO 5 and TS1140 tape drives)
Library Mode e no sequential mode

22

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Tape Libraries suportadas com LTFS - Exemplo do e-Config para LE

Single Drive Edition Supported Tape Systems TS2250 Library Edition TS2900, TS3100, TS3200, TS3310, TS3500 RHEL 5.6, 5.7, 6.1

TS2350
Supported Operating Systems RHEL 5.4, 5.5 SLES 11 SP1 Windows 7 32-bit Mac OS X 10.5.6 Other components For details on supported hardware configurations please refer to the System Storage Interoperation Center (SSIC)
Description TS3100 Tape Library Express 13m LC/LC Fibre Channel Cable Ultrium 5 Fibre Channel Drive Ultrium 5 Data Cartridge (5-pack) Attached to IBM AIX System 2.8m Power Cord 250V Brazil

Atualizaao Fev/2012

SUSE 11

For details on supported hardware configurations please refer to the System Storage Interoperation Center (SSIC)
Qty 1 1 1 1 1 1 1 1 1

Product 3573-L2U 6013 8244 8505 9600 9847

5639-LT1 IBM System Storage Linear Tape File System (LTFS) Library Edition V2R1 5806 Supply Feature U9WDC1 LTFS Library Edition V2.1 - Per Install 5639-LT1 Price 5639-LT2 LTFS Library Edition Maint (Reg/Ren): 1 Yr U9WEC2 Per Install SW Maintenance 1 yr SWMA Reg
23

1 1
2013 IBM Corporation

This document is for IBM and IBM Business Partner use only

IBM System Storage

LTFS LE Licensing
LTFS-LE is Priced by Install
Install is a unit of measure by which the Program can be licensed. An Install is an installed copy of the Program on a physical or virtual disk made available to be executed on a computer. Licensee must obtain entitlement for each Install of the Program. Installed on customer supplied server Purchase one install license for each:

Group of up to 2 tape drives and remaining single drives in a TS3100/TS3200 Tape Library Group of up to 2 tape drives and remaining single drives in a TS3500 Tape Library

Examples:
7 drive TS3500: 7 / 2 drives per install = 3 Groups of two drives + 1 group of one drive (the 7th drive) = 4 install licenses total 4 drive TS3200: 4 / 2 drives per install = 2 groups of two drives = 2 install licenses

3 drive TS3200: 3 / 2 drives per install = 1 Group of two drives + 1 group of one drives (for the 3rd drive) = 2 install licenses total

24

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Agenda

O volume de informao atual

O que LTFS Requerimentos
Tape Libraries Drives Operating System

Implementaes
Alguns casos de uso

25

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Propostas de casos de uso do LTFS

Disclaimer The use cases presented herein are hypothetical and may not exist as products. The intent of the following pages is to show how potential solutions can be envisioned without any warranty that IBM invests in any of these solutions. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.

26

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Use case: Simple File Storage

Simple deployment
Windows Linux Etc.

Export LTFS file system as network file system (NFS, CIFS) to any client capable of remotely mounting file system Access files directly from server with LTFS LE by client or application
NFS CIFS

Tape Appliance Linux Server

LTFS

Tape Library

27

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Use case: Simplified backup and archive

Simplified backup and archive

Daily copy of all or changed data to tape Optional: remove tape for vaulting

Solution

Advantages

Use LTFS with as remote file system E.g. via remote file system exports Copy files using simple tools
Easy integration in customer network Simple backup solution with standard OS tools Tapes can be brought offsite

LAN

T:\Tape1

T:\Tape2

T:\Tape3

LTFS with file server Backup Destination

28

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Agenda

O volume de informao atual

O que LTFS Requerimentos
Tape Libraries Drives Operating System

Implementaes
Alguns casos de uso

Leve para casa

30

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Leve para casa

LTFS apropriado para:

Integrar-se diretamente na infraestrutura de arquivos do cliente Importar e exportar arquivos Movimentar arquivos entre localidades Acessar arquivos diretamente da fita LTO-5

Valoriza as vantages da fita

Midia de alta capacidade de armazenamento Mdia removvel Alta performance sequencial (streaming data) Melhor TCO do que disco

LTFS disponivel de imediato

No requer infraestrutura adicional Para backup, archiving de dados

31

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Video publicado pela Thought Equity Motion (http://www.t3media.com/) sobre LTFS

32

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Linear Tape File System Weblinks

IBM Linear Tape File System:
http://www-03.ibm.com/systems/storage/tape/ltfs/index.html http://publib.boulder.ibm.com/infocenter/ltfs/cust/index.jsp http://publib.boulder.ibm.com/infocenter/ltfsle/cust/index.jsp http://www.ibm.com/support/docview.wss?rs=577&uid=ssg1S7003166 http://www.ibm.com/support/fixcentral/
(Storage Systems / Tape Systems / Tape Dev Driver and Software / Linear Tape File System / )

LTFS Info Center for Single Drive Edition: LTFS Info Center for Library Edition:

LTFS Format Specification:

LTFS Download (Linux, MAC OS, Windows): Almaden Research Project: Wikipedia:

http://www.almaden.ibm.com/storagesystems/projects/ltfs/
http://en.wikipedia.org/wiki/LTFS

33

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Linear Tape File System Web Feedback

Thought Equity Motion Client Reference Video
http://www-01.ibm.com/software/success/cssdb.nsf/CS/STRD-8GKDZS?OpenDocument&Site=corp&cty=en_us http://www.wwpi.com/index.php?option=com_content&view=article&id=9037:lto-5-and-ltfs-shaking-the-pillars-ofheaven&catid=99:cover-story&Itemid=2701018 http://www.storage-switzerland.com/Blog/Entries/2010/10/18_LTO5_with_its_own_File_System.html http://keycodemedia.wordpress.com/2010/11/18/storagedna-backs-up-avid-unity-to-lto-5-with-ltfs/ http://www.thoughtequity.com/video/shell/txp/ibm-and-thought-equity-motion-collaborate-on-film-archive-digitizationand-preservation-project-for-eye-film-institute-netherlands.do http://www.thebusinessofstorage.com/2011/03/28/the-value-of-tape-in-the-cloud/

LTO-5 and LTFS: Shaking the Pillars of Heaven

An Enabling Technology for Archive, Backup, Simple DR - even the Cloud:

StorageDNA backs up Avid Unity to LTO-5 with IBM LTFS: Film Archive Digitization and Preservation Project for EYE Film Institute Netherlands

The Value of Tape in the Cloud | The Business of Storage

Sony HDCam tape shortages: Is it time to now truly go tapeless? Or sort of tapeless with LTO5/LTFS
http://keycodemedia.wordpress.com/2011/04/10/1213/

34

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation

IBM System Storage

Fim

35

This document is for IBM and IBM Business Partner use only

2013 IBM Corporation