Académique Documents
Professionnel Documents
Culture Documents
This session will cover private and The difference between with block, file
public cloud storage options, and object stores, and where they are
including Flash, Disk and Tape to best used for different workloads will be
address the different types of cloud explained.
storage requirements
#ibmedge 1
This week with Tony Pearson
Day Time Topic
Monday All Flash is Not Created Equal:
2:30pm Tony Pearson Contrasts IBM FlashSystem and SSD
Grand Garden Arena, Lower Level, MGM Grand - Studio A
Wednesday All Flash is Not Created Equal:
11:00am Tony Pearson Contrasts IBM FlashSystem and SSD
Grand Garden Arena, Lower Level, MGM Grand - Studio 2
#ibmedge 2
Agenda
Applications and
Use Cases
Clients are facing explosive growth in Unstructured Data,
which is exactly why Object Storage is so critical
120
Problem - Traditional and Legacy Storage Designed for
Transactional, Not Unstructured Data
100
Unstructured
data growth of
80 60–80%
per year
creates
* Exabytes
60 Web-scale
storage needs
40 Unstructured Data
20
Structured Data
0
2009 2010 2011 2012 2013 2014 2015 2016 2017
*1 exabyte = 1,000 petabytes =1 million terabytes = 1 billion gigabytes Source: IDC
#ibmedge 4
How is Object Storage Different?
Access Access
Control Control
List List
SAN Zoning, SCSI File Eventual
(ACL) (ACL)
LUN Masking Reserve Locking Consistency
#ibmedge 8
Object Storage is Simpler for Application Development
#ibmedge 9
Where Objects can be Stored
Object-on-Database Photo123 Video789
Relational and NoSQL
Key/value stores Doc456
Object-on-File
Account = File System
Container = Fileset Eventually Consistent
Object = File OpenStack Swift
Metadata = Attributes Amazon S3
Basic HTTP
SAN/LAN
Storage-rich Servers
Multiple copies or
LAN/WAN Erasure Coding
#ibmedge 10
Data Protection Schemes
2.0X 3.0X
1.2X 1.5X
Erasure Coding
K pieces K+M = N
RAID-5 RAID-6 slices
K pieces K + 1 slices K pieces K + 2 slices
Applications and
Use Cases
Storage Positioning – Filling a Gap
Information Lifecycle
Unified file and object
Management (ILM) across tiers
storage on tape
Lowest cost
#ibmedge 13
IBM acquires Cleversafe, Inc.
Software Company
• Founded in 2004 in Chicago
• Shipping product since 2008 Notable Milestones
Software Defined
Object Storage
Over 350 Patents Awarded
• Over 100 people dedicated to
IBM Cloud software development
Object Storage Leader
Object 2 years in a row
Storage Runs on Industry Standard x86
System servers Multiple Exabytes in
• Certified platforms to provide Production
enterprise grade experience,
predictable performance and support Acquired by IBM 2015
#ibmedge 14
Data Growth at Petabyte (PB) Scale
Traditional
Approach
3 to 5x
PB of data Data
Protection Infrastructure Operations
Proprietary, specialized More than 1 FTE per PB
RAID, Mirrors,
hardware, multiple systems Maintenance outages
Replication, Tape
70%
60% Less Lower
1.7 x Hardware &
Rack space TCO
IBM Cloud
Object Storage
Approach Infrastructure Operations
Data Protection
High Availability & Disaster Recovery Software Defined, Less than 1 FTE per 6 PB
Geo-Distribution & Erasure Coding Commodity Hardware, Single system, Secure
Single System Self-healing
#ibmedge 15
IBM Cloud Object Storage System economics beat
legacy NAS storage and Amazon Web Services (AWS)
$6,000,000
IBM Cloud Object $1,053
dsNet object protected $4,000,000
#ibmedge 17
IBM Cloud Object Storage System – Terminology
Global Namespace Load
End user Accesser Balancer
HTTP
Application
OpenStack Swift
Server
Amazon S3
Vault Accesser Pool
HTTP
Geographically Dispersed
Three to Nine Sites
Consider adding IBM SoftLayer or leverage
existing datacenter locations to provide a broader
distribution of data for higher availability, site-
tolerance and scalability
#ibmedge 20
How the IBM Cloud Object Storage System Works
CONTENT
TRANSFORMATION BENEFITS
Data Ingest Data Retrieval
#ibmedge 21
Writing Data to IBM Cloud Object Storage System
Encrypted, Erasure
Coded Slices Information Dispersal
Original Data
Accesser® Appliance, Application,
12
11
Algorithm (IDA)
VM, Docker Container or Embedded 10
9
Erasure coding is used
8
7
to transform the data
Accesser® into a customizable
$ 7
6
5
4 number of slices (7/12
6 3
5
4 2 in this example)
3 1
Original object is 2
1
encrypted then
cut into pieces
#ibmedge 23
IBM Cloud Object Storage System – SmartRead
#ibmedge 24
Scalability
#ibmedge 25
IBM Cloud Object Storage System –
Software, Pre-Built Systems or Cloud Services
Software
• ClevOS – IBM Cloud Object
Storage System software Cloud Services
packaged with Debian Linux OS • IBM SoftLayer hardware
• Software-defined, hardware- infrastructure running IBM Cloud
Pre-built Systems
aware model for flexibility of x86 Object Storage System software
platform choice • Fully integrated appliance • Off-premise offering for
• Can be deployed on qualified models for easy customers that want security and
vendor hardware deployment and support controlled performance
• On-premises object
storage solution
#ibmedge 26
IBM Cloud Object Storage System –
Deployment Options
Cloud Public Consumed
Infrastructure • Standard regional pricing
Public Off-premises • Nearline regional
(IBM SoftLayer) • Nearline geo-
dispersed
Dedicated Dedicated Allocated
(Private) • IBM Managed pricing
Off-premises • Client managed
• Hybrid / Mixed
On-premises
Client Locally managed
infrastructure • Software
Local
(Private)
On-premises • Pre-built systems
(Recommend:
500TB or more)
Infrastructure
#ibmedge 27
Pre-Built Systems for IBM Cloud Object Storage System
12 drives @ 4, 6 or 8 TB
Health and performance monitoring 48 to 96 TB Nearline HDD
GUI and API access in 2U rack space
Configuration and security
Zero downtime upgrades
Slicestor 2448
16, 32 or 48 drives @ 4, 6 or 8 TB
Slices, Disperses and Retrieves data 64 to 384 TB Nearline HDD
in 4U rack space
#ibmedge 28
IBM Cloud Object Storage – SmartWrite and Rebuild
Optimistically attempts to write all slices in parallel
X ?
#ibmedge 29
Reading Data from IBM Cloud Object Storage System
With erasure coding “k” pieces are turned into “n” slices:
7
6
With this IDA, a read 5
4
can still be executed
with any five storage 3 $
2
nodes being 1
unavailable out of 12.
With 3 sites,
even an entire
Site 1 Site 2 Site 3 site outage (plus
one additional
storage node
outage) can be
tolerated.
#ibmedge 30
The Math Behind Reed-Solomon Erasure Coding
#ibmedge 31
IBM Cloud Object Storage System – Access Methods
NAS (NFS/SMB) Backup/Archive General Applications
DIRECT API ACCESS
The Accesser Software exposes three REST
APIs for ingest and retrieval. Applications with
knowledge of these APIs can leverage IBM
Cloud Object Storage directly. Hadoop
Data
S3 Compatible API Openstack Swift Simple Object API
Compatible API
Accesser
Software
S3 Compatible API Openstack Swift Simple Object API Site 1 Site 2 Site 3
Compatible API
Slicestor
Software
Accesser
Software
Slicestor
Site 1 Site 2 Site 3 PARTNER BASED
Software
A variety of Certified technology partners can leverage IBM’s
multi tenancy support to satisfy concurrent use cases on a
single IBM Cloud Object Storage instance.
#ibmedge 32
Agenda
Applications and
Use Cases
Market Verticals
Media & Media & Service Financial Heath Care & Government
Entertainmen Entertainment Providers Services & Life Sciences
t Distribution Insurance
Production
Consistently Scale your Secure customer Put medical
Have reliable Manage the data
create engaging storage for your on market offering trust and business progress before essential to serving the
experiences. demand content. without worry. compliance. everything else. good of the public.
Active Archive
Enterprise Storage as a
Content Repository STaaS
Service (STaaS)
Content Genomics
Collaboration Collaboration
Enterprise Collaboration
Backup
#ibmedge 34
Client Reference– Web Based Photo Sharing
• Scale – 130 petabytes and growing: more than 50 Billion images stored
• Manageability – 3 Administrators manage entire environment
• Security – 50,000+ uploads per minute with zero touch security
• Always-on availability – SLA of 100% download on demand – even during
California to Nevada datacenter move
• Economics – Operating costs reduced by more than 70%
• Key decision makers – Technical team backed by financial cost cutting
mandates
#ibmedge 35
IBM Cloud Object Storage System – Partner Comparison
Vendor Product Protocols Features Use Cases
Avere • NFS Global namespace • Analytics
FXT series • SMB Encryption, Compression, Snapshots, • Media rendering
Clustering
Ctera Networks • NFS, SMB Encryption, Snapshots, Replication, • Backup
CX0 series • AFP, FTP Enterprise File Sync and Share (EFSS) • RO/BO storage
• WebDAV
• iSCSI
IBM Spectrum Scale • NFS, SMB Global namespace & file locking, • Analytics / HPC
• OpenStack Encryption, Snapshots, Compression, • Media rendering
• Amazon S3 Replication • VMs and Databases
• Hadoop • Collaboration
• POSIX • NAS Consolidation
• Backup / Archiving
Nasuni NF series • NFS, SMB Global namespace & file locking, • Collaboration
• FTP, SFTP Encryption, Snapshots, Compression, • File sharing
• HTTPS Dedupe, EFSS • Archiving
• iSCSI
Panzura Global File • NFS Global namespace & file locking, • Collaboration
System • SMB Encryption, Compression, Dedupe • NAS consolidation
#ibmedge 36
IBM Spectrum Protect supports Cloud Object Storage!
Client nodes
Off-premises:
• IBM SoftLayer
Store
Lowest cost
#ibmedge 38
Competitive Differentiators
#ibmedge 39
Thank You
IBM Spectrum Implementing IBM IBM Spectrum IBM Spectrum IBM Spectrum
Scale (formerly Spectrum Scale Scale in an Scale – Big Data Scale and ECM
GPFS) OpenStack and Analytics FileNet Content
Environment Solution Manager
www.redbooks.ibm.com
#ibmedge 41
IBM Tucson Executive Briefing Center
#ibmedge
42
Tony Pearson
9000 S. Rita Road
Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM
Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on
storage topics covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to
Cloud Computing, Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads
client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and
virtualization products.
Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and
software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in
Electrical Engineering, both from the University of Arizona. Tony holds 19 patents for inventions on storage hardware and
software products.
#ibmedge 43
Additional Resources from Tony Pearson
Email:
tpearson@us.ibm.com
Twitter:
twitter.com/az990tony
Blog:
ibm.co/Pearson
Books:
www.lulu.com/spotlight/990_tony
Facebook:
www.facebook.com/tony.pearson.16121
Linkedin:
https://www.linkedin.com/in/az990tony
#ibmedge 44
Please Note: Edge 2016 Disclaimers
• IBM’s statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice and at IBM’s sole discretion.
• Information regarding potential future products is intended to outline our general product
direction and it should not be relied on in making a purchasing decision.
• The information mentioned regarding potential future products is not a commitment, promise,
or legal obligation to deliver any material, code or functionality. Information about potential
future products may not be incorporated into any contract.
• The development, release, and timing of any future features or functionality described for our
products remains at our sole discretion.
#ibmedge 45
Trademarks and Other Disclaimers
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central
Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are
trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT,
and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S.
Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell
Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP,
IBM Corp. and Quantum in the U.S. and other countries.
Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind
The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.
Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM
list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability,
or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such
commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount
of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements
equivalent to the ratios stated here.
Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your
geography.
Photographs shown may be engineering prototypes. Changes may be incorporated in production models.
© IBM Corporation 2016. All rights reserved. References in this document to IBM products or services do not imply that IBM intends to make them available in every country.
Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the
World Wide Web at http://www.ibm.com/legal/copytrade.shtml.
ZSP03490-USEN-00
#ibmedge 46