Académique Documents
Professionnel Documents
Culture Documents
Course Code CSE504T Course Category Course Title STORAGE TECHNOLOGY FOUNDATION Courses with conceptual focus Course Planner 12960::Nitin Kumar Lectures 4.0 Tutorials Practicals Credits 0.0 0.0 4.0
TextBooks Sr No T-1 Title Author Edition 2nd Year 2011 Publisher Name Wiley Information Storage and Management EMC Education Services Storing, Managing, and Protecting Digital Information in Classic, Virtualized, and Cloud Environments Reference Books Sr No R-1 R-2 Other Reading Sr No OR-1 OR-2 OR-3 OR-4 OR-5 Journals articles as Compulsary reading (specific articles, complete reference) Storage Networking Fundamentals: An Introduction to Storage Devices, Subsystems, Applications, Management, and Filing Systems, Marc Farley, Cisco , Storage Area Network Essentials, Richard Barker, Wiley , High Performance DatacenterNetworks Architectures, Algorithms, and Opportunities, Dennis Abts, Morgan &cLaypool publishers , Storage Virtualization: Technologies for Simplifying Data Storage and Management, Tom Clark, Addison Wesley Professional , http://blogs.msdn.com/b/data_otaku/archive/2011/11/01/an-introduction-to-big-data-concepts.aspx , Title Building Storage Networks Storage Networks: The Complete Reference Author Marc Farley Osborne Robert Spalding Edition 1st 1st Year 2001 2003 Publisher Name Tata McGraw Hill Tata McGraw Hill
Relevant Websites Sr No RW-1 RW-2 RW-3 RW-4 RW-5 RW-6 (Web address) (only if relevant to the course) http://www.intel.com/content/dam/doc/white-paper/intel-it-implementing-cloudstorage-metrics-paper.pdf http://cloudstory.in/2012/04/introduction-to-big-data-hadoop-ecosystem-part-3/ http://cloudstoragestrategy.com/2009/12/the-migration-to-object-based-storage.html http://blogs.gartner.com/thomas_bittman/2009/08/11/virtualization-unlocks-cloudcomputing/ http://lass.cs.umass.edu/~shenoy/courses/spring07/lectures/Lec05.pdf http://www.snia.org/education/storage_networking_primer/stor_devices/disk_drives Salient Features This paper presents the real time environment basics for the implementation of Cloud Storage by Intel. It provides the introduction and advanced learning topics related to big data, hadoop and adoption of them in cloud. The basics of unified storage and its implementation under different architectures. Virtualization Unlocks Cloud Computing Different types of virtualization Disk Drives explained
RW-7 RW-8 RW-9 RW-10 RW-11 RW-12 RW-13 RW-14 RW-15 RW-16 RW-17 RW-18 RW-19 RW-20 RW-21 RW-22 RW-23 RW-24 RW-25 RW-26 RW-27
http://www.serialstoragewire.org/Articles/2007_09/schultz.html http://wikibon.org/wiki/v/RAID_performance_and_security_metrics http://csciwww.etsu.edu/tarnoff/labs2150/harddrvs/drive_interfaces.htm http://msdn.microsoft.com/en-us/library/cc768535(v=bts.10).aspx http://techvirtuoso.com/2010/11/12/storage-tiering-vs-caching/ http://www.informationweek.com/news/storage/systems/232600068 http://www.storagenetworks.com/writeups/strategies/iscsi-vs-fc/iscsi-vs-fc.php http://www.sans.org/reading_room/whitepapers/backup/fibre-channel-storage-areanetworks-analysis-security-perspective_32913 http://blog.ipexpert.com/2012/07/23/ccie-data-center-fibre-channel-part-3-of-3/ http://www.infoworld.com/d/virtualization/deep-dive-san-and-nas-virtualization-241
The Many Faces of SAS Beyond the DAS Factor RAID performance and security metrics Hard Disk Interfaces and Physical Installation Measuring Performance on Hyper-V Storage and Cache Tiering Server-Based Storage Tiering Business Strategy Brief - iSCSI vs FC (Fibre Channel) SANs FC SANs Data center fibre channel Deep dive: SAN and NAS virtualization
http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/white_paper_c11- iSCSI and FCoE: A Comparison 495142.html http://onlamp.com/onlamp/2002/03/14/sansnas.html http://www.wwpi.com/index2.php?option=com_content&id=1591 http://www.ibm.com/developerworks/training/kp/cl-kp-cloudpaas/ http://cloud.dzone.com/articles/introduction-cloud-computing http://www.infostor.com/index/articles/display/6999554049/articles/infostor/volume13/Issue_10/Features/How_real_is_cloud_computing_storage_.html http://blogs.technet.com/b/privatecloud/archive/2012/04/05/planning-guide-forinfrastructure-as-a-service-iaas.aspx http://www.answers.com/topic/hierarchical-file-system https://developers.google.com/storage/docs/reference/v1/getting-startedv1 http://christoph.ruegg.name/blog/2010/7/21/content-based-storage-in-the-cloud.html http://www.cloudtweaks.com/2012/06/unified-storage-for-the-cloud-means-higherlevel-interfaces/ http://www.isaca.org/Knowledge-Center/Standards/Pages/IS-Auditing-Guideline-G32Business-Continuity-Plan-BCP-Review-from-IT-Perspective.aspx http://blog.disastercomuk.co.uk/tag/business-continuity-lifecycle-diagrams/ http://www.backupassist.com/education/articles/why-upgrade-to-v6.html http://www.storagesearch.com/datalink-nasbackup-art-2.pdf SAN and NAS File Storage Virtualization: The Solution to NAS And File Server Manageability Issues Cloud Computing An Introduction to Cloud Computing Characteristics and Service/Deployment Models Cloud storage Planning Guide for Infrastructure as a Service (IaaS) Hierarchical File System Google Cloud Storage Content-Based Storage in the Cloud Unified Storage For The Cloud Means Higher-Level Interfaces Read more: http://www.cloudtweaks.com/2012/06/unified-storage-for-thecloud-means-higher-level-interfaces/#ixzz21tVABYTX IS Auditing Guideline: G32 Business Continuity Plan (BCP) Review from IT Perspective Business Continuity Management Lifecycle Business Continuity NAS BACKUP
RW-32 RW-33 RW-34 RW-35 RW-36 RW-37 RW-38 RW-39 RW-40 RW-41 RW-42 RW-43 RW-44
http://searchdatabackup.techtarget.com/feature/Data-deduplication-approaches-inbackup-today http://www.ciol.com/resources/UserFiles/Technology/DataDe-duplicationWhitepaper.pdf http://www.drbd.org/users-guide/s-replication-protocols.html http://docs.oracle.com/cd/E19359-01/819-6148-10/chap2.html http://www.emc.com/collateral/software/white-papers/h8063-data-migration-vspherewp.pdf http://cisjournal.org/journalofcomputing/archive/vol3no3/vol3no3_13.pdf http://www.sans.org/reading_room/whitepapers/storage/storage-area-network-secureoverview-storage-area-network-security-perspective_516 http://technet.microsoft.com/en-us/magazine/hh641415.aspx https://www.sans.org/security-training/virtualization-private-cloud-security-1651-mid http://www.snia-europe.org/objects_store/SNIA_CSI_Storage_Multi-tenancy_WPfinal2.pdf http://www.oracle.com/us/026964.pdf http://hadoop.apache.org/ http://cloudcomputing.sys-con.com/node/807481
Deduplication in data DataDe-duplication-II Replication modes Replication and Synchronization Modes Data Migration Storage Security Storage Network Security Cloud Computing: Virtual Cloud Security Concerns Virtualization and Private Cloud Security Multitenancy ILM for Business Apache Hadoop Cloud Computing: Understanding Infrastructure as a Service
Audio Visual Aids Sr No AV-1 (AV aids) (only if relevant to the course) Videos for the datacenter , servers and storage arrays. Salient Features The videos depicts the working and configuration of arrays and servers.
Software/Equipments/Databases Sr No SW-1 SW-2 (S/E/D) (only if relevant to the course) Navisphere Simulator Control Center Salient Features A simulator used to showcase the internal working of storage arrays in the networked environment. Students will get hands-on experience. A Dataceneter Management Suite. This simulator provides the insight into datacenter operations and activities.
LTP week distribution: (LTP Weeks) Weeks before MTE Weeks After MTE Spill Over 7 6 2
Week Number
Lecture Number
Other Readings, Lecture Description Relevant Websites, Audio Visual Aids, software and Virtual Labs RW-2 Define the data and its bubsystem, Stoarage evolution
Learning Outcomes
Pedagogical Tool Demonstration/ Case Study / Images / animation / ppt etc. Planned Slide Show by Teacher
Week 1
Lecture 1
Storage System : Introduction to Information Storage and Management(Types of Data- Big Data, Information and Storage, Evolution of Storage Technology and Architecture, Data Centre Infrastructure.) Storage System : Introduction to Information Storage and Management(Challenges in Information Management and Information Life Cycle, Overview of virtualization and cloud computing.) Storage System Environment and Data Protection(Key I/O characteristics of an application, Application virtualization, File system mapping, LVM, Compute and Desktop Virtualization.) Storage System Environment and Data Protection(Popular connectivity protocols, Disk Drive Components, Disk Drive Performance.) Storage System Environment and Data Protection(Storage design based on application requirements and disk drive performance-Flash drives, DAS, host to storage access.) Storage System Environment and Data Protection(RAID Implementation, RAID array Components, RAID implementation methods.) Storage System Environment and Data Protection(Laws governing the Disk Performance, Compare I/O controller utilization and response time.)
T-1:Ch1 pg 1- 13
Student will be able to learn the concept of data and big data
Lecture 2
T-1:Ch1 pg 14-17
RW-1
Cloud and Virtualization Studenst will be able to Slide Show by Teacher overview understand the concepts of cloud and virtual environment
Lecture 3
T-1:1Ch1 pg 17-21
RW-4
Applications running in Students will be able to Slide Show by Teacher data center, Compute and understand the data desktop virtualization center technologies
Lecture 4
T-1:Ch 2 pg 21-48
RW-6
Connectivity options, Students will learn disk performance metrics about disk configuration and its performance
Week 2
Lecture 5
T-1:Ch 3 pg 51- 57
RW-9
Storage allocation to Students will be able to Slide Show by Teacher disks based upon the understand the concept application requirements of storage allocation and host access
Lecture 6
T-1:1Ch 3 pg 57-63
RW-8
Lecture 7
T-1:Ch 3 pg 64-68
Disk utilization laws and Students will learn response time about the disk basics and response time considerations
Week 2
Lecture 8
Intelligent Storage System (Components of an Intelligent Storage System, front end, and cache operation and management ,Server flash-caching technology, back end.) Intelligent Storage System(Storage Tiering and Cache Tiering, Case Study)
T-1:Ch 4 pg 84-86
Students will learn Slide Show by Teacher about the data center configurations and their usage
Week 3
Lecture 10
T-1:Ch 4 pg 90-93
RW-11 RW-12
Students will learn a Slide Show by Teacher bout the basics of storage and server based cache tiering and its usage Students will Slide Show by Teacher understand the working and implemen tation of storage servers and arrays
Lecture 11
Intelligent Storage System(Study of EMC CLARiiON and Symmentrix storage arrays, their Architecture, management, components.)
T-1:Ch 4 pg 93-95
Lecture 12
Storage Area Network(Fibre T-1:Ch 6 pg 117-127 Channel, Components of SAN, FC connectivity, Fibre Channel Ports, Fibre Channel Architecture.) Intelligent Storage System (Physical disks and Disk Drive Interfaces, traditional and virtual storage provisioning, LUN expansion, and LUN Masking.) Storage Area Network(Zoning, Fibre Channel Login Types, FC topologies, Organization of FC data, Fabric services) T-1:Ch 4 pg 87-90
RW-14
FC SAN ans its Students will be able to Slide Show by Teacher components, where they learn about SAN and its are used and how they artifacts are used LU expansion and migration, provisioning of resources Students will learn about the virtual resource provisioning and allocation Slide Show by Teacher
Lecture 9
RW-6 RW-9
Week 4
Lecture 13
T-1:Ch 6 pg 125-145
RW-15
Zoning in SAN, how Students will learn to data can be protected and apply security to data assigned to different and users across zones users
Lecture 14
Storage Area Network(Virtual R-2:Ch 17 page 240SAN, Block Level Virtualization, 257 SAN/NAS Capacity Management.) Storage Area Network(I/O workload management in SAN/NAS. Designing SAN/NAS, Case Study of EMC Connectrix.) Storage Area Network(I/O workload management in SAN/NAS. Designing SAN/NAS, Case Study of EMC Connectrix.) ISCSI, FCIP and Network Attached Storage(Components of iSCSI, host connectivity options, and ISCSI topologies, Protocol stack, iSCSI names.) R-2:Ch 17 page 258271
RW-10
Block level virtualization Students will Slide Show by Teacher in SAN and its understand the basics of configuration Block virtualizationand its importance IO workload management in SAN, designing of a SAN and NAS IO workload management in SAN, designing of a SAN and NAS ISCSI and its usage in the data center, topologies of ISCSI Students will learn to designand configure SAN and NAS Students will learn to designand configure SAN and NAS Slide Show by Teacher
Lecture 15
RW-7
Lecture 16
RW-7
T-1:Ch 8 pg 171-177
RW-13
Students will be able to Slide Show by Teacher define ISCSI protocol and its attributes
Week 5
Lecture 17
ISCSI, FCIP and Network T-1:Ch 8 pg 178-186 Attached Storage(FCIP protocol, and FICP protocol stack, Components of FCoE, FCoE frame mapping, and Converged Enhanced Ethernet.) ISCSI, FCIP and Network T-1:Ch 7 pg 149-157 Attached Storage(General purpose Servers v/s NAS Devices, NAS Benefits, NAS File I/O, NAS Components, NAS Implementation.) ISCSI, FCIP and Network T-1:Ch 7 pg 149-157 Attached Storage(NAS File Sharing Protocols, NAS I/O Operations, Factors affecting NAS Performance & Availability.) ISCSI, FCIP and Network Attached Storage(File Level Virtualization, Case Study EMC Celerra.) Cloud Computing(Cloud computing overview, essential cloud characteristics.) Cloud Computing(Cloud infrastructure framework, physical infrastructure, virtual infrastructure, application and platform software.) Cloud Computing(Cloud management and service creation tools, and cloud optimized storage and concept in practice.) Cloud Computing(Cloud enabling technologies, service models and cloud deployment models.) T-1:Ch 7 pg 158-168
RW-17
Students will be able to Slide Show by Teacher understand the difference between ISCSI, FCIP and IFCP
Lecture 18
RW-18
Lecture 19
Students will be able to Slide Show by Teacher define difference between NAS and SAN, configuration as well
Lecture 20
RW-16
NAS virtualiztion and its students will be able to Slide Show by Teacher usage define FILE virtulization Cloud and its attributes Students will learn Slide Show by Teacher about cloud computing and its characteristics Students will be able ti Slide Show by Teacher understand the virtual infra for the cloud deployment
Week 6
Lecture 21
RW-20
Lecture 22
RW-21
Lecture 23
RW-25 RW-26
Cloud storage and its Students will be able to Slide Show by Teacher usage across the domains define cloud based storage and their implementation methods Cloud deployment methods, services Students will learn about cloud types and their usage across the domains Students will learn about the basics of file systems and object storage Slide Show by Teacher
Lecture 24
RW-21
Week 7
Lecture 25
Object and Content Based Storage T-1:Ch 9 pg 189-194 (Comparison of hierarchical file system and flat address space, compare traditional and objectbased storage model.) Object and Content Based Storage T-1:Ch 9 pg 193-196 (Key components of OSD, and storage and retrieval process in OSD.)
RW-24
File systems used for storing the data across systems, object based storage
Lecture 26
RW-26
Components of OSD Students will learn storage and its attributes, about the process of retrieval process data storage and retrieval in OSD
Week 7
Lecture 27
Object and Content Based Storage T-1:Ch 9 pg 196-198 (CAS, components of unified storage.) Object and Content Based Storage T-1:Ch 9 pg 198-205 (Data access from unified storage. Case Study of EMC Centera)
RW-26
CAS model for archiving Students will be able to Slide Show by Teacher the data across domains understand the concept of CAS and its components Unified storage model for the cloud and data centers Students will learn about its basics and its configuration Slide Show by Teacher
Lecture 28
RW-3
MID-TERM
Week 8 Lecture 29 Storage Virtualization(Forms of Virtualization, Types and concept of Storage Virtualization.) Storage Virtualization(N/W Virtualization (Distributed virtual switches), Case Study of EMC Invista ,Rainfinity) T-1:Ch 10 pg 207212 RW-5 Virtualization types, virtual storage and its types Network virtualization and its usage in data center and across domains Students will be able to Slide Show by Teacher define the types and methods of virtualization in storage Students will be able to Slide Show by Teacher understand the concept of network virtualization and its types, they will be able to define its configuration
Lecture 30
T-1:10 pg 212-225
RW-4 RW-5
Lecture 31
Business Continuity and Backup and Recovery(Information Availability, BC Terminology, BC Planning Lifecycle, Failure Analysis.) Business Continuity and Backup and Recovery(Business Impact Analysis, BC Technology Solutions, Continuous data protection (CDP). Backup Purpose, Architecture.) Business Continuity and Backup and Recovery(Granularity, Considerations, Methods, Process, Backup and Restore Operations, Backup Topologies) Business Continuity and Backup and Recovery(Backup in NAS Environment, Backup Technologies, Backup to tapes, backup to disks) Business Continuity and Backup and Recovery(Backup to virtual tapes, data deduplication methods, and data deduplication implementations, Backup approaches in virtualization.)
T-1:Ch 11 pg 229238
RW-29
Business continuity plan Students will be able to Slide Show by Teacher and its process, BC define the BC plan and planning lifecycle its implementation
Lecture 32
T-1:Ch 11 pg 238244
RW-28
Students will be able to Slide Show by Teacher understand the concept of BIA and its applicability, the CDP process
Week 9
Lecture 33
T-1:Ch 12 pg 251262
RW-30
Methods for backup and Students will be able to Slide Show by Teacher restore, opeartions for define the concept of data backup backup and restore, furtehr they will be able to implment in real wirld problems Backup in NAS scenario, Students will be able to Slide Show by Teacher backup technologies to define the NAS backup be used in there methods and the technologies to be used data deduplication Students will be able to Slide Show by Teacher methods and their types, define deduplication their applicability methods and their usage in data center and storage scenario
Lecture 34
T-1:Ch12 pg 262270
RW-31
Lecture 35
T-1:Ch12 pg 271280
RW-32 RW-33
Week 9
Lecture 36
Replication(Local Replication at Source & Target, uses, data consistency, local replication technologies.)
T-1:Ch 13 pg 283297
Replication and its types, Students will be able to Slide Show by Teacher local replication define the concept of technologies Local and remote replication technologies and their implementation local replication in virtual infra, how to create multiple replicas Students will be able to Slide Show by Teacher define and use the local replication methosds and their implementation
Week 10
Lecture 37
Replication(Restore & restart considerations, creating multiple replicas, CDP, local replication in virtualized environment.) Replication(Management interface, Case Study of EMC Snapview.)
T-1:Ch 13 pg 297301
T-1:Ch 13 pg 301306
RW-36
Replication real time Students will be able to Slide Show by Teacher applicationsa dn usafe of define the local those applications replication and its types in real world scenario Homework,Term Paper,Test 1
Lecture 38 Lecture 39 Replication(Modes of remote replication, Remote Replication Technologies.) T-1:Ch 14 pg 309323 RW-34
Remote replication types and modes, remote technologies, three site replication Continuous data protection and their usage in data protection and redundancy, replicatiin virtual infrastructure Security framework in data center scenario and virtual framework, security domains in data center Security implementation in networked infra like SAN and NAS, Security policies Security in IP SAN scenario, its applicability and configuration, implementation Security aspects in cloud and virtual world, different techniques to be used for them
Students will be able to Slide Show by Teacher define remote replication technologies and their usage in data storage Students will learn about migration and replication stretegies, their usage, configuration and implementation Slide Show by Teacher
Lecture 40
T-1:Ch 14 pg 323360
RW-35 RW-36
Week 11
Lecture 41
Storage Security and Management (Storage Security Framework, Risk Triad, Storage Security Domains.)
T-1:Ch 15 pg 335340
RW-37
students will be able to Slide Show by Teacher define the storage security domains and their applicability in the infrastructure Students will be able to Slide Show by Teacher define the security inside NAS and SAN , applying policies on them Students will be ble to Slide Show by Teacher understand the concepts of security and protection in IP SAN Students will eb able to Slide Show by Teacher define and implenment the cloud and virtualization security concerns
Lecture 42
T-1:Ch 15 pg 341350
RW-37
Lecture 43
Storage Security and Management (Network firewalls, security implementation in IP SAN.) Storage Security and Management (Security in virtualized and cloud environment, and concept in practice.)
T-1:Ch 15 pg 350355
RW-38
Lecture 44
T-1:Ch 15 pg 355360
RW-39
Week 12
Lecture 45
Managing the Storage Infrastructure(Monitoring the Storage Infrastructure, Storage infrastructure management in virtualized environment.)
RW-40
Monitoring of storage infrastructure and its attributes, various domains under it, their configuration
Students will learn about the concepts of data center management protocols and techniques, procedures to be followed
Lecture 46
Managing the Storage Infrastructure(Storage multitenancy, Storage Management Activities, Challenges in managing information.) Managing the Storage Infrastructure(Storage multitenancy, Storage Management Activities, Challenges in managing information.) Managing the Storage Infrastructure(Information lifecycle management, benefits of ILM.)
RW-41
Storage multitenancy in data center scenarios, how it is useful, management activities in data centers Storage multitenancy in data center scenarios, how it is useful, management activities in data centers ILM management in business, its role and attributes with respect to applications
Students will be able to Slide Show by Teacher define the multitenancy concept and its usage in cloud and data center
Lecture 47
RW-41
Students will be able to Slide Show by Teacher define the multitenancy concept and its usage in cloud and data center
Lecture 48
RW-42
Students will define the Slide Show by Teacher role played by ILM in information management and procedures used for processing and analysis Students will define the Slide Show by Teacher role played by ILM in information management and procedures used for processing and analysis Students will define the Slide Show by Teacher role played by ILM in information management and procedures used for processing and analysis Students will be able to Slide Show by Teacher define the storage tiering concepts and its implementation in data cenetr and across the servers in data centers Students will be able to Slide Show by Teacher define the storage tiering concepts and its implementation in data cenetr and across the servers in data centers
Week 13
Lecture 49
RW-42
ILM management in business, its role and attributes with respect to applications
Lecture 50
RW-42
ILM management in business, its role and attributes with respect to applications
Lecture 51
Managing the Storage Infrastructure(Storage tiering, and concept in practice, Case Study of EMC ControlCenter.)
Stoarge tiering in data center and cloud infrastructure, its importanc e and applicability Stoarge tiering in data center and cloud infrastructure, its importanc e and applicability
Lecture 52
Managing the Storage Infrastructure(Storage tiering, and concept in practice, Case Study of EMC ControlCenter.)
SPILL OVER
Week 14 Lecture 53 RW-43 Hadoop and Big Data Students will be able to Slide Show by Teacher understand the concept of Hadoop and its usage and Big data cloud Infrastructure services will help students to understand about cloud virtual environment Slide Show by Teacher
Lecture 54
RW-44
Test 2
The objective is to Covers the syllabus till 8th week. check the understanding level of the students. term paper to be allocated from any topic within and relevant to the course Homework based week upto 4
Step by step evaluation of attempted questions. viva and evaluation based on the performance of students in attempting the questions
Individual Individual
3 / 11 4/6
List of suggested topics for term paper[at least 15] (Student to spend about 15 hrs on any one specified term paper) Sr. No. Topic 1 BIG DATA 2 CLOUD COMPUTING 3 SAN CAPACITY MANAGEMENT 4 Unified Storage 5 Object Based Storage
6 Continuous Data Protection 7 RAID Performance analysis 8 CACHE TIERING 9 Virtual Data center 10 FCIP VS IFCP 11 FCOE 12 Virtualization Technology 13 Business Continuity 14 GREEN STORAGE 15 V-SAN