1、1对象存储讨论与EMC ECS云对象存储2议题 什么是对象存储 为什么要使用对象存储 对象存储如何工作 什么场景适合使用对象存储 对象存储API3什么是对象存储 对象存储对象存储(又被成为基于对象的存储)是一种以对象的方式来管理数据的存储架构 通常每一个对象,包含数据本身数据本身,一系列的元数据元数据和一个全局唯一的标识全局唯一的标识 对象存储可以在不同的层面来实现,例如在设备级别(对象存储设备),在接口级别4典型的对象 一张图片一张图片l 图片文件本身l Meta Data元数据(图片大小、像素、色深、何时拍摄、拍摄设备信息)l 一个全局地址标识 一个文档一个文档l 文档文件本身l Meta
2、 Data元数据(文档字符数、作者、何时写成)l 一个全局地址标识对象可以是照片,视频,录音,文档,各种海量文件等等5对象存储架构的演进2002API(Proprietary)Single namespaceImmutable ContentUnstructured ContentEMC Centera2007Rest APIGeo replicationGlobal namespaceMulti-tenantUnstructured DataEMC Atmos2013-2015Universal API SupportSupport AnalyticsHighly efficient Geo
3、 storageSemi-structured DataFlexible Form FactorsEMC ECS6http:/ 多个磁盘组成一个LUN 访问单元为“块”LUN的大小通常10TB 文件数量几千万 无法直接共享 数据中心内访问 通过复制或者镜像实现主/备拷贝 多个LUN组成一个文件系统 访问单元为“文件”卷组大小通常 CreatePOST-ModifyGET-FetchDELETE-Delete54REST API文档 AWS S3 REST APIhttp:/ ECS REST APIhttps:/ SWIFT REST APIhttp:/developer.openstack.
4、org/api-ref-objectstorage-v1.html55Sample REST RequestPOST/rest/objects HTTP/1.1 x-emc-listable-meta:part4/part7/part8=quick x-emc-meta:part1=buy accept:*/*x-emc-useracl:john=FULL_CONTROL,mary=READ date:Wed,18 Feb 2009 16:03:52 GMT content-type:application/octet-stream x-emc-date:Wed,18 Feb 2009 16:
5、03:52 GMT x-emc-groupacl:other=NONE host:168.159.116.96 content-length:211 x-emc-uid:33115732f3b7455d9d2344ddd235f4b9/user1 x-emc-signature:KpT+3Ini1W+CS6YwJEAWYWvIlIs=56Sample REST ResponseHTTP/1.1 201 Created Date:Wed,09 Mar 2011 11:37:54 GMT Server:Apache x-emc-policy:default x-emc-delta:105836lo
6、cation:/rest/objects/4d773b6ca10574f404d773bd3bedfc04d776693243b8Content-Length:0 Connection:close Content-Type:text/plain;charset=UTF-857ECS硬件规格58ECS硬件平台规格(Gen1)RUECS U30040GbE3910 GbE3810 GbE37Empty36352u 4 node3433Blank32313029Blank28272625Blank24232221Blank2019181715 Disk x 6TB1615141315 Disk x
7、6TB121110915 Disk x 6TB876515 Disk x 6TB4321Not Used360TB(U300)RUECS U110040GbE3910 GbE3810 GbE37Empty3635Phoenix4 Blade3433Blank32313029Blank28272625Blank24232221Blank2019181745 Disk x 6TB1615141345 Disk x 6TB121110945 Disk x 6TB876545 Disk x 6TB4321Not UsedRUECS U70040GbE3910 GbE3810 GbE37Empty363
8、5Phoenix4 Blade3433Blank32313029Blank28272625Blank24232221Blank2019181730 Disk x 6TB1615141330 Disk x 6TB121110930 Disk x 6TB876530 Disk x 6TB4321Not UsedRUECS U150040GbE3910 GbE3810 GbE37Empty36352u 4 node3433Blank32313029Blank28272625Blank24232221Blank2019181760 Disk x 6TB1615141360 Disk x 6TB1211
9、10960 Disk x 6TB876560 Disk x 6TB4321Not Used720TB(U700)1.2PB(U1100)1.4PB(U1300)2.1PB(U2100)RUECS U300040GbE3910 GbE3810 GbE372u 4 node36352u 4 node343360 Disk x 6TB3231302960 Disk x 6TB2827262560 Disk x 6TB2423222160 Disk x 6TB2019181760 Disk x 6TB1615141360 Disk x 6TB121110960 Disk x 6TB876560 Dis
10、k x 6TB4321Not Used2.5PB(U2500)2.9PB(U3000)1.8PB(U1800)RUECS U180040GbE3910 GbE3810 GbE372u 4 node36352u 4 node343315 Disk x 6TB3231302915 Disk x 6TB2827262515 Disk x 6TB2423222115 Disk x 6TB2019181760 Disk x 6TB1615141360 Disk x 6TB121110960 Disk x 6TB876560 Disk x 6TB4321Not UsedRUECS U210040GbE39
11、10 GbE3810 GbE372u 4 node36352u 4 node343330 Disk x 6TB3231302930 Disk x 6TB2827262530 Disk x 6TB2423222130 Disk x 6TB2019181760 Disk x 6TB1615141360 Disk x 6TB121110960 Disk x 6TB876560 Disk x 6TB4321Not UsedRUECS U250040GbE3910 GbE3810 GbE372u 4 node36352u 4 node343345 Disk x 6TB3231302945 Disk x
12、6TB2827262545 Disk x 6TB2423222145 Disk x 6TB2019181760 Disk x 6TB1615141360 Disk x 6TB121110960 Disk x 6TB876560 Disk x 6TB4321Not Used59ECS硬件平台规格(Gen2)640TBRUECS U400040GbE3910 GbE3810 GbE372u 4 node36352u 4 node343360 Disk x 8TB3231302960 Disk x 8TB2827262560 Disk x 8TB2423222160 Disk x 8TB201918
13、1760 Disk x 8TB1615141360 Disk x 8TB121110960 Disk x 8TB876560 Disk x 8TB4321Not Used2.8PB3.8PB320TBRUECS U40040GbE3910 GbE3810 GbE37Blank36352u 4 node3433Blank32313029Blank28272625Blank24232221Blank2019181710 Disk x 8TB1615141310 Disk x 8TB121110910 Disk x 8TB876510 Disk x 8TB4321Not UsedRUECS U400
14、-T40GbE3910 GbE3810 GbE372u 4 node36352u 4 node343310 Disk x 8TB3231302910 Disk x 8TB2827262510 Disk x 8TB2423222110 Disk x 8TB2019181710 Disk x 8TB1615141310 Disk x 8TB121110910 Disk x 8TB876510 Disk x 8TB4321Not UsedRUECS U280040GbE3910 GbE3810 GbE372u 4 node36352u 4 node343345 Disk x 8TB3231302945 Disk x 8TB2827262545 Disk x 8TB2423222145 Disk x 8TB2019181745 Disk x 8TB1615141345 Disk x 8TB121110945 Disk x 8TB876545 Disk x 8TB4321Not Used