Category Archives: Unified Storage

Washing too much software defined

  By cfheoh | May 15, 2013 - 7:29 pm | Big Data, Cloud, Data Availability, Datacore, EMC, Filesystems, HDS, NetApp, Nexenta, Object Storage, Openstack, Software-defined Datacenter, Storage Optimization, Storage Tiering, Unified Storage, Virtualization
Leave a comment

There’s been practically a firestorm when EMC announced ViPR, its own version of “software-defined storage” at EMC World last week. Whether you want to call it Virtualization Platform Re-defined or Re-imagined, competitors such as NetApp, HDS, Nexenta have taken pot-shots at EMC, and touting their own version of software-defined storage.

In the release announcement, EMC claimed the following (a cut-&-paste from the announcement):

  • The EMC ViPR Software-Defined Storage Platform uniquely provides the ability to both manage storage infrastructure (Control Plane) and the data residing within that infrastructure (Data Plane).
  • The EMC ViPR Controller leverages existing storage infrastructures for traditional workloads, but provisions new ViPR Object Data Services (with access via Amazon S3 or HDFS APIs) for next-generation workloads. ViPR Object Data Services integrate with OpenStack via Swift and can be run against enterprise or commodity storage.
  • EMC ViPR integrates tightly with VMware’s Software Defined Data Center through industry standard APIs and interoperates with Microsoft and OpenStack.

The separation of the Control Plane and the Data Plane of the ViPR allows the abstraction of 2 main layers.

Layer 1 is the abstraction of the underlying storage hardware infrastructure. Although I don’t have the full details (EMC guys please enlighten me, please!), I believe storage administrator no longer need to carve out LUNs from RAID groups or Storage Pools, striped and sliced them and further provision them into meta file systems before they are exported or shared through NAS protocols. I am , of course, quoting the underlying provisioning architecture of Celerra, which can be quite complex. Anyone who has done manual provisioning with Celerra Manager should know what I mean.

Here’s the provisioning architecture of Celerra:

(more…)

Storage Facebook likes

  By cfheoh | January 31, 2013 - 11:13 am | Appliance, Cloud, Filesystems, iSCSI, Open Compute Project, Openstack, Storage Tiering, Unified Storage, Virtualization, VMware
2 Comments

There is a mini revolution going on, and Facebook is the main force driving it.

It is the Open Compute Project (OCP), and its mission is to redesign the modern-day data centers and drive open hardware and architectural designs and specifications, including storage. The overall goals are to drive greater data center efficiency, flexibility, energy savings and cost effectiveness in a new class of “hyperscale” datacenters. Facebook, Google and Amazon are some of the examples of hyperscale datacenters, where their businesses relies on massive computing power, exponential storage performance and racks and racks of computing infrastructure to drive their web-computing or cloud-computing services.

Some of the cool technology innovations in mind includes having systems that support any CPUs from any vendors including Intel and AMD. We may even see both processor brands running on the same motherboard. The Open Common Slots component for processors is based on PCIe. Intel has pledged their Decathlete motherboard specifications for OCP and likewise AMD has produced its Roadrunner mobo series specification for the project as well. The ARM processor could also be supported in the near future in this “mix-and-match” OCP ideals.

Other proposed changes include OpenRack specifications, “sleds”, and of course, the Open Vault project for storage (aka “Knox”). (more…)

Is there no one to challenge EMC?

  By cfheoh | December 11, 2012 - 6:36 am | Data, Dell, EMC, Fibre Channel, Fujitsu, HDS, HP, IBM, IDC, iSCSI, NetApp, NFS, Object Storage, Oracle, Storage Market Share, Unified Storage
5 Comments

It’s been a busy, busy month for me.

And when the IDC Worldwide Quarterly Disk Storage Systems Tracker for 3Q12 came out last week, I was reading in awe how impressive EMC was at the figures that came out. But most impressive of all is how the storage market continue to grow despite very challenging and uncertain business conditions. With the Eurozone crisis, China experiencing lower economic growth numbers and the uncertainty in the US economic sectors, it is unbelievable that the storage market grew 24.4% y-o-y. And for the first time, 7,104PB was shipped! Yes folks, more than 7 exabytes was shipped during that period!

In the Top 5 external disk storage market based on revenue, only EMC and HDS recorded respectable growth, recording 8.7% and 13.8% respectively. NetApp, my “little engine that could” seems to be running out of steam, earning only 0.9% growth. The rest of the field, IBM and HP, recorded negative growth. Here’s a look at the Top 5 and the rest of the pack:

HP -11% decline is shocking to me, and given the woes after woes that HP has been experiencing, HP has not seen the bottom yet. Let’s hope that the new slew of HP storage products and technologies announced at HP Discover 2012 will lift them up. It also looked like a total rebranding of the HP storage products as well, with a big play on the word “Store”. They have names like StoreOnce, StoreServ, StoreAll, StoreVirtual, StoreEasy and perhaps more coming.

The Open SAN market, which includes iSCSI has EMC again at Number 1, with 29.8%, followed by IBM (14%), HDS (12.2%) and HP (11.8%). When combined with NAS numbers, the NAS + Open SAN market, EMC has 33.5% while NetApp is 13.7%.

Of course, it is just not about external storage because the direct-attached storage numbers count too. With that, the server vendors of IBM, HP and Dell are still placed behind EMC. Here’s a look at that table from IDC:

There’s a highlight of Dell in the table above. Dell actually grew by 4.0% compared to decline in HP and IBM, gaining 0.1%. However, their numbers seem too tepid and led to the exit of Darren Thomas, Dell’s storage group head honco. News of Darren’s exit was on TheRegister.

I also want to note that NAS growth numbers actually outpaced Open SAN numbers including iSCSI.

This leads me to say that there is a dire need for NAS technical and technology expertise in the local storage market. As the adoption of NFSv4 under way and SMB 2.0 and 3.0 coming into the picture, I urge all storage networking professionals who are more pro-SAN to step out of their comfort zone and look into NAS as well. The world is changing and it is no longer SAN vs NAS anymore. And NFSv4.1 is blurring the lines even more with the concepts of layout.

But back to the subject to storage market, is there no one out there challenging EMC in a big way? NetApp was, some years ago, recorded double digit growth and challenging EMC neck-and-neck, but that mantle seems to be taken over by HDS. But both are long way to go to get close to EMC.

Kudos to the EMC team for damn good execution!

HUS VM is not virtual storage appliance

  By cfheoh | October 16, 2012 - 10:40 am | EMC, Fibre Channel, Filesystems, HDS, IBM, Object Storage, RAID, Unified Storage
2 Comments

I was very confused with an recent HDS announcement, and it has been at the back of my mind for several weeks now.

On the last week of September 2012, HDS announced their Hitachi Unified Storage VM, aimed at small/medium enterprises (SMEs). Nothing wrong with that, except the VM part. I am not sure if it was the Computerworld author’s mistake, but he specifically mentioned VM as “virtual machine”. Check out the link here and the screenshot below:

It got me a bit riled up thinking this was some kind of virtual storage ala VMware Virtual Storage Appliance or NetApp ONTAP-V or even the early innovation of HP Lefthand Virtual SAN Appliance. Apparently not!

I did some short investigation and found Nigel Poulton’s blog which gave a fantastic dissection about the HUS VM. The VM is not virtual machine, but Virtual Midrange!

The HUS VM architecture is deep in ASICs, given HDS long history in ASICs design and manufacturing. SiliconFS, is the NAS front end, while the iSCSI and FC part are being serviced from the same HDS microcode of the higher end HDS VSP. Here’s a look at the hardware architectural diagram from Nigel’s blog:

There are plenty of bells and whistles in the HUS VM, armed with plenty of 8Gbps FC ports, SAS 6Gbps backend, SSDs, and software such as Dynamic Provisioning (thin provisioning) and Dynamic Tiering.

(more…)

The reports are out!

  By cfheoh | June 10, 2012 - 7:43 am | Apple, Dell, EMC, Gartner, HP, IBM, IDC, NetApp, Oracle, Steve Jobs, Storage Market Share, Unified Storage
1 Comment

It’s another quarter and both Gartner and IDC reports on disk storage market are out.

What does it take to slow down EMC, who is like a behemoth beast mowing down its competition? EMC, has again tops both the charts. IDC Worldwide Disk Storage Tracker for Q1 of 2012 puts EMC at 29.0% of the market share, followed by NetApp at 14.1%, and IBM at 11.4%. In fourth place is HP with 10.2% and HDS is placed fifth with 9.4%.

In the Gartner report, EMC has the lead of 32.5%, followed by NetApp at 12.7% and IBM with 11.0%. HDS held fourth place at 9.5% and HP is fifth with 9.0%. (more…)

“I want to put in my own hard disk”

  By cfheoh | May 20, 2012 - 5:45 pm | Disks, Filesystems, Joyent, Nexenta, Solid State Devices, Unified Storage, VMware
3 Comments

“I want to put in my own hard disk“.

If a customer ever utter that sentence, it will trigger a storage vendor meltdown. Panic buttons, alarm bells, and everything else that will lead a salesman to go berserk. That’s a big NO, NO!

For decades, storage vendors have relied on proprietary hardware to keep customers in line, and have customers continue to sign hefty maintenance contracts until the next tech refresh. The maintenance contract, with support, software upgrades and hardware spares replacement, defines the storage networking industry that we are in. Even as some vendors have commoditized their hardware on the x86 platforms, and on standard enterprise hard disk drives (HDDs), NICs and HBAs, that openness and convenience of commodity hardware savings are usually not passed on the customers.

It is easy to explain to customers that keeping their enterprise data in reliable and high performance storage hardware with performance optimization and special firmware is paramount, and any unwarranted and unvalidated hardware would put the customer’s data at high risk.

There is a choice now. The ripple of enterprise-grade, open storage kernel and file system has just started its first ring, and we hope that this small ripple will reverberate across the storage industry in the next few years.

(more…)

Linking Apple to SAN

  By cfheoh | March 30, 2012 - 5:57 am | Apple, Promise Technology, Unified Storage
3 Comments

Serendipity is what I would describe this encounter. I was introduced to Promise Technology Channel Sales Director early this week. When I saw his face, I realized that I already knew him, a Malaysian who previously worked at EMC in Taiwan, but has been residing in that country for many years. We laughed and joked like old buddies and hence, the story begins …

I have known of Promise through its popular VTrak storage, which many Apple users here ignorantly associate as an Apple product. Here it is, appearing on Apple’s website:

Yes, that’s the 3rd picture from your left.

Another very strong Apple product from Promise Technology is Pegasus, a storage line of direct-attached storage (DAS) sporting the Thunderbolt, a very fast interface that connects peripherals to Macs through its Mini DisplayPort. I found this strange having a graphics display port being used to connect to a storage device, but as I looked deeper into Thunderbolt, I found that the technology was meant to extend the PCIe bus with the DisplayPort into a conduit that delivers high throughput serially. Impressive!

The picture below shows the Thunderbolt link connections, in which
Intel will provide two types of Thunderbolt controllers, a 2 port type and a 1 port type.

But Thunderbolt is not a network-based technology. It is channel-based, and hence, connecting to a Fibre Channel SAN is like mixing oil with water. Apple is not known for accessing storage through Fibre Channel, and since Apple products do not have a Fibre Channel interface, Promise Technology has come up with Thunderbolt to Fibre Channel converter. They call it SANLink. And the picture below shows how it is done:

The SANLink can also be daisy-chained. In the example below, the Pegasus DAS is daisy-chained to a SANLink which then extends and expands its capacity from the Fibre Channel connected VTrak Ex30 or Ex10.

The connectivity can be 8Gbps for the VTrak Ex30, and 4Gbps for the Ex10, and it has been validated to work with MacOS X, Final Cut Studio and Apple’s Xsan.

This is targeted to the Apple’s presence in the video editing and video production environment. I have 1 customer using our storage for their Apple file sharing purpose, and I realized that these guys work in isolation most of the time. They are like a sheep-shearing house, taking one job, work on it a bit and then pass it on to another colleague for the next stage in the video production process. Sharing is clearly not well known in this type of environment. And Promise wants to change that by opening to those hermit-like video editors and producers to share and collaborate in their work.

I don’t know much about other vendors besides Apple that pushes the Thunderbolt technology. It is very high performance interface, capable of delivering 20Gbps but I am afraid that Thunderbolt may suffer from the Apple-only syndrome.

Apple tend to be very cutting-edge when it comes to most technologies that go into their products. That makes Apple high risk takers, and that puts Thunderbolt into that risky category when if Apple fails, Thunderbolt fails. So far, I have not seen Thunderbolt spreading like wildfire, but opening Apple to SAN, both iSCSI and Fibre Channel, is good. It is time Apple embrace more of the storage networking technologies and standards out there, rather than being steadfast with their proprietary implementation of storage. Apple File Protocol (AFP) and Thunderbolt (for now) comes to mind. It is good to be stubborn but …

A wizer IBM

  By cfheoh | October 20, 2011 - 9:18 pm | IBM, Unified Storage
Leave a comment

A couple nights ago, IBM launched a slew of new storage technology updates and a new cloud service called SmartCloud Enterprise, which incorporates some cloud technology from Nirvanix.

There were updates to IBM XIV, SVC, SONAS and also the DS8800 and the announcement reached us with a big bang. One of the notable updates that caught my eye was IBM Storwize V7000. When IBM first acquired Storwize in 2010, their solution was meant to be a compression engine in front of a NAS storage. And it pretty much of that for a while, until the new Storwize V7000.

The new Storwize V7000 is now a Unified Storage array, a multiprotocol box that IBM has quoted to compete with EMC VNX series. In the news, the V7000 has the block virtualization code from the IBM SVC, files support, a file distribution policy engine called ActiveCloud, and also included remote replication (Metro & Global Mirror), automatic storage tiering (EasyTier), clustering and storage virtualization as well. It also sports a new user interface inherited from IBM XIV’s Gen3 GUI that can manage both files and blocks.

The video below introduces the V7000:

While IBM is being courteous to NetApp (NetApp FAS series are IBM’s N-Series) by saying that their cannons are pointed towards EMC’s VNX, one cannot help to question the strong possibility of the V7000 hurting N-series sales as well. NetApp could see this relationship sailing choppy waters ahead.

To me, the current IBM storage technology lineup is staggered. It is everything to everyone, and there are things that are in need of sharpening. HDS has certainly made great leaps getting their act together and they have gained strong market share in the past 2 quarters. Dell and HP have not been so good, because their story just don’t gel well. It’s about time IBM get going with their own technology, and more importantly consolidate their storage technology lineup into a more focused strategy.

This is a great announcement for IBM and they are getting wizer!