SAN JOSE, Calif. Storage gurus from IBM Corp. and EMC Corp. spent much of the Labor Day weekend debating the future of flash memory drives in servers and storage systems. In a candid online exchange, the two agreed flash drives will rewrite the rules for system storage, but took significantly different views on how to implement solid state disks in servers.
The debate launched late last week when IBM announced it had worked with startup Fusion-IO (Salt Lake City), a flash controller designer, to hit a sustained data transfer rate of more than one million I/O operations/second (IOPS) with a response time of less than a millisecond. The Fusion-IO controller uses PCI Express, unlike most flash drives that use the serial ATA interconnect popular on hard drives.
A senior IBM storage designer, Barry Whyte, posted a detailed description of the IBM work called Project Quicksilver. In his posting, Whyte took a few swipes at competitor EMC. Although EMC was early to call the significance of flash drives, it plugged SSDs from Step Inc. (Santa Ana, Calif.) into its existing systems rather than take IBM's approach of designing a more optimal platform for flash, Whyte said.
The posting attracted a mixture of kudos and criticisms from Barry Burke, chief strategy officer in the Symmetric group at EMC and an avid blogger on storage technology. "Congrats on the accomplishment, and thanks for joining in the efforts to make flash a commercial reality," wrote Burke.
However, he and other EMC technologists were also quick to probe some aspects of the IBM milestone. They noted that PCI Express cannot support the RAID features that typically provide storage redundancy, and they questioned whether the million IOPS could be sustained when all storage management features were in use.
EMC's Burke also noted that IBM has yet to fully describe the test system which uses more than eight processors. Although IBM has published performance from earlier tests updated in March, it has not been able to document the million IOPS milestone because it was achieved on an unreleased system.
IBM's Whyte admitted the Fusion-IO card does not support RAID. However, he said IBM has developed a version of its virtualization software that handles disk mirroring for flash controllers and allows hot swapping of cards if a failure occurs.
Whyte also admitted running all storage management features can slow performance and increase CPU use. However, he said the test system had plenty of processing overhead.
Both sides agreed that balancing the uneven read and write performance of flash drives is one of the challenges to integrating SSDs in servers. "There are ways to mitigate those [issues] with a little bit of old-fashioned innovation and some integration between the drive and the array microcode," wrote Burke.
In general, most companies are simply plugging SSDs into existing serial ATA interconnects buses for hard drives, Whyte noted. He said IBM, Intel and Sun are experimenting with using PCI Express and DIMM connections.
But the best approach is "to build a storage controller that is truly optimized for this game changing technology. That's what we have prototyped," he wrote.