Welcome!

SDN Journal Authors: Elizabeth White, Liz McMillan, Pat Romanski, Greg Schulz, Jerome McFarland

Related Topics: Containers Expo Blog, Java IoT, Microservices Expo, @CloudExpo, @BigDataExpo, SDN Journal

Containers Expo Blog: Article

SSD vs. HDD – The Battle for the Future of Storage

Look to the latest economically sensible storage solutions that are answering today’s performance and capacity calls

I have been working for technology companies for 33 years now, so I don't know why I'm always surprised at the technology myths that proliferate. For example, there is a popular notion running around that Solid State Drives (SSDs) will replace Hard Disk Drives (HDDs) as the dominant storage media. So, which will win? Let me give you my answer upfront before I take you through my arguments: both win, and the market size for both continues to grow.

As I offer up this data and this perspective, I'll repeat some advice I received early in my career. A mentor once told me, when searching for the truth in business and technology "look to the economics" (maybe my version of "go to the mattresses" for you "Godfather" fans).

Here is what I read and hear on a regular basis regarding the battle of HDDs and SSDs:

  • SSDs run circles around HDDs for performance
  • SSDs will soon replace HDDs
  • The improving density of SSDs will collapse the current cost premium to HDDs

Sound familiar? Well, as with most claims of this ilk, there are some elements of truth to them but each of these statements goes too far when viewed in light of some data.

Performance
Yes, it's true that SSDs are fundamentally faster than HDDs. This is particularly true of random I/O data reading (as with databases). With large block sequential data (i.e., rich media like video), however, this difference tends to be very small.

Replacing HDD?
Here's a claim where the data just doesn't add up. While the attractiveness of the SSD technology would lead one to believe this, the economics really don't hold up. I should probably point more specifically to NAND flash here (the "solid state" in SSDs) because another solid state technology might actually achieve this, but that appears to be years and tens of billions of dollars away.

Let's talk for a minute about the world's demand for storage. Last year approximately 2500 exabytes of data was created and/or replicated. And...this is doubling about every two years. This needs to be serviced largely by HDDs and SSDs. Last year, the NAND flash industry produced somewhere between 30 and 40 exabytes of storage; with somewhere around 3.5 exabytes finding its way into SSDs (the balance in phones, tablets, cameras, etc.). What is that, 1.4% of our total storage need? But production is ramping up... at a capital cost of about $1.5 billion per Exabyte (semiconductor fabs are expensive)! So, from an available supply perspective, SSDs replacing HDDs seems implausible.

Improving Technology Makes SSDs Cheaper
Agree. The NAND flash technology point is at 21nm line widths with plans to move to 19, then 16 nm. Storage density is further improving with the use of multi-level cell (MLC) capabilities vs single-level cell (SLC). This is bringing down the cost of solid state storage in much the same way the areal density increases seen in HDDs brought down the cost of hard drive storage.

Notice how I said "brought" down (i.e., past tense)? Because a real density growth in the hard drive industry has slowed to a crawl, the rapid erosion of cost/Gb has also slowed to a crawl. Now, the HDD industry needs to move to its next technology (HAMR?) to continue to take cost out and HAMR is a number of years away. HAMR will require significant capital investment by the HDD companies. Significant capital investment will be required anyway to keep up with storage demand (even more so with slowing areal density growth). This all spells out a flattening of HDD costs for the foreseeable future. Some would speculate that a renewed interest in improving the utilization of HDD capacity is an artifact of these economics.

Here's what's preventing the complete collapse of the price difference between the two technologies. The NAND flash suppliers have a similar problem as the HDD manufacturers... the implications of shrinking technology geometries. As the line widths shrink, the ability of flash to sustain multiple write-erase cycles declines. To make up for this deficiency, sophisticated error-correction algorithms and "brute force" overprovisioning (to allow some cells to wear out) are being used. This and the above mentioned semiconductor fab costs tend to mitigate the progress SSDs are making in closing the cost gap to HDDs.

Having made my arguments that SSDs won't take over the world, I have to say that IT solutions need this technology. I think you can see that SSDs aren't the answer to all our storage needs, but they allow us to address a crying storage requirement. At a high level, storage is called on to produce two key deliverables:

  • Make data available to an application or user in an appropriate timeframe (i.e., performance) and in today's environment this need is growing.
  • Store data reliably (i.e., capacity) and in today's environment this need is growing

By and large, to date, systems with hard drives have been architected to deliver both of these capabilities. It's hard to argue that hard drives haven't done a good job of delivering affordable capacity. But to deliver against the performance requirements of IT solutions, hard drives:

  • Have been developed with higher speeds, but arguably little progress has been made in the last ten years
  • Have been "short stroked" (a technique limiting the stroke of the actuator to improve performance)
  • Have been grouped together to allow striping of data across a large number of drives to aggregate their performance.

With each of these approaches the user suffers from higher power requirements, and with the last two approaches their system has been overprovisioned (leaving stranded capacity) to deliver performance. This all adds up to significant system cost that can be avoided with new storage architectures.

Here's where SSDs come in. SSDs are proving to be a technology answer to the new generation of storage needs, both the growing performance and the growing capacity requirements. Here's the simple, logical way to think about SSDs and HDDs and their role in storage solutions. Use the right tool for the job. That is, take advantage of SSDs for performance (particularly small block, random I/O) and HDDs for capacity.

You might challenge me now and ask, "Does adding SSDs (Flash) to IT solutions make economic sense?" SSDs are expensive, but, used appropriately, SSDs can also minimize the number of HDDs required in a given solution. The secret is in optimizing the use of both, that is, avoid overprovisioning of both. Thin provisioning of capacity has become popular as a cost saver. Similarly, thin provisioning of performance is a similar cost saver. (This is a benefit of virtualized caching or tiering capabilities of newer storage solutions.)

I'll close with a few proof points. Look to the latest economically sensible storage solutions that are answering today's performance and capacity calls. The vast majority of affordable "Ultrabooks" incorporate both flash and hard drive technology, as does Apple's latest "Fusion" drive.

More Stories By Tom Major

Tom Major is President of Starboard Storage. He joined Starboard from Seagate Technology, where he was senior vice president of Product Management and Business Operations. Before Seagate, Major worked at LeftHand Networks as chief strategy officer. Previous positions included vice president and general manager, Disk Business Unit, at StorageTek and vice president of Network Storage Marketing at HP, where he spent 21 years.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today the How to Create Angular 2 Clients for the Cloud Workshop, being held June 7, 2016, in conjunction with 18th Cloud Expo | @ThingsExpo, at the Javits Center in New York, NY. Angular 2 is a complete re-write of the popular framework AngularJS. Programming in Angular 2 is greatly simplified. Now it’s a component-based well-performing framework. The immersive one-day workshop led by Yakov Fain, a Java Champion and a co-founder of the IT consultancy Farata Systems and...
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in Embedded and IoT solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions® for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, HPC and ...
In his session at 18th Cloud Expo, Andrew Cole, Director of Solutions Engineering at Peak 10, will discuss how the newest technology advances are reducing the cost and complexity of traditional business continuity and disaster recovery solutions. Attendees will: Learn why having a full disaster recovery strategy is more important now than ever before Explore the key drivers of a successful disaster recovery solution Achieve measurable operational and business value from a disaster recovery ...
How will your company move to the cloud while ensuring a solid security posture? Organizations from small to large are increasingly adopting cloud solutions to deliver essential business services at a much lower cost. According to cyber security experts, the frequency and severity of cyber-attacks are on the rise, causing alarm to businesses and customers across a variety of industries. To defend against exploits like these, a company must adopt a comprehensive security defense strategy that is ...
SYS-CON Events announced today that Hanu Software will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Leveraging best-in-class people, processes, and technologies, Hanu provides high-quality, high-value software development and business process outsourcing services to independent software vendors (ISVs) and enterprises.
What a difference a year makes. Organizations aren’t just talking about IoT possibilities, it is now baked into their core business strategy. With IoT, billions of devices generating data from different companies on different networks around the globe need to interact. From efficiency to better customer insights to completely new business models, IoT will turn traditional business models upside down. In the new customer-centric age, the key to success is delivering critical services and apps wit...
Join us at Cloud Expo | @ThingsExpo 2016 – June 7-9 at the Javits Center in New York City and November 1-3 at the Santa Clara Convention Center in Santa Clara, CA – and deliver your unique message in a way that is striking and unforgettable by taking advantage of SYS-CON's unmatched high-impact, result-driven event / media packages.
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, will provide an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life ...
The initial debate is over: Any enterprise with a serious commitment to IT is migrating to the cloud. But things are not so simple. There is a complex mix of on-premises, colocated, and public-cloud deployments. In this power panel at 18th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists will look at the present state of cloud from the C-level view, and how great companies and rock star executives can use cloud computing to meet their most ambitious and disruptive business ...
SYS-CON Events announced today that MobiDev will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business managers to a full-scale mobile software company with over 200 develope...
SYS-CON Events announced today that BMC Software has been named "Siver Sponsor" of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. BMC is a global leader in innovative software solutions that help businesses transform into digital enterprises for the ultimate competitive advantage. BMC Digital Enterprise Management is a set of innovative IT solutions designed to make digital business fast, seamless, and optimized from mainframe to mo...
As cloud and storage projections continue to rise, the number of organizations moving to the cloud is escalating and it is clear cloud storage is here to stay. However, is it secure? Data is the lifeblood for government entities, countries, cloud service providers and enterprises alike and losing or exposing that data can have disastrous results. There are new concepts for data storage on the horizon that will deliver secure solutions for storing and moving sensitive data around the world. ...
SoftLayer operates a global cloud infrastructure platform built for Internet scale. With a global footprint of data centers and network points of presence, SoftLayer provides infrastructure as a service to leading-edge customers ranging from Web startups to global enterprises. SoftLayer's modular architecture, full-featured API, and sophisticated automation provide unparalleled performance and control. Its flexible unified platform seamlessly spans physical and virtual devices linked via a world...
SYS-CON Events announced today that ContentMX, the marketing technology and services company with a singular mission to increase engagement and drive more conversations for enterprise, channel and SMB technology marketers, has been named “Sponsor & Exhibitor Lounge Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York City, New York. “CloudExpo is a great opportunity to start a conversation with new prospects, but what happens after the...
Companies can harness IoT and predictive analytics to sustain business continuity; predict and manage site performance during emergencies; minimize expensive reactive maintenance; and forecast equipment and maintenance budgets and expenditures. Providing cost-effective, uninterrupted service is challenging, particularly for organizations with geographically dispersed operations.
The IoTs will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm and share the must-have mindsets for removing complexity from the development proc...
SYS-CON Events announced today TechTarget has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. TechTarget is the Web’s leading destination for serious technology buyers researching and making enterprise technology decisions. Its extensive global networ...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management...
Many banks and financial institutions are experimenting with containers in development environments, but when will they move into production? Containers are seen as the key to achieving the ultimate in information technology flexibility and agility. Containers work on both public and private clouds, and make it easy to build and deploy applications. The challenge for regulated industries is the cost and complexity of container security compliance. VM security compliance is already challenging, ...
The essence of data analysis involves setting up data pipelines that consist of several operations that are chained together – starting from data collection, data quality checks, data integration, data analysis and data visualization (including the setting up of interaction paths in that visualization). In our opinion, the challenges stem from the technology diversity at each stage of the data pipeline as well as the lack of process around the analysis.