from being killed by flash SSDs - the high-end RAM SSD market grew in
then again in 2011"
says editor Zsolt
"Every time the
PCIe flash SSD market
sells another 50 to 100 cards to accelerate a bunch of user servers - that
creates a new demand
which may one day be cleared only by RAM SSDs."
the enterprise SSD market - which used to be 100% RAM based 10 years ago -
overwhelmingly dominated by flash. Reports from SSD vendors suggest
2012 - RAM SSDs and
RAM cache in flash
SSDs probably accounted for no more than 1 to 2% of all
enterprise SSD capacity.
SSDs aren't fast enough!|
|RAM based SSDs are the
original type of
solid state disk and have
been around for
They rely on batteries to retain data
when power is
lost. Most models also include internal
hard disk drives to
which data is saved under battery power, so that data is not lost when the
battery runs down. This hybrid technology means that RAM based SSDs are more
and RAM SSDs are unable to operate in the same range of
RAM based SSDs are mostly used in enterprise server speedup
applications. The fastest RAM SSDs are faster than the fastest
flash SSDs. But
for many server speedup applications flash SSDs are fast enough.
flash SSDs, RAM based SSDs never had restrictions on the number of write
cycles. That made them more popular in enterprise acceleration applications in
the past. But write
endurance problems may be a thing of the past for flash.
disks - RAM SSDs have symmetric read/write IOPS. That's another big
RAM and flash SSDs.
The fastest flash SSDs available in 2009 had
achieved parity between random read and write IOPS.
But that's not how
transaction based applications work. The important differentiator here is repeat again write
IOPS. If you compare that between RAM and flash based SSDs - the RAM
SSDs are upto 100x faster - even when the datasheets suggest they look
On the other hand - in some enterprise applications - like
IPTV servers - the
random write IOPS rarely repeats in the same memory space during milli-second
timeframes - and in these video server apps - flash really does perform as well
as RAM - and is much cheaper.
Latency figures quoted by many flash SSD
products can also look very similar to those for RAM SSDs. But low random write
latency doesn't mean that the data has actually hit the flash media yet - as
you'll find if you try to read back the data and rewrite to the same block.
are also some non volatile memory products such as
FRAM and RRAM which are replacing flash in industrial applications - and
which already offer 1 to 1 read/write performance. But their capacity is 2
orders of magnitude too low to be of use in server applications.
SSDs cost about 3x as much as SLC flash SSDs for similar capacity in FC
SAN rackmount systems - (based on pricing data 2011.)
choice of SSD depends on the specific server and application environment and
cost / benefit analysis.
Not everyone needs or can afford the
fastest SSDs. Some
environments do. Others don't.
Identifying the right choice of SSD in
the right place is a complex decision - which requires a high degree of
SSD education and
trust in the vendor.
More articles about the problems and solutions
related to accelerating enterprise server apps can be seen on the
SSD ASAPs page.
|how fast can your SSD run
|Editor:- April 20, 2012 - StorageSearch.com today published
a new article which looks at the
11 key symmetries in
SSDs are complex devices and there's a lot of
mysterious behavior which isn't fully revealed by
vendor's product datasheets and whitepapers. Underlying all the important
aspects of SSD behavior are asymmetries which arise from the intrinsic
technologies and architecture inside the SSD.
Which symmetries are
most important in an SSD? - That depends on your application. But knowing
that these symmetries exist, what they are, and judging how your selected SSD
compares will give you new insights into SSD
no such thing as - the perfect SSD - existing in the market today - but
the SSD symmetry list helps you to understand where any SSD in any memory
technology stands relative to the ideal. And it explains why deviations from the
ideal can matter.
flash SSDs decision tipping point|
|Editor:- in December 2010 - I interviewed Jamon Bowen,
Director of Sales Engineering for Texas Memory Systems
and asked him about the use of SSDs in financial applications like banks and
traders - a market which he said accounts for most of their RAM SSD sales.
The company which started in RAM SSDs
over 30 years
ago - now sells more flash SSDs than RAM SSDs (even though the product
brand for both types of SSD is
RamSan.) Bowen said that flash is 70% of their business.
Bowen said that in many bank applications RAM SSDs are actually cheaper than
flash - because of the small size of the data. TMS still sell a lot of 16GB RAM
Production bank systems are typically shared by many hosts and
get a lot of write IOPS / capacity. To achieve the same
provisioning which would drive the cost up.
He suggested a simple
rule of thumb for intensive IOPS bank SSDs on the SAN
- < 128GB capacity - RAM SSDs cheaper
- 128GB to 4TB capacity - middle ground could be either - or determined by
Jamon Bowen said that the analysis
side of operations in banks is different. That tends to have much larger data
sets and is more read than write intensive. In these apps - flash SSDs are
usually more economic.
- > 4TB - flash SSDs cheaper
|McObject shows in-memory database resilience
Editor:- October 9, 2013 - what happens if you pull out
the power plug during intensive in-memory database transactions? For those
who don't want to rely on batteries - but who also need ultimate speed - this
is more than just an academic question.
Recently on these pages I've
been talking a lot about a new type of
SSDs which are hoping to break into the application space owned by
PCIe SSDs. But another
solution in this area has always been DRAM with power fail features which save
data to flash in the event of
loss. (The only disadvantages being that the memory density and cost are
constrained by the nature of DRAM.)
products include in-memory database software) yesterday
published the results of
benchmarks using AGIGA
Tech's NVDIMM in which
they did some unthinkable things which you would never wish to try out for
yourself - like rebooting the server while it was running... The result?
Everything was OK.
"The idea that there must be a tradeoff
between performance and persistence/durability has become so ingrained in the
database field that it is rarely questioned. This test shows that mission
critical applications needn't accept latency as the price for recoverability.
Developers working in a variety of application categories will view this as a
breakthrough" said Steve Graves,
Here's a quote from the whitepaper -
Persistence, Without The Performance Penalty (pdf) - "In these tests
eXtremeDB's inserts and updates with AGIGA's NVDIMM for main memory storage
were 2x as fast as using the same IMDS with transaction logging, and
approximately 5x faster for database updates (and this with the
transaction log stored on RAM-disk, a solution that is (even) faster than
storing the log on an SSD). The possibility of gaining so much speed while
giving up nothing in terms of data durability or recoverability makes the IMDS
with NVDIMM combination impossible to ignore in many application categories,
including capital markets, telecom/networking, aerospace and industrial
Editor's comments:- last year McObject
published a paper showing the benefits of using PCIe SSDs for the transaction
log too. They seem to have all angles covered for mission critical ultrafast
databases that can be squeezed into memory.
SMART samples ULLtraDIMM SSDs
Editor:- August 8, 2013
- SMART Storage
it has begun sampling the first memory channel SSDs compatible with the
interface and reference architecture created by Diablo Technologies.
first generation enterprise
(ULL = ultra-low latency) can be deployed via any existing DIMM slot and
provides 200GB or 400GB of enterprise class flash SSD memory with upto 1GB/s and
760MB/s of sustained read/write performance, with 5 microseconds write latency.
Throughput, IOPS and memory capacity all scale with the number of ULLtraDIMM
deployed in each server.
comments:- With the current design -only one DIMM slot in each server has to
be reserved for conventional DRAM. Apart from that constraint any DIMM slot can
be used for either flash or DRAM as deemed necessary for the application.
more about the potential of this technology, the thinking behind it and the
competitive landscape relative to
PCIe SSDs etc see my
earlier articles on the
in memory database even better with FIO's flash
November 20, 2012 - McObject
recently released new
benchmark results which indicate that the in-memory database company is not
so unfriendly to flash SSDs as you may have thought from reading earlier
company positioning papers.
It seems that a software product - which
was originally designed for the DRAM-HDD world - is a good fit in the flash SSD
world too - if you have the right scale of data and the right SSD. ...read more
Micron sources power holdup technology for NVDIMMs
November 14, 2012 - Micron
has signed an agreement
with AgigA Tech
to collaborate to develop and offer nonvolatile DIMM (NVDIMM) products using
AgigA's PowerGEM (sudden power loss
controller and holdup modules).
STEC discloses RAM vs flash SSD revenues
November 7, 2012 - among other things STEC revealed
yesterday in its earnings conference call that RAM SSDs were approximately 4%
of its revenues in the recent quarter.
AMD will rebrand Dataram's RAMDisk software
September 6, 2012 - Dataram
it will develop a version of its RAMDisk software which will be rebranded
by AMD in Q4 under the name of Radeon
RAMDisk and will target Windows market gaming enthusiasts seeking (upto 5x)
faster performance when used with enough memory. See also:-
Kaminario recommends you read SSD Symmetries article
June 15, 2012 - I accidentally discovered today that earlier this week Gareth Taube,
VP of Marketing at Kaminario
published a new blog
in which he recommends my article about
says "Flexibility, such as being able to integrate multiple memory
technologies into a single box (like Kaminario's K2-H), is going to be
increasingly important to customers who want efficiency and customization
options. This is especially true because there are many memory innovations
coming on the near horizon." ...read Gareth's blog
comments:- when I was writing the symmetry article one of the things I had in
mind to do was to put more examples in it. Then I realized that having lots of
examples would simply make the article unreadable.
One of the examples
I was going to use for good roadmap symmetry (but then forgot to put
anywhere) was in fact Kaminario - because they can leverage off whatever
Fusion-io does with
flash (or other nv memory)
and furthermore Kaminario can also leverage off whatever server makers do with
CPUs and RAM. Roadmap
symmetry is a long term consideration - important for big users who don't like
supplier churn and important for
VCs and investors too.
I'm glad I wrote that bit about "roadmap symmetry" - because by a
spooky coincidence - 3 days later we got the news that Kaminario's investors
still love what they do.
June 18, 2012 - Kaminario today
it has secured a $25 million series D round of funding, bringing its total
funding to $65 million.
sharpen your SSD R/W grid latency weapons to 5µS
May 9, 2012 - Kove
has published some
record latency numbers for its fast
RAM SSD - the XPD L2 -
which has achieved continuous and sustained 5 microsecond random storage read
and write when connected via 40Gb/s
from Mellanox .
Kove's system has good
which the company says - is not subject to periodic performance jitter or "periodicity".
Even under constantly changing disk utilization, it delivers uniform,
predictable, and deterministic performance.
"The Kove XPD L2... allows high performance applications to use
storage as a weapon rather than accept it as a handicap," said Kove's
Overton. "We are pleased to set a new bar height for storage
STEC's RAM SSDs percentage?
Editor:- February 28,
2012 - "Our DRAM-related products accounted for 3% of revenue"
said Raymond Cook, CFO, STEC - in the company's
Q4 2011 - earnings conference.
Fusion-io's 1 billion IOPS demo narrows latency gap between flash
and RAM SSDs
Editor:- January 6, 2012 - in a historic
yesterday showing the capabilities of its latency reducing Auto Commit
Memory (ACM) extension Fusion-io
announced it had exceeded 1 billion IOPS (64 byte data packets) in a
configuration which used 8 HP servers each configured with 8x
ioDrive2 Duo PCIe
Editor's comments:- although we're used to thinking about
SSD IOPS in terms of bigger packets - such as 4kB - instead of the very small
packet size in this demo -
IOPS is simply
a convenient and not always reliable way of comparing the relative
performance of storage products.
In real life - users don't have a
choice of what size the R/W operations are which take place in their apps. They
occur at all sizes (mostly smaller than 4kB) and when these R/W operations take
place in traditional storage architecture systems - which internally impose
their own restrictions on the minimum size of atomic data packets - that's where
latencies and performance become discontinuous compared to the value of the data
update due to amplification
and packetization effects.
In my view - the important thing about this
demo - is that the same PCIe SSD product which can perform useful work as a
storage device - can also be deployed as a super scaler memory device - when it
is running the appropriate software.
The difference is that with
traditional storage software - you might expect that a 64x PCIe SSD system might
hit 64M IOPS or some similar figure (regardless of the small size of the data
packet). Instead the demo shows that apps developers can get 16x more
performance in small R/W transactions if they are willing to invest the
effort to make their apps work with FIO's new APIs.
It's that order of
magnitude difference which is the attraction for some markets - because it
closes the gap in performance between
RAM SSDs and flash
SSDs. And when you can run apps 10x faster than other flash competitors at the
same price - or support 10x bigger data sets than competitors using RAM SSDs -
that create new markets. See also:-
sudden power loss|
|Why should you care
what happens in an SSD when the power goes down? |
This important design
feature - which barely rates a mention in most SSD datasheets and press releases
- has a strong impact on
SSD data integrity
This article will help you understand why some
SSDs which (work perfectly well in one type of application) might fail in
others... even when the changes in the operational environment appear to be
|sometimes you just can't wait|
|the Problem with
Write IOPS in flash SSDs |
|Random "write IOPS"
in many of the fastest
flash SSDs are now similar to "read IOPS" - implying a
performance symmetry which was once believed to be impossible.|
are flash SSD IOPS such a poor predictor of application performance? And why
are users still buying
RAM SSDs which cost an
order of magnitude more than SLC? (let alone
MLC) - even
when the IOPS specs look superficially similar?
tells you why the specs got faster - but the applications didn't.
||And why competing SSDs with
apparently identical benchmark results can perform completely differently.