|can memory do more?|
June 17, 2016 - When all storage is memory based - are there new design
techniques which can push back the boundaries of what memory can do?
That was the catalyst for my new blog on StorageSearch.com -
Should we set
higher expectations for memory systems?
All the marketing noise
coming from the DIMM wars market (flash as RAM and Optane etc) obscures some
important underlying strategic and philosophical questions about the future of
SSD. Can we think of software as a heat pump to manage the entropy of
memory arrays? (Nature of the memory - not just the heat of its data.)
we be asking more from memory systems? ...read the blog
We just made the first tri-state DRAM chip in the world
June 2, 2016 - In his recent linkedin note -
chip gonna rock the DRAM industry - Wayne Zhang,
President and CEO at Encrip
enthuses about his company's new tri-state DRAM technology which he says
can work with any standard process - even 10nm.
Wayne says - "For
the same capacity DRAM chip, with using our patented technologies, we could
reduce the memory array area up to 36%, we could reduce the power consumption up
to 40%, we could also increase the chip access speed." ...read
DIMM wars at battery scale - FLC from Marvell
May 12, 2016 - When thinking about
SSD / SCM DIMM
wars - most of the buzz in the past year has been focused on the impacts of
replacing DRAM with
flash at the
server and cloud
levels. But the same concepts can be applied (albeit with different
efficiency gains) at
the implementation level of battery powered embedded devices and wearables.
a recent blog -
Marvell FLC Redefines Main Memory - by Hunglin Hsu, VP
provides authoritative examples of the replacement ratios possible in a phone
A strategic lesson to guide future designers is that even
while getting a 50% power consumption reduction (due to flash as RAM) it
is also feasible to increase application performance at the same time because
the software can work with a larger memory capacity (due to the lower
cost of flash
Among other things Hunglin says - "With FLC, better
performance can be achieved by reporting to the operating system a larger than
physically implemented main memory. The operating system is thus less likely to
kill background apps, which is why the fast app switching is possible. The FLC
hardware does all the heavy lifting in the background and frees up the tasks of
the operating system." ...read
DRAM's indeterminate latencies and the virtual memory slider
Editor:- March 2, 2016 - in the new page blog on StorageSearch.com I cast an eye
on the latency specific defects in DRAM system behavior which are among
the many technology enablers of the emerging tiered memory / flash as RAM
We've been accustomed to think of DRAM as the simple
predictable latency memory (compared to
flash). But server
motherboard memory system latency hasn't improved for over 10 years. Memory
systems got bigger and bandwidth got faster but worst case latencies can
sometimes be worse than they used to be - due to interference effects caused
by complex data queuing patterns.
If you haven't noticed these
problems - congratulations!
It means you might not notice (or care)
when the virtual memory slider moves in the cheaper direction towards
memories like flash. ...read the
DRAM revenue declined sequentially in Q4 2015
February 15, 2016 - DRAMeXchange
today listed the top 6 DRAM brands in a
reporting that the global DRAM industry posted approximately $10 billion
revenue in Q4 2015 - about 9% down from the prior quarter.
also:- who does
storage market research?
Who'd want to buy a RAM company? - Micron's $3 billion
gamble on Inotera
Editor:- December 17, 2015 - Micron recently
a $3.2 billion transaction to complete its 100% share ownership of Inotera Memories.
comments:- Micron officially says this is about securing
RAM manufacturing capacity
- because Inotera supplies about a third of Micron's DRAM.
In an email
reply to a reader question at around this time (about Micron's 3DXPoint) I said
"I have never thought that 3DXPoint (if it was real) would
have any impact on the enterprise market in the next few years for
reasons I explained at the time. Flash based RAM replacements (from
SanDisk and others)
which use another memory tier will have the same effect on enterprise
DRAM revenue that SATA SSDs did on the 15K SAS HDD market. But much
sooner in 1- 2 years. At best 3DXPoint would have density
characteristics similar to what flash-as-RAM can already deliver now. And
flash is proven so it doesn't have to wait for a 2 year evaluation and
reliability assessment period before it can be used in servers. If 3DXPoint
was deliverable - its immediate applications would be limited to consumer
products where reliability is not important. There may be real products which
come out of the many alt nvms but in the short term these announcements
sound more like funding requests to keep the technology teams intact for
So why does Micron want more RAM capacity?
semi-serious interpretation might be - it's a poison pill. Who would want to
buy a RAM company? Except Micron which knows RAM.
interpretation is that - by paying a premium price for Inotera - Micron is
saying it is worth more too. We've seen this kind of huff and bluff many
times before in the storage market. It doesn't always follow that the valuations
On the other hand - it may be nothing to do with RAM at
It can be viewed as a convenient way of buying more
semiconductor wafer fab capacity in readiness for a market in which the SSD
ecosystem will be able to consume more memory than all the chip companies
It does take a little while to repurpose fabs from
making one type of memory to another - but it's not a big deal. The big deal is
knowing what SSDs the memories will wind up in.
beginner's guide to semiconductor memory boom-bust cycles
retiring and retiering RAM
Editor:- December 3, 2015-
Retiring and retiering RAM is one of the ideas discussed in my new home page
blog on StorageSearch.com -
the big SSD
ideas of 2015.
Netlist allies with Samsung to codevelop flash-as-RAM DIMMs
November 19, 2015 -
how it's going to enter the storage class memory SSD DIMM wars market. This by
way of a 5 year joint development and license with Samsung which also
brings to the table $23 million of funding. The companies expect to sample
products in 2016.
2015 was a
signficant kick-start year for the server memory market.
retiering enterprise DRAM was one of the three big SSD ideas of the year.
DIMM wars in
SSD servers how significant is Memory1?
3D X-Point could shrink DRAM market by 1/3 in 5 years- says
Editor:- October 23 , 2015 - Coughlin Associates
has recently published a new
report on Emerging Non-Volatile Memory and Spin Logic (163 pages,
$4,000). The memories addressed in this report
(pdf) include PRAM, RRAM, MRAM, STT MRAM as well as the recently announced
3D X-Point Technology.
3D X-Point Technology will have a big impact
on DRAM growth (with DRAM
sales down $6.7 billion to $15.6 billion due to XPoint by 2020) with XPoint
revenues of $663 million to $1.5 billion by 2020.
MRAM and STT MRAM
revenue is estimated at $1.4 billion to $3.2 billion by 2020. Manufacturing
equipment revenue for MRAM and STT MRAM production is estimated to be between
$159 million and $294 million by 2020. See also:-
market research news,
SanDisk and HP ally in SCM DIMM wars
October 9, 2015 - SanDisk
and HP yesterday
a long-term partnership to collaborate on a new technology within the Storage
Class Memory category.
The companies say it will center around HP's
Memristor and SanDisk's ReRAM memory technology and manufacturing and design
Editor's comments:- In the summer
Micron established the
precedent that it's now OK to talk about futuristic memory roadmap intentions
as long as they include a big dollop of memory types which are less well known
that flash - because most of the press and business analysts treat it with just
as much seriousness as if you were talking about something which you can ship
This is part of the pre-shooting, phoney war about how the
industry is going to phase in a new level of big memory which from the software
point of view has similar R/W characteristics to RAM - but which from the
capacity point of view - is closer to flash than it is to DRAM. And in
competitive terms will work better than existing memory types in some types of
applications and not at all well in others.
SanDisk already has a good
view of the possibilities in this market via its ZetaScale software - which
provides big data RAM virtualization using any type of flash SSD. And
conversations with customers of its memory channel storage codeveloped with
Diablo - must have reinforced SanDisk's confidence in new uses for DIMMs.
(Although SanDisk's ULLtraDIMM is a flash based SSD - which can't do byte writes
in the same way that Memory1 can.)
So... what could HP bring to
this party for SanDisk?
You need a friendly bios
and platform and routes to market when you're trying to launch a new
Memristor? - This press release had to include
some kind of technology input from HP to make them feel better. If you had said
"toner cartridges" instead it would have been just as deliverable
today - except that everyone knows the printers are now going in a different
direction. Maybe the draft press release did have toner cartridges as the
placeholder and they just slipped that memory jibber jabber in at the last
minute before pressing send.
- "Low power is at the center of HP's ReRAM technology. HP's
presentation pointed out that a lot of the time and energy of computation is
used by the OS moving data between the various levels of the memory hierarchy
of existing computer architectures." - ReRAM
Forum (July 2014)
- "We're the world's largest purchaser of DRAM and the second largest
buyer of flash and (with Memristors) we're trying to disrupt and re-arrange our
supply chain" - said HP - reported in the article -
to replace flash and SSD in 2013 (October 2011) on Electronics Weekly
nvRAMs - state of the semiconductor market readiness
September 17, 2015 -
Gaps in the
memory hierarchy have created openings for new types of memory is a new blog
LaPedus, Executive Editor - Semiconductor
Engineering - which is flavored with some strong opinions from
Mark says - "after numerous delays, a new wave of
next-generation, nonvolatile memories are finally here. One technology, 3D NAND,
is shipping and gaining steam. And 3 others - Magnetoresistive RAM, ReRAM and
even carbon nanotube RAMs - are suddenly in the mix." ...read the article
Diablo aims to shrink enterprise DRAM market with flash as memory
August 12, 2015 - Diablo
has launched an assault on the enterprise server RAM market with the launch
of a new DRAM compatible emulation memory module called "Memory1"
which replaces DDR-4 DRAM
- with byte addressable flash.
In a new blog on StorageSearch.com
- DIMM wars in
SSD servers - how significant is Diablo's Memory1? I discuss the
potential impact of this technology and make some guesses about how Diablo
has managed to replace DRAM with flash. ...read the
data compression techniques in memory systems
May 26, 2015 - Inside the
SSD controller brain
the compressibility of data is one of the tools which can go into the mix of
optimizing performance, endurance and competitive cost.
A recent paper
Survey Of Architectural Approaches for Data Compression in Cache and Main Memory
Systems by Sparsh Mittal
and Jeffrey S. Vetter in
IEEE Transactions on Parallel and
Distributed Systems - reviews the published techniques available and places
their relevance in the context of real and future memory types and applications.
The survey covers applications from embedded systems upto supercomputers. In
addition to being useful resource directory of related papers the article
gives you a brief description of many compression techniques, where you might
use them and what benefits you might expect.
list of articles and
books by Sparsh Mittal which among other things covers caching
techniques, reliability impacts and energy saving possibilities in a wide
range of server architectures.
flash backed DIMMs - a new directory from StorageSearch.com
October 21, 2014 - Although StorageSearch.com
has been writing about flash
backed DRAM DIMMs since the first products appeared in the market - I didn't
think that subject was important enough before to rate a specific article or
market timeline page. (Unlike
SSDs - which became 1 of the top 10
viewed by readers after having had its own directory page since
However, sometimes a
market is defined as
much by what it isn't as by what it is.
And so - to help clarify the
differences between these 2 types of similar looking storage devices (one of
which I think is much more significant than the other - but both of which are
important for their respective customers) I have today created a directory
page for hybrid DIMMs
etc - which will act as the future pivoting point for further related
Samsung in volume production of 3D DDR4 RDIMMs
August 27, 2014 - Although the main interest in DDR4 RDIMMs - from an SSD
market perspective - will be in how that interface opportunity gets leveraged
channel flash SSDs - let's not forget that the motherboard slots - which
will enable that market - have been designed for
DRAM. So the DRAMs will
come first and are an important part of the countdown to the new DDR4 flash DIMM
In that context I'd like to mention that Samsung is today
celebrating "a new milestone in the history of memory technology" with
the announcement that the company is in volume production of the
industry's first 64GB DDR4
RDIMMs (DRAM) that use 3D "through silicon via" (TSV) stacked die
package technology and 20nm class die geometries.
Samsung says that
the new 64GB TSV module performs 2x as fast as a 64GB module that uses
conventional wire bonding packaging, while consuming approximately 1/2 the
Editor's comments:- Samsung describes this announcement as "historic"
and I was content to include that positioning statement in the news above -
because much of what Samsung has done in the past has indeed had historic
For more examples - see "Samsung
historic" which gives you search results from the
Diablo unveils DDR-4 flash DIMM SSDs
7, 2014 - Diablo
yesterday announced details of a new 2nd generation
SSD - low latency flash SSD accelerators in DDR-4 sockets - which will
sample to oems in the first half of 2015.
Along with the new hardware
technology there will be an improved software platform - with features like
NanoCommit - which Diable says will enable hundreds of millions of
transactions per second, with nanosecond latency.
comments:- After FMS - Diablo sent me
more info (pdf)
about their FMS
presentation (pdf) from which I have extracted these key features.
- Diablo's converged memory architecture (flash tiered with DRAM) is planned
to support 700 million random cachelines / sec.
- Latency of each cacheline is about 48 nanoseconds.
- Diablo's NanoCommit supports byte addressable small writes to flash with
high transaction rates and the ability to mirror the DRAM contents to
- The combination of technologies would enable something like a 1U server
with 25TB of converged memory.
AgigA Tech samples 1st DDR4 NVDIMM
6, 2014 - AgigA Tech
today announced that it is now sampling the industry's first DDR4 Nonvolatile
DIMM (NVDIMM) to key OEMs and development partners.
is there a market for I'M Intelligent Memory inside SSDs?
June 4, 2014 - Are there applications in the SSD market for DRAM chips which
integrate ECC correction inside the RAM chip - and which plug into standard
That was the question put to me this afternoon by Thorsten
Wronski - whose company MEMPHIS
Electronic AG distributes I'M Intelligent Memory in
Thorsten told me he's had a good reaction from the SSD
companies he's spoken to - which is why he phoned.
But in a long
conversation about the economics and architectures of end to end
in SSDs and the different
ratios of RAM cache
to flash in SSDs - I told him that my initial reaction was he should look
at embedded applications - which depend on the
reliability of a
single SSD - rather than enterprise systems in which the economics analysis for
arrays point to a system wide solution rather than a point product fix.
interesting thing is he said he's done tests on the new I'M memory as drop in
replacements for unprotected memory designs- in which he accelerated the likely
incidence of error events by increasing the interval between refreshes and
raising the temperature.
Here's what he said.
assembled a standard 1GB unbuffered DIMM with 8 chips of 1Gbit ECC DRAM. Then we
put this into a test board and ran RSTPro (a very strong memory test software).
No error found.
Next we put the whole board into a temperature chamber
at 95°C, which normally requires the refresh rate to be doubled (32mS
instead of 64mS). No error found.
Finally we wrote a software to change the refresh-register of the CPU
on the board, so we were able to set higher values. The highest possible was
750mS, so the DRAM did almost not get any more refreshes. Still it continued
working in RSTPro without a single error for 24 hours.
We tried the same with Samsung and Hynix modules, but none of them
came even close to those results. Most failed at refresh-rates of 150 to 200 mS,
which is not bad indeed. Many more tests will follow."
Editor's comments:- the reason I mention this - is because
adapting the refresh rate was one of the things mentioned in my recent blog -
Are you ready to
However - most of the leading SSDs in
don't have RAM caches for other reasons (to reduce the physical space, power
consumption, hold-up time, or because don't need the performance). So I told
Thorsten I don't see an industry wide demand inside SSDs. But some of you
might already have thought of applications.
I'M ECC DRAM product
big memory makers still need to recoup investments in flash and
DRAM before switching to newer technologies
Editor:- May 22, 2014 -
today published a new article -
Big Memory Shift
Ahead - which looks at the cost, scaling and other technical pressures on
legacy nand flash and DRAM which are the object of attack by other memory
"If these new memories really are as good as the
claims, why are we not seeing them in production applications today?" -
says Brian Bailey,
Technology Editor - Semiconductor
Engineering who wrote the article. "The answer appears to be inertia."
CEO of Intermolecular
expands on this by suggesting - "NAND flash is a $30B industry that has
tens of billions of dollars in capital infrastructure that would need to be
retooled. The big 4 players represent 95% of the market and they have a lot of
existing investment. The entire cost equation is CapEx, so they need to milk the
tail of the revenues as long as they can." ...read the article
Are you ready to rethink RAM?
Editor:- April 2, 2014
- We've all got used to the idea that a
revolutions has been playing out in the enterprise server market centered
around flash SSDs and - in that context - the developments in DRAM
technology have sounded reassuringly boring and predictable.
are you ready to
rethink enterprise DRAM architecture too?
The state of blue sky
thinking about enterprise DRAM - what is it really for? - and the changes
that could lead to - are discussed in a new blog on StorageSearch.com ...read the article
Samsung in volume production of 20nm DDR3 RAM
March 11, 2014 - 40 years ago in the
days of MOS LSI - whenever semiconductor companies like
Intel wanted to
characterize a new semiconductor production process and establish the "safe"
design rules for manufacturability at ever smaller chip geometries (aka "shrink")
the circuit and product of choice for the fab architects was memory - even if
the eventual product for the wafer fab was going to be a microprocessor.
recently - in the past few years - if you've been looking at all those "nm"
(nanometer) numbers in the news stories about IT related chips you can
hardly fail to have noticed that it's been the flash memory devices which have
been at the leading edge of the numbers. And when looking at production
devices - flash has been about 2 years in advance of DRAM and server CPUs.
often heard on these pages that it's only by
safe design rules used in preceding generations that interesting new SSDs
come to market.
And a big part of the to-do list for any
SSD controllers is to
cope with a predictable scale and style of expected memory defects and
virtualize them away - creating a usable base level storage device.
in line with this trend - Samsung today
it's using 20nm technology in the production of new 4Gb DDR3
way this pattern has been going in recent years is that the first volume uses
of new silicon geometries go into consumer markets - where if there's a data
upset - you can see something wrong happening (blue screen or freeze) turn the
power off and try things again. After several quarters of doing this - the chip
bakeries have finely tuned their recipes and are ready to guarantee a less
crumbly dough mixture for use in the enterprise.
- Samsung was doing volume production of 10nm flash (used in consumer
eMMC SSDs for mobile
phones) in November
But if these concepts
are new to you - it's not worthwhile memorizing them. Because
3D nand flash changes the
priority of future enhancements towards a preference for building upwards
in more layers instead of merely thinning sideways.
Virtium launches 32GB ULP RAM with industrial screening
February 26, 2014 - Virtium
new low profile 16GB and 32GB DDR3 RAM modules in these form factors -
ULP (Ultra-Low Profile) - 0.70" high and VLP (Very-Low Profile) - 0.738"
high - for use in dense embedded servers which need industrial temperature
operation in these form factors.
Editor's comments:- as with
- one of the differences in industrial memory is the screening process.
Virtium's memory blog
says that using 24 hour TDBI (Test During Burn-In) chambers can reduce early
failures up to 90%.
parity lost Sun its reputation for SPARC reliability
general principles of
improving electronic reliability by screening
Empirical Study of Memory Hardware Errors in a Server Farm (pdf)
Hybrid Memory Cube gets x2 speedup
25, 2014 - Although the market for Hybrid Memory Cube compatible
RAM has barely begun - a
new Gen2 specification was
today which doubles the fastest short-reach data performance (previously
15Gb/s) upto 30Gb/s. See also:-
what changed in SSD year 2013?
Editor:- December 9,
2013 - The important ideas in the SSD market seem to change every year. To
avoid making bad decisions you not only have to learn new SSD ideas
but you also need to identify which old SSD ideas to forget. That's
the theme of a new article on StorageSearch.com
changed in SSD year 2013?.
Micron samples 2GB HMC
Editor:- September 25, 2013 -
it's sampling the company's first implementation of the
Hybrid Memory Cube (high
density chip stacking architecture
standard) which was
launched in October
(short reach) HMC provides 2GB DRAM in a BGA - with upto 160 GB/s
More smoke than fire at SK Hynix memory plant
September 5, 2013 - Yesterday there was widely reported speculation about
the possible market impact of a fire at an SK Hynix memory plant
- which makes upto 15% of the world's
statement reported by Reuters the company said there was no material
damaage to the clean rooms and SK Hynix anticipated that supply volumes
would not be materially affected.
Editor's comments:- 3 weeks
ago it was
that 16nm flash from SK Hynix is the main memory building block in
Skyera's 1U half
DRAM technology won't advance soon - says Micron
August 20, 2013 - In recent years the SSD market has become nearly 100%
flash (and nv memory)
focused - with little or no mention of
DRAM based SSDs. The
reason is that nearly every company whose product line used to be mainstream
RAM SSD - has pulled out of that market or discontinued enhancements to those
products. Flash SSDs are more economic and easier to sell.
mean to say that the role of DRAM in SSD systems has entirely disappeared. It
still appears as a cache
or tier in many flash SSD arrays and the existence of some small percentage
of DRAM is assumed in SSD
and also in (flash based)
sent out a useful signal of where its own DRAM roadmap is going in
article yesterday in EETimes - which reports an interview with
Micron's president Mark
Adams who said - "There will be no new greenfield DRAM fabs for the
foreseeable future. We are hitting something of a lithography wall in DRAM where
shrinks are getting tougher and gains are not as attractive, so people are not
as financially motivated to invest in new fabs. Also we see planar DRAM advances
will end in the next 3 to 5 years, so you probably cannot get ROI in a new
planar fab." ...read
SMART samples ULLtraDIMM SSDs
8, 2013 - SMART
Storage Systems today
it has begun sampling the first memory channel SSDs compatible with the
interface and reference architecture created by Diablo Technologies.
first generation enterprise
(ULL = ultra-low latency) can be deployed via any existing DIMM slot and
provides 200GB or 400GB of enterprise class flash SSD memory with upto 1GB/s and
760MB/s of sustained read/write performance, with 5 microseconds write latency.
Throughput, IOPS and memory capacity all scale with the number of ULLtraDIMM
deployed in each server.
comments:- With the current design -only one DIMM slot in each server has to
be reserved for conventional DRAM. Apart from that constraint any DIMM slot can
be used for either flash or DRAM as deemed necessary for the application.
more about the potential of this technology, the thinking behind it and the
competitive landscape relative to
PCIe SSDs etc see my
earlier articles on the
Hybrid Memory Cube spec ready for chip designers
April 3, 2013 - back in
October 2011 - I
reported on this page the formation of a new industry
ORG - the Hybrid Memory Cube Consortium
- which could have an impact on future SSD packaging densities.
takes a while to get these things going - but according to
press release this week by one of the founding companies - Micron - the 100 plus
companies which are collaborating in this enterprise have agreed on an
A key feature of the new multiplane memory
architecture is that distributed memory controllers in an HMC module will
handle the data I/O packet requests for the bunch of stacked memory chips in its
own vault. This is similar to the distributed intelligent data mover concept
which is already used in all proprietary
SSD controller designs - because it's the only way you can get good
aggregated global system performance while also dealing with low level
local memory management issues at low latency.
As with earlier
generations of remote distributed memory interfaces - such as
InfiniBand - HMC is
designed to optimize the request of small packets - which in the case of HMC is
16 to 128 bytes of data.
With today's semiconductor speeds -
accessing the data in those distributed memory chips within the same HMC module
presents similar technical problems to distributed memory cards in traditional
computer designs - because traversing inches of physical space at high speed is
as difficult as moving data across tens of feet at slower speeds.
has been born as a DRAM
technology - but don't ignore it - just for that reason. (Or because the data
packet sizes are small compared to the block sizes in
nand flash.) If and when
these HMC packaging ideas result in viable products - the ideas and
methodologies will spill into SSDs too -regardless of what the underlying
memories used in SSDs may be at that time.
It's all about speed and
scalability. According to the HMC
faqs page - A single (1st generation) HMC unit can provide more than 15x
the bandwidth of a DDR3 module. See also:-
SSD interface glue chips.
Micron sources power holdup technology for NVDIMMs
November 14, 2012 - Micron
has signed an
agreement with AgigA Tech to
collaborate to develop and offer nonvolatile DIMM (NVDIMM) products using
AgigA's PowerGEM (sudden power loss
controller and holdup modules).
NEC Hitachi Memory dream ends in Elpida bankruptcy
Editor:- February 27, 2012 - Elpida today announced
it is reorganizing under the code of the bankruptcy laws in Japan.
comments:- The company's
press release (pdf)
relates a detailed history of problems starting in 2007 with the credit
crunch, over capacity, falling RAM prices, increasing strength of Yen etc.
The company - Japan's biggest surviving RAM maker - started out as NEC Hitachi
Memory in 1999 and changed its name to Elpida in 2000.
Elpida never got
into the SSD market. Now it looks like it never will.
A report in the
New York Times says -
bankruptcy filing is the biggest ever by a Japan-based manufacturer..."
Viking ships nv 8GB DDR3 DIMM
Editor:- October 18,
Viking Modular Solutions
said it is shipping
extension of their nv module range.
ArxCis-NV plugs into standard
RAM sockets and provides
2GB to 8GB RAM which is backed up to SLC flash in the
event of a
power failure - while the memory power is held up by an optional external
25F supercap pack. Viking says these new memory modules can eliminate the need
for battery backup units in servers and the maintenance logistics associated
with maintaining them. They are specified as being maintenance free for "5
years @ 60°C".
Editor's comments:- will these new
modules replace batteries in
RAM SSDs? - I doubt it
- because of scalability issues - like managing a spiderweb of 100+ dangly
bits of wire when you have a terabyte of RAM. Having said that - there are many
applications which only use a small number of memory chips which could benefit
from such a product.
Hybrid Memory Cube will enable Petabyte SSDs
October 7, 2011 - Samsung
and Micron this
week launched an new industry initiative - the Hybrid Memory Cube Consortium
- which will standardize a new module architecture for memory chips -
enabling greater density, faster bandwidth and lower power.
is unlike anything currently on the radar," said Robert Feurle,
Micron's VP for DRAM Marketing. "HMC brings a new level of capability to
memory that provides exponential performance and efficiency gains that will
redefine the future of memory."
Editor's comments:- HMC
may enable SSD designers to pack 10x more
RAM capacity into the same
space with upto 15x the bandwidth, while using 1/3 the power due
to its integrated power management plane.
The same technology will
enable denser flash SSDs too - if flash is still around in 3 years' time and
hasn't been sucked into the obsolete market slime pit by the
lurking nv demons
which have been shadowing flash for the past 10 years and been waiting for each
"next generation" to stumble and be the last.
management architecture integrated in HMC and the density scaling it allows
for packing memory chips (without heat build-up) are key technology enablers
which were listed as some of the problems the SSD industry needed to solve
in my 2010 article -
this way to the
| "Across the whole
enterprise - a single petabyte of SSD with new software could replace 10 to
50 petabytes of raw legacy HDD storage and still enable all the apps to run
much faster while being hosted on a shrunken population of SSD enhanced
|meet Ken and the
enterprise SSD software event horizon|
|Partial list of past and present RAM
manufacturers - mentioned in
storage news /
AGIGA Tech ,
Apacer Memory America,
ATP Electronics, Austin Semiconductor,
Avant North America,
Micro Memory Bank,
Ramaxel Technology ,
Rocky Mountain Ram,
Memory, Silicon Power
Micro Systems, Spansion,
Viking Modular Solutions,
White Electronic Designs,
Winbond Electronics ,
Z Tech International.
|when you need the fastest access|
|The new dominant focus and
center of gravity in large memory systems will be DIMM wars - which revisit long
held assumptions such as - what is memory? - where's the best place for it to
go? - and how much memory of each latency is best to have in each location?
(Given that multiple distinct memory and storage latencies have found viable and
enduring economic and architectural product classication silos already.)
|DIMM wars in SSD
servers - Memory1?|
|"We propose the design
and an implementation of a bulk parallel external memory priority queue to take
advantage of both shared memory parallelism and high external memory transfer
speeds to parallel disks. Our experimental results show that in the selected
benchmarks the priority queue reaches 64% of the full parallel I/O bandwidth of
SSDs and 49% of rotational disks, or the speed of sorting in external memory
when bounded by computation."|
|A Bulk-Parallel Priority Queue in
External Memory with STXXL (pdf)|
|"Among 129 DRAM
modules we analyzed (comprising 972 DRAM chips), we discovered disturbance
errors in 110 modules (836 chips). In particular, all modules manufactured in
the past two years (2012 and 2013) were vulnerable, which implies that the
appearance of disturbance errors in the field is a relatively recent phenomenon
affecting more advanced generations of process technology. We show that it takes
as few as 139K reads to a DRAM address (more generally, to a DRAM row) to induce
a disturbance error."|
Errors in DRAM - an Experimental Study (pdf) (2014)|
| "Our past work
showed that application-unaware design of memory controllers, and in particular
memory scheduling algorithms, leads to uncontrolled interference of applications
in the memory system." - said Onur Mutlu, Carnegie Mellon University.|
|Are you ready to
|RAM in a historic market
by Zsolt Kerekes,
|RAM - Random Access Memory
- is the fastest type of storage.|
It's implemented by silicon chips
which can contain upto thousands of millions of storage bits (gigabits)
connected in a randomly accessible array.
The "random access"
part of the RAM name was to differentiate RAM from other early types of
memory which had different interface characteristics. (Mostly block based - and
sometimes with the blocks having device dependent R/W timing and location
RAM was easier to write software for - even if it was
more expensive. So it became the preferred standard for software.
has equal (symmetric)
read and write access times (unlike
flash memory). Other
significant differences to flash are:-
- the data stored in a RAM is only maintained while the device is powered
up (is volatile)
- RAM doesn't suffer from write wear-out (endurance)
RAM products have different
designs and are optimized for various markets (such as servers, notebooks and
graphics cache) based on their speed, cost, interface and capacity.
- RAM is typically more expensive than flash for the same capacity, and
typically uses more electrical power. The exception is smaller capacity memories
inside a chip where the complexity of managing flash memory incurs more overhead
than the much simpler overheads in RAM.
has been the dominant type of random access memory from 1972 until today
(2015). That was because it offered lower cost and higher storage capacity than
competing memory types which had similar R/W characteristics.
period 2003 to 2015
many new types of randomly writable memory emerged (which used different on
chip storage characteristics). At various times these alternative memory types
claimed they would displace DRAM or flash. But they had no impact on the
revenue of the 2 dominant semiuconductor memory types.
If there was a
threat to DRAM upto 2015 - it didn't come from physical random access memory
Instead important lessons learned from virtualization
techniques (mostly arising from the
PCIe SSD market
experience from around
indicated that in large datacenters - a proportion of DRAM could be
functionally replaced by flash.
The intrinsic defficiencies of flash
(block write rather than byte write, and slower writes than reads) were capable
of being statistically offset most of the time by adding a new latency tier in
As flash cells had already surpassed DRAM cells
in terms of how many data bytes could be packed in a chip - this was an
approach which promised lower systems costs.
But it wouldn't provide
satisfactory performance for all applications and even when it could do so -
it would require significant investments in rewriting software.
the close of
entering a new age in the enterprise DRAM market in which 2 things will change
in the next 5 years.
- flash will continue to displace a proportion of DRAM in the enterprise
due to virtualization efforts and new
SSD software and also
by plug compative devices.
- some of the alternative physical random access memories are again being
hyped (by their advocates) as being nearly in a market readiness state to
compete with DRAM in server sockets on a cost basis.
news archive 2000 to 2015
circuit RAM timeline 1961 to 1998 (pdf)
|"...The RAM market faces
disruptive challenges from SSDs
- just as hard disks
have done. At some time during the next 5 years - most of the world's new
memory will be deployed inside an SSD or an SSD controlled loop. Owning an
SSD brand will be as important in the new market for memory makers as getting
designed into tier 1 server slots was in the past. Commercial RAM makers will
have to re-engineer themselves into SSD companies - or risk lower profit
margins from selling to SSD brands at spot market prices from outside the SSD
|...Editor:- talking to a market strategist in one
of the world's biggest seminconductor companies in June 2011.|
|"I'm often asked if I could foresee
how important (DRAM) would become," said Robert Dennard
(the inventor of DRAM) on receiving a lifetime achievement award in 2005.|
"I knew it was going to be a big thing, but I didn't know it would grow to
have the wide impact that it has today." ...read the