IME14K Makes HPC and Big Data Cluster Behavior Far More Predictable While Delivering Significant Acceleration in Data-Intensive Applications

SANTA CLARA, Calif. – November 17, 2015 — / — DataDirect Networks (DDN), ) today announced a major advancement enabling high performance computing (HPC) and large scale data environments to break free from I/O bottlenecks that are slowing entire data-intensive infrastructures. Today, the performance demanded by applications and computing has outpaced the performance delivered by traditional storage technologies, creating storage and file system I/O bottlenecks. The DDN IME14K® breaks through these bottlenecks and optimizes mixed application workloads to deliver game-changing I/O acceleration for data-intensive environments.

Leveraging the new DDN 14K hardware platform and IME software technology, the new IME14K appliance optimizes and accelerates the read and write I/O path from compute to persistent storage.

  • IME14K Acceleration of the Compute Cluster. The IME14K acts as a burst buffer and optimizes the compute cluster performance as it allows more simultaneous application jobs to run, shortening the job queue and enabling significantly faster application run time for the user.
  • IME14K Acceleration Writing to the Persistent File Storage. As data is moved from the IME14K NVMe cache to persistent storage, the IME software dynamically reorganizes data into sequential writes, eliminating the latency, thrashing and slow write times created by the fragmented I/O patterns of demanding mixed workload applications leveraging a shared file system. This approach enables the NVMe cache to be offloaded significantly more quickly and helps to avoid the requirement of overprovisioning the file system to achieve the performance needed.
  • IME14K Acceleration Reading from the Persistent File Storage.An out-of-band API is provided for configuration of the IME appliance with job schedulers and to warm the cache and accelerate first read.

The DDN IME14K all-flash array takes advantage of DDN’s high-performance, hyper-converged 14K hardware platform, which delivers the NVMe cache on a local PCI-3 embedded fabric, driving low latency, full device performance to each of the NVMe-enabled SSD devices. Each IME14K can be configured to start with a small number of NVMe devices and scales up to 48 NVMe SSD in each 4u appliance. IME14K delivers an expected throughput starting at 10GB/sec for entry performance and scales up to 50GB/sec in each 4U appliance. The IME14K is designed to accommodate additional appliances being clustered to deliver thousands of GB/sec performance for the most data-intensive workloads on the globe. The IME14K is powered by the intelligence of DDN’s patented IME application and file system acceleration software that runs within the storage memory of the appliance on the embedded PCI-e fabric. With IME14K, large scale data-intensive environments now have the tools to leverage untapped compute cycles and are able to run more jobs, achieving application efficiency and performance by minimizing I/O bottlenecks and accelerating applications and file systems, while reducing the erratic performance often found in large scale, mixed application environments.

Users benefit from the IME14K acceleration capabilities as it:

  • Speeds time to results by accelerating workflows, applications and bottlenecked I/O;
  • Eases data growth by optimizing usage of storage systems; and
  • Increases compute ROI by eliminating I/O wait times and increasing the amount of time that can be utilized for computation.

Tweet This: New IME14K from @DDN_Limitless breaks I/O bottlenecks & delivers unrivalled performance and efficiency #HPC

The IME14K offers customers flexible scalability and the choice of several of the latest, and soon to be released, high-performance interconnects, including: InfiniBand® EDR, Omni-Path® and 100Gb/E. Dual servers, distributed erasure coding and real-time health monitoring increase reliability, availability and serviceability (RAS) and provide high-performance data cache with many of the same levels of protection as disk-based persistent storage tiers.

“Over the past few years the performance demanded by applications and computing has outpaced the performance delivered by storage technologies, creating storage system I/O bottlenecks. As speed and scale of environments and applications grow, the negative effects of I/O contention and latency are magnified. To combat this challenge, DDN’s IME14K is redefining the industry’s approach to data-intensive architectures and is enabling new levels of efficiency and capabilities, including higher utilization of compute, optimized use of storage hardware, and faster time to results in areas such as scientific and medical discovery, data analytics and market analysis,” said Molly Rector, CMO, executive vice president product management and worldwide marketing, DDN. “With IME14K, DDN is expanding on its mission to help solve the toughest challenges of Government Labs & Academia, the Enterprise and Web/Cloud organizations.”

The IME14K All-Flash Array appliance powered by IME software is available for limited shipments in fourth quarter 2015 and will be generally available in the first quarter of 2016.

Supporting Resources

  • More on DDN IME14K
  • DDN IME14K Product Brief
  • Early Customer Evaluation of IME Video
  • More on HPC Market Trends
  • More on DDN at SC15
  • More on DDN End to End Storage
  • More on DDN Big Data Platforms
  • More on DDN DDN Customers
  • Follow DDN via Blog and Twitter

About DDN
DataDirect Networks (DDN) is the world’s leading big data storage supplier to data-intensive, global organizations. For more than 15 years, DDN has designed, developed, deployed and optimized systems, software and solutions that enable enterprises, service providers, universities and government agencies to generate more value and to accelerate time to insight from their data and information, on premise and in the cloud. Organizations leverage the power of DDN technology and the deep technical expertise of its team to capture, store, process, analyze, collaborate and distribute data, information and content at largest scale in the most efficient, reliable and cost effective manner. DDN customers include many of the world’s leading financial services firms and banks, healthcare and life science organizations, manufacturing and energy companies, government and research facilities, and web and cloud service providers. For more information, go to or call 1-800-837-2298.

©2015 All rights reserved. DDN Storage, DDN, SFA, and SFA7700X are trademarks owned by DataDirect Networks. All other trademarks are the property of their respective owners.

Media Contacts:
Michael King
Sr. Director of Marketing
Work: 408-419-2892

IGNITE Consulting, on behalf of DDN
Linda Dellett, 303-439-9398
Kathleen Sullivan, 303-439-9365

Source: DDN