Our Latest Online Backup Reviews:Vembu SyncBlaze
Industry LinksTools and Graphs
HPC End Users Identify Mixed I/O as the Most Difficult Performance Problem to Solve and Burst Buffers Cited as the Most Likely Technology to Take Storage to Exascale Levels
SANTA CLARA, Calif. – November 12, 2015 — /BackupReview.info/ — DataDirect Networks (DDN) today announced the results of its annual High Performance Computing (HPC) Trends survey, which showed that HPC end-users view data storage as the most strategic part of the HPC data center and that managing mixed I/O performance and rapid data growth remain the biggest challenges for HPC organizations going into 2016.
Conducted by DDN for the third consecutive year, the survey polled a cross-section of end-users managing data intensive infrastructures worldwide representing hundreds of petabytes of storage investment. Respondents included individuals responsible for high performance compute, networking and storage systems from Financial Services, Government, Higher Education, Life Sciences, Manufacturing, National Labs and Oil & Gas organizations. The data under management in each of these organizations is staggering!
Of organizations surveyed:
Storage is the fastest growing segment in IT spending in HPC1, and according to an overwhelming majority of survey respondents (77 percent) data and data storage has now become the most strategic part of the HPC data center as end-users seek to solve data access, workflow and analytics challenges to accelerate time to results.
Tweet This: Mixed I/O is No. 1 #BigData challenge; Data #storage deemed Most Strategic by #HPC in @DDN_Limitless customer survey http://bit.ly/1Pp9RLd
The diverse set of applications driving this ever growing data in large scale environment and analytical workflows places rigorous demands on storage infrastructures and creates unique challenges for HPC users. As the graph below highlights:
As shown below, more than half of respondents (56 percent) identify storage I/O as the main bottleneck in analytics workflows.
These responses illustrate how performance issues have surged as Big Data environments grapple with a proliferation of diverse applications creating mixed IO patterns and stifling the performance of their storage infrastructure.
Only a small percent of respondents believe today’s file systems and data management technologies will be able to scale to Exascale levels, while almost 2/3 of respondents believe new innovation will be required. This belief is exemplified in respondents’ views on addressing performance issues:
Given the intense performance requirements of HPC environments as well as security, data access, workflow management and cost considerations, it is not surprising that according to 75 percent of those surveyed, security and data sharing complexity remain the largest impediments to increased collaboration across sites. This concern is underscored by respondents’ overwhelming preference for private clouds:
With storage performance a critical requirement for today’s large scale and petascale-level data centers, site-wide file systems like those at Oakridge National Lab (ORNL), National Energy Research Scientific Computing Center (NERSC) and Texas Advanced Computing Center (TACC) continue to be a significant infrastructure trend in HPC environments, according to more than two-thirds (67 percent) of HPC customers polled. Site-wide file systems allow architects to either consolidate multiple computers on the same system and/or provide the flexibility to upgrade storage and servers as needed.
“The results of DDN’s annual HPC Trends Survey reaffirms the key issues and requisite requirements we hear from HPC users regularly. Handling mixed I/O workloads and resolving I/O bottlenecks in data intensive workloads are critical issues DDN has worked fervently to address within our suite of high performance end-to-end solutions,” said Molly Rector, CMO, executive vice president product management and worldwide marketing, DDN. “Survey respondents were clear that data storage has become the most strategic part of the data center, and users rely on DDN to deliver continued technology innovation that enables research and business organizations to accelerate strategic insights and to speed time to results. DDN remains committed to the relentless innovation that raises the bar to meet the surging I/O performance, scale, content distribution and collaboration demands of high performance computing – in ways that are faster, smarter, more efficient and more cost effective than anyone else in the market.”
Upcoming SC15 Conference
1 Intersect360 Research. “Worldwide High Performance Computing 2014 Total Market Model and 2015–2019 Forecast“, June 2015.
©2015 All rights reserved. DDN Storage, DDN, SFA, and SFA7700X are trademarks owned by DataDirect Networks. All other trademarks are the property of their respective owners.
IGNITE Consulting, on behalf of DDN
General Tags: SaaS, data storage, CEO interviews, top rated online backups, software as a service, online backup, online file storage, online backup services, online backup providers directory, data security, online backup news, online data backup, cloud computing, online backup reviews, compare online backups, online backup companies, online file backup, backing up online
Like us on Facebook
Sponsored Links:Data Deposit Box Asigra Bacula Systems