Digital Edition

SYS-CON.TV
100 Times More Bandwidth for Linux Clusters, from HP
100 Times More Bandwidth for Linux Clusters, from HP

HP today announced a breakthrough file sharing product that uses new Linux clustering technology to deliver up to 100 times more bandwidth than typical clusters. The new product, HP StorageWorks Scalable File Share (HP SFS), is a self-contained file server that enables bandwidth to be shared by distributing files in parallel across clusters of industry-standard server and storage components.

The product is the second based on HP's "storage grid" architecture and the first commercial research product to use a new Linux clustering technology, called Lustre, which was developed through collaboration between HP, the U.S. Department of Energy (DoE) and Cluster File Systems, Inc.

Targeted initially for high-performance computing (HPC), HP SFS allows applications to see a single file system image regardless of the number of servers or storage devices connected to it. Built using industry-standard HP ProLiant servers and HP StorageWorks disk arrays, HP SFS provides protection from hardware failures through resilient, redundant hardware and built-in fail-over and recovery.

Tuned for ease of use and manageability, the system can span dozens to thousands of clustered Linux servers, making it easier to run distributed applications for challenging science and engineering needs.

The Lustre protocol used in HP SFS is already running in some of the world's most demanding HPC environments, such as the one found at the DoE Pacific Northwest National Laboratory (PNNL). It helps to eliminate input/output (I/O) bandwidth bottlenecks and saves users hours of time copying files across hundreds or thousands of individual, distributed file systems.

The DoE selected HP to provide program management, development, test engineering, hardware and services to support the Lustre project. HP is the only major vendor to offer a supported and case-hardened Lustre-based file share product.

"HP's Lustre implementation on our supercomputer allows us to achieve faster, more accurate analysis," said Scott Studham, associate director for Advanced Computing, PNNL. "This translates into faster time-to-solution and better science for our researchers, who are addressing complex problems in energy, national security, the environment and life sciences."

Lustre technology has been in use at PNNL for more than a year on one of the 10 largest Linux clusters in the world. PNNL's HP Linux super cluster, with more than 1,800 Intel Itanium 2 processors, is rated at more than 11 teraflops (one teraflop equals one trillion floating point operations per second) and sustains more than 3.2 gigabytes per second of bandwidth running production loads on a single 53-terabyte Lustre-based file share. Individual Linux clients are able to write data to the parallel Lustre servers at more than 650 megabytes per second. The system is designed to make the enormous PNNL cluster centralized, easy to use and manage, and simple to expand.

Studham also noted that Lustre scales the high-bandwidth I/O needed to match the large data files produced and consumed by the laboratory's scalable simulations. HP has worked with PNNL to help ensure Lustre is reliable, stable and cost-effective. "We are confident in the Lustre file system's ability to prevent loss of data," said Studham.

The HP SFS servers are factory assembled, pre-configured, pre-cabled, pre-tested in clustered I/O racks, and ready to run the Lustre software with the HP SFS added-value installation, maintenance, monitoring and administration tools.

More information is available at www.hp.com/go/technicalstorage.

About Linux News Desk
SYS-CON's Linux News Desk gathers stories, analysis, and information from around the Linux world and synthesizes them into an easy to digest format for IT/IS managers and other business decision-makers.

In order to post a comment you need to be registered and logged in.

Register | Sign-in

Reader Feedback: Page 1 of 1

Can it print? my hp 7260 is a paper weight as of now.




ADS BY GOOGLE
Subscribe to the World's Most Powerful Newsletters

ADS BY GOOGLE

ChatOps is an emerging topic that has led to the wide availability of integrations between group cha...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting ch...
As Marc Andreessen says software is eating the world. Everything is rapidly moving toward being soft...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know ...
Is advanced scheduling in Kubernetes achievable?Yes, however, how do you properly accommodate every ...
The cloud era has reached the stage where it is no longer a question of whether a company should mig...
The need for greater agility and scalability necessitated the digital transformation in the form of ...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an over...
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and ...
While some developers care passionately about how data centers and clouds are architected, for most,...
"Since we launched LinuxONE we learned a lot from our customers. More than anything what they respon...
DevOps is under attack because developers don’t want to mess with infrastructure. They will happily ...
"As we've gone out into the public cloud we've seen that over time we may have lost a few things - w...
In his session at 21st Cloud Expo, Michael Burley, a Senior Business Development Executive in IT Ser...
Sanjeev Sharma Joins June 5-7, 2018 @DevOpsSummit at @Cloud Expo New York Faculty. Sanjeev Sharma is...
We are given a desktop platform with Java 8 or Java 9 installed and seek to find a way to deploy hig...
"I focus on what we are calling CAST Highlight, which is our SaaS application portfolio analysis too...
"Cloud4U builds software services that help people build DevOps platforms for cloud-based software a...
The question before companies today is not whether to become intelligent, it’s a question of how and...