Supercomputing '08 Panel
Exa and Yotta Scale Data - Are We Ready?
Sponsored by DOE SciDAC Petascale Data Storage Institute (PDSI)
Panel Chair: William Kramer, NERSC
Friday, November 21, 2008
Soon after Teraflops, HPC facilities were handling Peta-Byte data. The challenges of Exa-byte and Yotta-byte data will be a significant, possibly dominate, limiter on productivity of HPC users.This panel will address the question "Is the HPC community ready for Exa Byte data?" and will discuss challenges of Yotta-bytes.
Keith Gray (BP)
Rob Farber (Pacific Northwest National Laboratory)
Gary Grider (Los Alamos National Laboratory)
Specific topics include:
Petascale computing infrastructures for scientific discovery make petascale demands on information storage capacity, performance, concurrency, reliability, availability, and manageability. The last decade has shown that parallel file systems can barely keep pace with high performance computing along these dimensions; this poses a critical challenge when petascale requirements are considered. The Petascale Data Storage Institute (http://www.pdsi-scidac.org/) focuses on data storage problems found in petascale computing environments and leverages experience in applications and diverse file and storage systems expertise of its members, the institute allows a group of researchers to collaborate extensively on developing requirements, standards, algorithms, and development and performance tools.
The Drive to Exa-scale Computing means faster computers need more data, faster:
Data Challenges at this level include:
There are significant issues regarding Large Scale System integration that are not being addressed in other forums, such as the current research portfolios or vendor user groups. The impact of less-than-optimal integration technology means the time required to deploy, integrate and stabilize a large scale system may consume up to 25 percent of the useful life of such systems. Therefore, improving the state of the art for large scale systems integration has potential for great impact by increasing the scientific productivity of these systems.
Other Workshops & Panels of Interest at SC08
Petascale Data Storage Workshop '08
pNFS Protocol after Final Draft and before RFC