Skip to Content
Find More Like This
Return to Search

Cooperative storage of shared files in a parallel computing system with dynamic block size

United States Patent

9,183,211
November 10, 2015
View the Complete Patent at the US Patent & Trademark Office
Los Alamos National Laboratory - Visit the Technology Transfer Division Website
Improved techniques are provided for parallel writing of data to a shared object in a parallel computing system. A method is provided for storing data generated by a plurality of parallel processes to a shared object in a parallel computing system. The method is performed by at least one of the processes and comprises: dynamically determining a block size for storing the data; exchanging a determined amount of the data with at least one additional process to achieve a block of the data having the dynamically determined block size; and writing the block of the data having the dynamically determined block size to a file system. The determined block size comprises, e.g., a total amount of the data to be stored divided by the number of parallel processes. The file system comprises, for example, a log structured virtual parallel file system, such as a Parallel Log-Structured File System (PLFS).
Bent; John M. (Los Alamos, NM), Faibish; Sorin (Newton, MA), Grider; Gary (Los Alamos, NM)
EMC Corporation (Hopkinton, MA), Los Alamos National Security, LLC (Los Alamos, NM)
13/ 730,080
December 28, 2012
STATEMENT OF GOVERNMENT RIGHTS This invention was made under a Cooperative Research and Development Agreement between EMC Corporation and Los Alamos National Security, LLC. The United States government has rights in this invention pursuant to Contract No. DE-AC52-06NA25396 between the United States Department of Energy and Los Alamos National Security, LLC for the operation of Los Alamos National Laboratory.