Skip to Content
Find More Like This
Return to Search

Parallel checksumming of data chunks of a shared data object using a log-structured file system

United States Patent

September 6, 2016
View the Complete Patent at the US Patent & Trademark Office
Los Alamos National Laboratory - Visit the Technology Transfer Division Website
Checksum values are generated and used to verify the data integrity. A client executing in a parallel computing system stores a data chunk to a shared data object on a storage node in the parallel computing system. The client determines a checksum value for the data chunk; and provides the checksum value with the data chunk to the storage node that stores the shared object. The data chunk can be stored on the storage node with the corresponding checksum value as part of the shared object. The storage node may be part of a Parallel Log-Structured File System (PLFS), and the client may comprise, for example, a Log-Structured File System client on a compute node or burst buffer. The checksum value can be evaluated when the data chunk is read from the storage node to verify the integrity of the data that is read.
Bent; John M. (Los Alamos, NM), Faibish; Sorin (Newton, MA), Grider; Gary (Los Alamos, NM)
EMC Corporation (Hopkinton, MA), Los Alamos National Security, LLC (Los Alamos, NM)
13/ 799,264
March 13, 2013
STATEMENT OF GOVERNMENT RIGHTS This invention was made under a Cooperative Research and Development Agreement between EMC Corporation and Los Alamos National Security, LLC. The United States government has rights in this invention pursuant to Contract No. DE-AC52-06NA25396 between the United States Department of Energy and Los Alamos National Security, LLC for the operation of Los Alamos National Laboratory.