Skip to Content
Find More Like This
Return to Search

Storing files in a parallel computing system based on user-specified parser function

United States Patent

8,868,576
October 21, 2014
View the Complete Patent at the US Patent & Trademark Office
Los Alamos National Laboratory - Visit the Technology Transfer Division Website
Techniques are provided for storing files in a parallel computing system based on a user-specified parser function. A plurality of files generated by a distributed application in a parallel computing system are stored by obtaining a parser from the distributed application for processing the plurality of files prior to storage; and storing one or more of the plurality of files in one or more storage nodes of the parallel computing system based on the processing by the parser. The plurality of files comprise one or more of a plurality of complete files and a plurality of sub-files. The parser can optionally store only those files that satisfy one or more semantic requirements of the parser. The parser can also extract metadata from one or more of the files and the extracted metadata can be stored with one or more of the plurality of files and used for searching for files.
Faibish; Sorin (Newton, MA), Bent; John M. (Los Alamos, NM), Tzelnic; Percy (Concord, MA), Grider; Gary (Los Alamos, NM), Manzanares; Adam (Hopkinton, MA), Torres; Aaron (Los Alamos, NM)
EMC Corporation (Hopkinton, MA), Los Alamos National Security, LLC (Los Alamos, NM)
13/ 536,369
June 28, 2012
STATEMENT OF GOVERNMENT RIGHTS This invention was made under a Cooperative Research and Development Agreement between EMC Corporation and Los Alamos National Security, LLC. The United States government has rights in this invention pursuant to Contract No. DE-AC52-06NA25396 between the United States Department of Energy and Los Alamos National Security, LLC for the operation of Los Alamos National Laboratory.