Skip to Content
Find More Like This
Return to Search

Small file aggregation in a parallel computing system

United States Patent

8,825,652
September 2, 2014
View the Complete Patent at the US Patent & Trademark Office
Los Alamos National Laboratory - Visit the Technology Transfer Division Website
Techniques are provided for small file aggregation in a parallel computing system. An exemplary method for storing a plurality of files generated by a plurality of processes in a parallel computing system comprises aggregating the plurality of files into a single aggregated file; and generating metadata for the single aggregated file. The metadata comprises an offset and a length of each of the plurality of files in the single aggregated file. The metadata can be used to unpack one or more of the files from the single aggregated file.
Faibish; Sorin (Newton, MA), Bent; John M. (Los Alamos, NM), Tzelnic; Percy (Concord, MA), Grider; Gary (Los Alamos, NM), Zhang; Jingwang (Beijing, CN)
EMC Corporation (Hopkinton, MA), Los Alamos National Security, LLC (Los Alamos, NM)
13/ 536,315
June 28, 2012
STATEMENT OF GOVERNMENT RIGHTS This invention was made under a Cooperative Research and Development Agreement between EMC Corporation and Los Alamos National Security, LLC. The United States government has rights in this invention pursuant to Contract No. DE-AC52-06NA25396 between the United States Department of Energy and Los Alamos National Security, LLC for the operation of Los Alamos National Laboratory.