Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.
ACKNOWLEDGMENT OF GOVERNMENT SUPPORT
This invention was made with government support under Contract No. DEAC52-06NA25396 awarded by the U.S. Department of Energy. The government has certain rights in the invention.