Post-Processing Results#
Stage 3 transforms Raw Output Data files from completed experiments
into Processed Output Data ready for graph generation in stage 4.
Processing is driven by the --proc plugin chain: one or more plugin names
passed in order, each executed sequentially. The default chain is
proc.statistics proc.collate. For what each built-in plugin does, see
New Experiment Results Processing Plugin (--proc). For the data quality and resource options
that apply across all plugins, see Core Command Line Reference.
Composing the Chain#
Plugins are run in the order given, and order matters. The constraints between the built-in plugins are documented in their respective pages:
Common compositions:
# Default: statistics then collation
sierra ... --proc proc.statistics proc.collate
# Add imagizing for later video rendering via prod.render
sierra ... --proc proc.statistics proc.collate proc.imagize
# Compress raw outputs after processing to recover disk space
sierra ... --proc proc.statistics proc.collate proc.compress
# Decompress, reprocess, recompress after fixing a stage 3 issue
sierra ... --proc proc.decompress proc.statistics proc.collate proc.compress