Skip to content

Terminology

elavoie edited this page Jan 29, 2016 · 6 revisions
Terminology Definition
artifact Elementary component with a file representation and associated JSON meta-information
repository Collection of artifacts on the file system
action Operation that can be performed on artifact(s)
Artifacts Definition
benchmark Abstract algorithm that performs a useful numerical task
build Runnable implementation that is ready to be executed on an environment and the configuration that was used to create it
compiler Program that processes a benchmark implementation to produce a new implementation (in the same or a different language)
configuration Combination of artifacts and their associated parameters necessary for performing an action
environment Additional virtualization layer executing on top of a platform (or another environment) a benchmark might execute on
experiment Combination of a configuration and experimental parameters that determine what, where, and how an implementation is to be executed
implementation Realization of a benchmark in a specific language (ex: C, assembly) and packaged in a particular format (ex: text file, binary, webpage) which might be directly runnable or not
platform Hardware and (native) OS combination for the machine to run benchmarks on
report Collection of figure(s) and the configuration that was used to produce them
run Execution report (ex: timing results, memory usage, etc.) and the experiment that produced it
Actions Definition
building Creation, from a configuration, of an implementation that is executable on an environment
installing Retrieval, and initialization of an artifact in the repository
reporting Aggregation of multiple compatible runs, selection of significant results, and production of human-readable figure(s) from those results
running Execution of an implementation on a stack of environment(s), and production of a run from the monitoring of its execution

Table of Contents

  • Introduction
    • Terminology | [Conventions](Benchmark Organization Conventions)
  • Installation
  • [Configuration](Add local platform information)
  • Contribution
    • [Add a new benchmark](Adding a new benchmark and implementation to an existing suite)
    • [Configure implementation.json](Adding multiple parameters in implementation.json)
    • [Add a new compiler](Adding a new compiler) // To-do
    • [Add a new implementation](Adding a new implementation) // To-do
  • Development // To-do
    • [Work with commands](Work with commands)
    • [Customize jobs](Customize jobs)
Clone this wiki locally