External benchmarking integration via new workflow

[joniohtonen]

Support for running benchmarks in a remote cluster.

Background

The remote cluster contains hardware that's outside of our current list of supported and tested hardware, but we're interested to see the results from them anyway.

Goals

Implement a workflow that is compatible with our hardware cluster.

Tasks

• Implement a workflow using the existing build-and-benchmark as a baseline
• Implement a separate artifact handling

Tests

• Test workflow functionality with a benchmark run

Other

The system requires a dedicated and customized self-hosted runner. The customized runner creates a JIT runner in the remote cluster, which ingests the actual benchmarking job.

Known caveats:

• The queue times can be long
• Due to the long queue times, the ephemeral runner configuration might go stale while waiting (unknown if this really happens)