Skip to content

[CI] Enable BMG benchmarking in nightly #18351

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Jun 2, 2025
Merged

[CI] Enable BMG benchmarking in nightly #18351

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
7186cd2
add bmg, l0v2
ianayl May 2, 2025
5b3f25d
remove include
ianayl May 2, 2025
449cbe5
quote strings
ianayl May 2, 2025
eab34bd
use include for constants
ianayl May 2, 2025
126161f
do not fail fast
ianayl May 2, 2025
b785c81
match BMG naming
ianayl May 5, 2025
b4f57f7
fix missing backslash
ianayl May 5, 2025
baf318d
Disable l0v2 in nightly
ianayl May 6, 2025
fdccb1d
Add backend info to artifact name to prevent name collision
ianayl May 6, 2025
8f66dd3
change layout again
ianayl May 7, 2025
4e9ef30
Merge branch 'sycl' of https://github.com/intel/llvm into ianayl/benc…
ianayl May 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions .github/workflows/sycl-nightly.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -284,13 +284,14 @@ jobs:
needs: [ubuntu2204_build]
if: ${{ always() && !cancelled() && needs.ubuntu2204_build.outputs.build_conclusion == 'success' }}
strategy:
fail-fast: false
matrix:
runner: ['["PVC_PERF"]', '["BMG_PERF"]']
backend: ['level_zero:gpu']
include:
- ref: ${{ github.sha }}
save_name: Baseline
runner: '["PVC_PERF"]'
backend: 'level_zero:gpu'
preset: Minimal
save_name: 'Baseline'
preset: 'Minimal'
uses: ./.github/workflows/sycl-linux-run-tests.yml
secrets: inherit
with:
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/sycl-ur-perf-benchmarking.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,7 @@ on:
type: choice
options:
- '["PVC_PERF"]'
- '["BMG_PERF"]'
backend:
description: Backend to use
type: choice
Expand Down
17 changes: 14 additions & 3 deletions devops/actions/run-tests/benchmark/action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,7 @@ runs:
run: |
case "$RUNNER_TAG" in
'["PVC_PERF"]' ) ;;
'["BMG_PERF"]' ) ;;
*)
echo "#"
echo "# WARNING: Only specific tuned runners are fully supported."
Expand All @@ -54,6 +55,7 @@ runs:
# input.target_devices is not directly used, as this allows code injection
case "$TARGET_DEVICE" in
level_zero:*) ;;
level_zero_v2:*) ;;
*)
echo "#"
echo "# WARNING: Only level_zero backend is fully supported."
Expand Down Expand Up @@ -135,8 +137,17 @@ runs:
opencl:*) SAVE_SUFFIX="OCL" ;;
*) SAVE_SUFFIX="${ONEAPI_DEVICE_SELECTOR%%:*}";;
esac
# TODO accomodate for different GPUs and backends
SAVE_NAME="${SAVE_PREFIX}_PVC_${SAVE_SUFFIX}"
case "$RUNNER_TAG" in
'["PVC_PERF"]') MACHINE_TYPE="PVC" ;;
'["BMG_PERF"]') MACHINE_TYPE="BMG" ;;
# Best effort at matching
*)
MACHINE_TYPE="${RUNNER_TAG#[\"}"
MACHINE_TYPE="${MACHINE_TYPE%_PERF=\"]}"
;;
esac
SAVE_NAME="${SAVE_PREFIX}_${MACHINE_TYPE}_${SAVE_SUFFIX}"
echo "SAVE_NAME=$SAVE_NAME" >> $GITHUB_ENV
SAVE_TIMESTAMP="$(date -u +'%Y%m%d_%H%M%S')" # Timestamps are in UTC time

sycl-ls
Expand Down Expand Up @@ -221,5 +232,5 @@ runs:
if: always()
uses: actions/upload-artifact@v4
with:
name: Benchmark run ${{ github.run_id }} (${{ runner.name }})
name: Benchmark run ${{ github.run_id }} (${{ env.SAVE_NAME }})
path: ./cached_changes
Loading