⚙️ dashboard for observability + rerun option

[baptistecolle]

Changes

• Added capability to rerun individual benchmarks

  • Modularized backend architecture to support selective benchmark reruns
  • Addresses cases where benchmarks produced erroneous results due to outdated dependencies

• Implemented observability dashboard for LLM Performance Leaderboard

  • Provides monitoring of benchmark execution status
  • Tracks failed benchmark configurations to facilitate debugging
  • Enhances visibility into the overall health of the leaderboard system

Motivation

These changes improve the maintainability and reliability of the LLM Performance Leaderboard by enabling operators to:

1. Quickly identify and rerun problematic benchmarks (previously old data would just stay in the leaderboard)
2. Monitor benchmark execution status through a centralized dashboard
3. Understand failed configurations better in order to find root cause of a bug