Skip to content

Add comprehensive provider coverage tests to ensure runtime and playground consistency. #2192

@kheiner

Description

@kheiner

Currently the test suite does not validate against alignment between runtime providers and playground configuration. Tests are missing or invalid as a result.

Missing Tests

It would be a lot easier if the tests were organized alphabetically and a provider-coverage test for:

  • Each provider should exist exactly once in playground
  • Each provider should be defined with a key and value in every image
  • All playground providers should exist in runtime
  • Images should not contain unknown providers
  • Missing provider tests list should shrink over time

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions