Changing custom evaluator from prompt based to coded does not change the scoring method

[JaakkoPakarinen]

Technical Feedback

Hello, I have created a custom evaluator in new Foundry UI. I updated my custom evaluator from prompt based to code based and ended up with "ValueError: pass_threshold must be between 0.0 and 1.0". I realized that Boolean scoring method is not supported for code based evaluators and it needs to be changed to a working one.

Desired Outcome

The UI should properly switch to supported scoring method when changing between Prompt based and Code based evaluator types.

Current Workaround

Manually switch the scoring method to a supported one when changing to evaluator type.