Revert Locale support for TestCompiler

[snicoll]

Unfortunately, #31408 needs to be reverted as we didn't find a way to make sure the locale works reliably. As it's been introduced in a milestone, it is better to revert it now than keeping it broken.

See #31407