Add a pure Java test runner

[Gedochao]

We should add a pure Java test runner at some point, so that we can keep Java test builds pure as well (we currently have to add Scala to them)
Context:

• Add Scala to pure Java test builds #3009 (comment)
• Scala CLI fails to run tests for a pure Java project #2940