Tests Hang on Second Run After Code Change

[Razcoina]

I'm having this issue where running all the tests once works fine. But if I make a change to any of the tests and run all the tests again, the extension hangs indefinitely:

Notice the timer on the top right corner

If I run all the tests individually it seems to work, but the tests keep running:

Tests keep running

I am using the extension on VSCodium, Arch Linux. The only setting I changed from default was:
"phpunit.phpunit": "vendor/bin/pest"

Am I missing something?