Pkg.test() will use the preferences defined in the LocalPreferences.toml file of a package. TestReports.test() does not. I'm not sure if this is a bug, expected behavior, or I'm just not using TestReports.test() correctly.
This may be related to JuliaTesting/TestEnv.jl#59.