go test ./package dumps Stdout of successful tests, not just the failed test

While writing a CLI tool that outputs to stdout, I noticed that if one test fails, then whatever the other (successful) tests had also written to stdout gets dumped out as well, which is misleading.

Is this to be expected, or should I set os.Stdout to /dev/null while testing? but then how would the testing package find anything to print out?