OuputCapture with multiple tests

I am using org.springframework.boot.test.OutputCapture to test an annotation that logs something.

It works brilliantly for a single test and when tests are run individually if there a multiple tests using output capture in a source file, but when multiple tests are run together only the first test run gets the captured output, the others get empty strings.

Is there any way to avoid this, I can't see any configuration possibilities?