How to use rerun.txt when running tests in paralell

Currently im having an issue with my Failed Runner file running on Jenkins. When I run the tests locally the rerun.txt file is populated. However due to the huge size of my test suite I have to run my tests as 6 different jobs on jenkins (using the annotations to seperate them). Although now the rerun.txt isnt populating and the conditional runner cant run any failed tests (currently theres about 10 failing out of 1000 due to loading issues). Anyone know how to remedy this?

Failed Runner

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

@RunWith(Cucumber.class)
@CucumberOptions(
    features = {"@target/rerun.txt"},
    glue = {"clinical_noting.steps", "clinical_noting.hooks"},
    monochrome = true,
    plugin = {"pretty","rerun:target/rerun.txt","json:logs/cucumber.json"}
    //plugin = {"html:target/cucumber/"}
)

public class FailedRunner {

}

And my conditional step setup