Approval tests run in different locations depending on the level of execution

I have a test project with two directories in containing approval tests. When running the tests in each directories individually the approved files are searched for in the correct directory, the directory where the tests are placed.

But when running all tests in the project the test in dir 2 fails. It seems as all tests are executed from dir 1 as new and empty approved files are created in dir 1.

What is causing this behavior? I would like to have the same behavior independent of which level the tests are started from.