Intellij not recognizing directory as tests

I added another source set, and a task of type test that uses that source set. I can execute the task and run the tests fine.

However, Intellij doesn't consider this src/newTests/java as tests. If I 'Mark directory as test sources' in the UI, it will forget it he next time build.gradle is synced. How do I make it remember this?