Override Django cache settings in tests

I'm using django.core.cache.backends.dummy.DummyCache in my tests, however, there is one test which requires actual caching so using DummyCache is not good there.
Is there a clean way to override the general Django settings for a certain scope? Preferably using a decorator.

In [2]: django.__version__
Out[2]: '1.8.4'