Robot Framework - Selenium2Library - IE11 is very unstable to complete tests

Basically, if the test cases are ran on Chrome, FF or Edge, they go through without a problem - and you can even use the browser after the tests.

With IE however, running it from a web driver basically makes the browser unstable. This is for both the framework and manual usage. The issue I am having is that some elements flicker when they have been selected. And unfortunately, I am trying to select an element deep inside a drop down table. Once it starts to flicker, and then executes the Click Element, it clicks behind the drop down, and thus accidentally clicking on a completely different element and stopping my tests.

Is there a way round this? I need to automate our tests on all 4 of the browsers.