Severity for automated tests failure

How can I make a distinction between critical tests that fail (and that should be addressed immediately) VS tests that fail, but aren't too critical (eg. a tab-view with the wrong default tab open) ? It seems like most services (I am using CircleCI) only show you red or green ?

I feel like I need some intermediate "orange" color in addition to the green and red colors. Is there any add-on or trick that could help us make the distinction between critical test failures and acceptable-ones ? (For example with annotations @non-critical) ?

I am using Cucumber for testing a Ruby on Rails application.