samedi 14 novembre 2020

How to run TestCafe tests in parallel in CI by specifying the metadata

As far as I know TestCafe default behaviour is to run tests in parallel. Indeed the browsers [function][1] accepts an array of browser (which is cool). What I would like to do however is quite different. I have fixtures based on area of my portal (search, payment etc...) and so I'd like to know if it's possible to run these tests in CLI in parallel as they are orthogonal. The scope is of course to improve the execution time as the number test cases will grow. On the other hand I'd like also to catch the failures meaning that if a test ran in parallel on a specific metadata filter fails possibly we would like to stop the others too.

I am not using TestCafe's docker but our custom one with just Firefox, Chrome installed and we launch of tests in headless mode.

As a last point a great thing would be if we could run these scenario/metadata in parallel but somehow at the end of the test suite gather the reports together.

I understand the question is not easy especially because it involves either TestCafe or GitlabCi but probably someone else faced this problem too.

Thank you

Aucun commentaire:

Enregistrer un commentaire