lundi 4 novembre 2019

vstest.console.exe doesn't generate trx on long running test suites

I'm running nightly integration tests using vstest.console.exe. When running 145 of the tests for 1,5 hours I get a trx result file. However, when I run all 447 test for 3,8 hours, there is no trx results file. Why might this be?

Running 145 tests

"%vsTestPath%\vstest.console.exe" C:\XYZ\Company.XYZ.IntegrationTests\bin\%XYZ_BuildConfiguration%\Company.XYZ.IntegrationTests.dll /TestCaseFilter:"FullyQualifiedName~Company.XYZ.IntegrationTests.ScenarioTests" /TestAdapterPath:C:\XYZ\Company.XYZ.IntegrationTests\bin\%XYZ_BuildConfiguration%\ /logger:Trx /ResultsDirectory:C:\XYZ\Tests\IntegrationTests\Results

Results

2019-11-04T14:53:19.9618550Z NUnit VS Adapter 2.0.0.0 executing tests is finished
2019-11-04T14:53:41.3427186Z Results File: C:\XYZ\Tests\IntegrationTests\Results\ContainerAdministrator_3928C6ECEC3B_2019-11-04_14_23_30.trx
2019-11-04T14:53:41.3607316Z 
2019-11-04T14:53:41.3694975Z Total tests: 145
2019-11-04T14:53:41.3697045Z      Passed: 144
2019-11-04T14:53:41.3697451Z      Failed: 1
2019-11-04T14:53:41.3697710Z  Total time: 1.5134 Hours
2019-11-04T14:53:41.4269788Z Test Run Failed.

Running all 447 tests

"%vsTestPath%\vstest.console.exe" C:\XYZ\Company.XYZ.IntegrationTests\bin\%XYZ_BuildConfiguration%\Company.XYZ.IntegrationTests.dll /TestAdapterPath:C:\XYZ\Company.XYZ.IntegrationTests\bin\%XYZ_BuildConfiguration%\ /logger:Trx /ResultsDirectory:C:\XYZ\Tests\IntegrationTests\Results

Results

2019-11-05T02:56:36.0148924Z NUnit VS Adapter 2.0.0.0 executing tests is finished
2019-11-05T02:57:17.9540526Z 
2019-11-05T02:57:18.0993784Z Test Run Failed.
2019-11-05T02:57:18.1438599Z Total tests: 447
2019-11-05T02:57:18.1438859Z      Passed: 336
2019-11-05T02:57:18.1439172Z      Failed: 106
2019-11-05T02:57:18.1439403Z     Skipped: 5
2019-11-05T02:57:18.1439592Z  Total time: 3.8780 Hours

Aucun commentaire:

Enregistrer un commentaire