[GRADLE-2672] Gradle reports contain incorrect values for test case times Created: 07/Feb/13 Updated: 16/Feb/13 Resolved: 16/Feb/13 |
|
Status: | Resolved |
Project: | Gradle |
Affects Version/s: | None |
Fix Version/s: | None |
Type: | Bug | ||
Reporter: | Gradle Forums | Assignee: | Unassigned |
Resolution: | Not A Bug | Votes: | 0 |
Attachments: | GRADLE-2672.zip |
Description |
I just upgraded to Gradle 1.4. I was excited to try out the new XML report output for CI as well as the new HTML report output for TestNG tests (big improvement!). But while testing it out I discovered that Gradle is reporting incorrect values for test case execution times when my tests are executed. I've tried running just the tests (gradle test) and with cobertura (gradle cobertura). Regardless, both the HTML files and the CI test output (TEST-<classname>) report execution times are all negative and of the incorrect magnitude. And on top of that the execution times differ for the same tests between each type of report. Here are the times reported for three tests in build/test-results/TEST-com.xyz.MemoryAwareECStreamTemplateTest.xml: Here are snapshots of the HTML output for the same tests for comparison. Notice how the execution times of the same tests differ from the CI XML: Oddly enough, the individual test case times reported in build/reports/tests/Gradle suite/Gradle test.xml appear to be correct. Though the total time seems high (Gradle reports the total build time of 29.975 secs on the command-line). Here's a snippet: Environment info: ------------------------------------------------------------ ---------------------------------------------------------------------------------------- |
Comments |
Comment by Derek Burket [ 12/Feb/13 ] |
I think Gradle is off the hook for this issue. While building my reproducible sample I discovered that my project was pulling in an older version of TestNG (5.13.1). So I tried the latest version and it worked as expected. Further investigation revealed that the issue affects TestNG 5.13.x. Versions less than or greater than those work as expected. I've attached my sample in case it's useful in any way. |
Comment by Adam Murdoch [ 16/Feb/13 ] |
Thanks for letting us know. |