Project

General

Profile

Feature #9486

leverage the execution time data in unit test results to profile performance

Added by Eric Faulhaber over 1 year ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
Start date:
Due date:
% Done:

0%

billable:
No
vendor_id:
GCD
case_num:
version_reported:
version_resolved:
reviewer:
production:
No
env_name:
topics:

History

#1 Updated by Eric Faulhaber over 1 year ago

My understanding is that execution time for each test is part of the ABL/OE unit test results already. The idea is to leverage/expose this data for performance profiling and to identify performance trends.

Given a set of baseline results and assuming identical hardware conditions, any task branch could be tested and compared against that baseline for performance impact overall, by test group, by individual test, etc. This would provide a data point to measure intended performance improvements and potentially to help identify performance regressions more proactively.

There is an assumption of course that execution time is only comparable if the pass/fail results for a test or group of tests being compared is the same between the baseline and the current run.

I don't know yet exactly where we would implement this functionality. This task is being opened to discuss the requirements and the approach.

#3 Updated by Vladimir Tsichevski over 1 year ago

Eric Faulhaber wrote:

I don't know yet exactly where we would implement this functionality...

The #9134 tool can be used for this. We can implement execution time reports, but I do not see exactly how the typical queries would look.

#4 Updated by Greg Shah over 1 year ago

  • Project changed from Build and Source Control to Testing

Also available in: Atom PDF