TestComplete 7 - Test Log Improvements

TestComplete 7 includes a number of improvements that we, at AutomatedQA, are very excited about. One of the most exciting improvements that help you better analyze your automated test results are in the test log. Here, we will examine the new features of the test log and show you how these features make working with your automated tests’ results even easier.

A New Summary Panel

Test log panels provide information about your automated test runs in your project suite and project - whether there were errors, logged messages, or if it was successful. In TestComplete 7, we introduced a new Summary panel into the test log. The Summary panel provides a summary of how the automated tests performed in your project suite and project.

The image below shows an example of the Summary panel:

If the project suite is selected in the log tree, the Summary panel displays some general information about all projects in your project suite. To make the Summary panel display information on a specific project, you just need to select it in the log tree.

The Summary panel displays the following information:

  • Total number of project test items

    This is the total number of project’s (or project suite’s) test items. It includes both the tests that were executed during the run and the tests that were excluded from testing. The value enclosed in parentheses specifies the total number of times that the test item ran.

    Top level items: The first value is the total number of top-level test items of the project (or project suite). The value enclosed in parentheses specifies the total number of times that these tests were run.

  • Executed project test items

    This is the total number of project’s (or project suite’s) test items that were executed during the test run. The value enclosed in parentheses specifies the total number of test runs for these tests.

    Top level items: The first value is the total number of top-level test items of the project (or project suite) that were executed. The value enclosed in parentheses specifies the total number of times that the top-level test item was run.

  • Project test items executed successfully

    This is the total number of project’s (or project suite’s) test items that were executed successfully during the project run. The value enclosed in parentheses specifies the total number of test runs for these tests.

    Top level items: The first value is the total number of top-level test items of the project (or project suite) that were executed successfully. The value enclosed in parentheses specifies the total number of test items that were run successfully.

  • Failed project test items

    This is the total number of project’s (or project suite’s) test items that failed during the project run. The value enclosed in parentheses specifies the total number of test runs that failed.

    Top level items: The first value is the total number of top-level test items of the project (or project suite) that failed during execution. The value enclosed in parentheses specifies the total number top-level test runs that failed.

The Summary Panel helps you quickly determine how your project suite and project ran over several test runs.

Sequence of Automated Tests: Call Stack Panel

Large projects may contain a number of automated tests (scripts, keyword tests, low-level procedures). During the automated test’s execution, it can call other tests and the sequence of automated tests called can be complex. Sometimes it may be difficult to detect which part of the sequence caused an error. With TestComplete 7, determining the sequence of the automated test execution is a lot easier with the addition of the Call Stack panel, which is located on the Generic Test Log page.

Call Stack Panel

During the automated test run the test engine detects the sequence of tests and then displays it in the Call Stack panel. By default, call stack tracing is enabled only for error messages, but if needed you can enable it for any other message type. While selecting the needed error message in the Test Log panel, you can view the corresponding sequence of automated tests in the Call Stack panel.

Filtering Panels Content: the Quick Search Feature

Another new feature in TestComplete’s test log is the Quick Search feature. The Quick Search box is now included into the Project Log and Test Log panels.

Quick Search Box

This feature enables you to filter the content of the corresponding panel. Before TestComplete 7, you had to scroll through the list expanding all log message folders in order to find the desired message. This was very time consuming if the project had a lot of log messages. Now you can use the Quick Search edit box, and the log contents will be filtered according to what you type. Filtering the Project Log panel’s content is performed by the Name column. When filtering the content of the Test Log panel, the Priority, Type Description and Message columns are included into the search. Notice that in both panels search is performed on all levels of log messages hierarchy.

For instance, the following log contains a number of messages:

Test Log

In the example above, the image contains the word - “folder”. By typing “folder” into the Quick Search box, only the log entries containing that word are displayed. All messages that don’t match the specified criteria will be hidden:

Filtering the Test Log Contents

Conclusion

TestComplete logs store comprehensive information on each automated test run. New features introduced into TestComplete 7, such as the new Call Stack and Summary panels, make analyzing this information even easier than before. The new Quick Search feature enables you to filter log messages and makes finding certain messages faster. If you haven’t tried TestComplete 7 and looked at all of the new enhancements, download and try it today.


Close

Add a little SmartBear to your life

Stay on top of your Software game with the latest developer tips, best practices and news, delivered straight to your inbox

By submitting this form, you agree to our
Terms of Use and Privacy Policy

Thanks for Subscribing

Keep an eye on your inbox for more great content.

Continue Reading