Eliminating Bugs in Releases
"TestComplete has basically eliminated the release of products with show-stopping behaviors. Testing of basic menu, UI, process, reporting and regression functions has prevented us from releasing project builds with flaws. By using TestComplete, it has reduced the need for point releases on projects where before, it was used for each release. Besides eliminating bugs in our releases, we have also experienced a better audit trail and better process compliance. All of these benefits are due to a more complete test coverage on our Main UI, Help, Menu, Reporting and Configuration options," said Ted.
TestComplete Saves Time and Money
Ted described how TestComplete has saved them time and money: "Automation of general test scripts removes up to 90% of the labor associated with executing a test specification. Complex and infrequently used program features are tested manually by Subject Matter Experts or specific test scripts. It has also saved money on projects by reducing testing time, code rework and by significantly diminishing the interval between introduction of a programming flaw and its discovery."
"Our market is career US Government Staff, Foreign Service Officers and political appointees. In addition, all products produced for public diplomacy have significant Section 508, privacy and security compliance requirements. By reducing test times and increasing product quality with TestComplete, product release cycles have been reduced significantly," said Ted.
Testing Different Release Candidates
Ted explained that MSAG has hundreds of tests for several different projects: "We have hundreds of tests that test for show-stoppers every automated build. We also have automated test scripts for all alpha release candidates, manual, one off, complex and essential new functionality test scripts for all beta release candidates and User community Acceptance and Ad Hoc testing for every final release candidate. Our general goal is to automate any repeatable or data-driven test script after it has been performed more than two times."
MSAG TestComplete Test Plan
"TestComplete’s scripting language support and object orientation allow for the use of structured test development that mirrors code development," said Ted.
"All of our TestComplete projects are structured in the same way.
A project suite will contain the following functional test projects:
- Main: start and stop, query test run defaults, test all help
- MainMenu: worker scripts open and close all main menu choices
- MainUI: worker scripts to open and close all main window dialogs and sub systems
- Regression: worker scripts to implement pass/fail tests for all past reported error conditions
- Process: test scripts to demonstrate, validate and log discrete program requirements from Technical Design
- Configuration: worker scripts to test all remembered settings and configuration options
- Reporting: scripts to test and output auditable results demonstrating program reporting requirements from Technical Design
"In addition, a switch to allow batch automated testing is included so top level testing can be performed during an automated build. This provides a pass/fail condition for the program delivery system."