GUI tests are a vital step in the software testing life-cycle because they are performed from the view of the end user of an application. Test automation of this phase is the final goal as it is already done with unit or integration tests.
When you search the Internet for such a task you will find a broad spectrum of functional test tools that are either „general purpose“ test tools or dedicated to a specific kind of GUI. My job was to find a suitable test tool that is able to perform automated tests for a complicated Java Swing GUI (provided as a Java Web Start application).
Of course, you can start evaluating all the „big players“ in this area but „big player“ also means „big money“ in terms of license fee and maintenance cost. The other possibility is to look for vendors that are specialized in Java Swing GUI testing if this is all you want. Such a first preselection was my starting point and QF-Test was one of my first candidates for a deeper analysis.
Open source tools may be a choice too for every user that is looking for a low cost solution. However, in my opinion these tools are capable of handling simple GUI tests but reach their limits with complex GUIs (custom components, etc.) if you do not invest time and money to do a lot of „customization“ (it‘s open source, so you are free to extend them). But you can also decide to take the middle road and then you should definitely give QF-Test (for Java) a try.
For a tool comparison I have created more than 30 evaluation criteria (annotated with different priorities) like
Having these evaluation criteria as well as dedicated test scenarios for the real system under test I have to say that QF-Test succeeded in fulfilling all my requirements with a score of more than 90%. That result placed QF-Test above all other evaluated commercial and open source tools -- at least for my specific requirements and target.
However, I think you will hardly find another Java Swing GUI test tool that gives you a better value for your money.
Result: With QF-Test GUI testing can change from an obligatory task into excitement.
Klaus Berg, Senior Engineer, Siemens Corporate Technology, Munich
1. Functional cookies
We use functional cookies to ensure the basic functionality of the website.
2. Performance and statistic cookies
We use Matomo for analyzing and optimizing our website. Cookies permit an anonymous collection of information that help us offering you a clear and user-friendly visit of our web pages.
This cookie contains a unique, pseudonymized visitor ID internal to Matomo for recognizing returning visitors.
This cookie is used to track from which website the anonymized user proceeded to our website.
The Matomo session cookie is used to track the visitor's page requests during the session.
is created and should be then directly deleted (used to check whether the visitor’s browser supports cookies).
short lived cookies used to temporarily store data for the visit.
short lived cookies used to temporarily store data for the visit.