TechValidate Research on Ranorex


Ranorex Case Study

Medium Enterprise Computer Software Company

Introduction

This case study of a medium enterprise computer software company is based on a November 2022 survey of Ranorex customers by TechValidate, a 3rd-party research service. The profiled company asked to have their name blinded to protect their confidentiality.

“Like the GUI object recognition using xPath which enables the product changes look and feel when software evolves while the test continues to run.”

“It is a good GUI testing tool with flexibility between allowing auto generated code for business oriented people and C# coding for software developers. The GUI object recognition is robust and easy to use.”

Challenges

The business challenges that led the profiled company to evaluate and ultimately select Ranorex:

  • Before using Ranorex, the challenges they had in testing their application:
    • Test coverage: no challenges
    • Test reporting: no challenges
    • Staffing: no challenges
    • UI object recognition and automation: minor challenges
    • Flaky or unstable tests: average challenges
    • Meeting the release schedule or deadline: average challenges
    • Unacceptable amount of bugs in production: no challenges
    • Getting feedback from testing: minor challenges

Use Case

The key features and functionalities of Ranorex that the surveyed company uses:

  • The most valuable aspects of Ranorex Studio in their decision to choose Ranorex over other vendors they evaluated:
    • Feature options that meet the needs of their team
    • Compatibility with current and planned organizational tools and solutions
  • The platforms/technologies they test with Ranorex Studio:
    • Desktop – C/C++
  • The percentage balance between automated and manual testing: We have other in-house automated testing tools to make up our automated tests, which is the majority of our test and is more than 90%. Ranorex test is small part of our overall automated tests.
  • The types of tests that are their priority for automation:
    • Database
    • Functional UI
    • Integration
    • Regression tests
    • Web service/API
    • Visual regression

Results

The surveyed company achieved the following results with Ranorex:

  • The level of agreement of how using Ranorex Studio for test automation impacted their company:
    • Increased testing productivity and efficiency: agree
    • Shortened test cycles: agree
    • Decreased number of manual test runs: agree
    • Improved application quality and fewer defects: agree
    • Increased revenue: slightly agree
    • Allowed for involvement by non-technical team members: disagree
    • Led to more robust and reliable automation: agree
    • Shortened release cycles: slightly agree
  • The rating of Ranorex Studio on the following capabilities compared to other solutions they have used or researched:
    • Objection recognition: better
    • Ease for maintaining object repository: better
    • No or low code testing with action editor and recorder: significantly better
    • Code editor: average
    • Cross platform testing: better




About This Data

This data was sourced directly from verified users of Ranorex by TechValidate.

TechValidate verifies the identity and organizational affiliation of all participants that contribute to published research data. When research participants so desire, we also guarantee their anonymity so that they may share information honestly and freely.


More Research on Ranorex