TechValidate Research on Ranorex

Introduction

This case study of a S&P 500 computer software company is based on a December 2017 survey of Ranorex Studio customers by TechValidate, a 3rd-party research service. The profiled company asked to have their name blinded to protect their confidentiality.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select Ranorex Studio:

• Top challenges associated with test automation:
  • Identifying and improving flaky tests
  • Maintaining deployment pipeline and automation environments (VMs)
  • Management not understanding the costs and limitations of automated testing

Use Case

The key features and functionalities of Ranorex Studio that the surveyed company uses:

• Has 50+ people on their team performing Automated Testing.
• Automating the following tests with Ranorex:
  • Functional UI
  • Integration
• Integrated Jenkins with Ranorex.
• Is using Jira for test management.
• Testing the following application interfaces/platforms with Ranorex:
  • Desktop
  • Web

Results

The surveyed company achieved the following results with Ranorex Studio:

• Ranorex Studio has helped in the following ways:
  • Increased their testing efficiency (less manual tests)
  • Shortened their test cycles
  • Gained robust and reliable automation
  • Improved their level of technical knowledge/skills
• Realized a greater than 20% (saved 6+ hours a week) increase in productivity after using Ranorex Studio for test automation.
• Reports the following as important features when they evaluated Ranorex automation tool:
  • Ease of use
  • Excellent object recognition
  • A strong automation API
  • The ability to fit into technology stacks (.NET, C#/VB.Net)
  • The ability to bring people with different skill sets closer together
  • Price

Introduction

This case study of TTC – Testing Training and Consulting Ltd is based on a December 2017 survey of Ranorex Studio customers by TechValidate, a 3rd-party research service.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select Ranorex Studio:

• Top challenges associated with test automation:
  • Maintaining existing automated tests due to changes in the UI
  • Maintaining deployment pipeline and automation environments (VMs)
  • Management not understanding the costs and limitations of automated testing

Use Case

The key features and functionalities of Ranorex Studio that the surveyed company uses:

• Has 10-49 people on their team performing Automated Testing.
• Automating the following tests with Ranorex:
  • Functional UI
  • End to end
  • Integration
  • Web service / API
  • Performance
• Integrated Gitlab CI with Ranorex.
• Is using HP ALM (HP QC) for test management.
• Testing the following application interfaces/platforms with Ranorex:
  • Desktop
  • Web
  • Mobile

Results

The surveyed company achieved the following results with Ranorex Studio:

• Ranorex Studio has helped in the following ways:
  • Increased their testing efficiency (less manual tests)
  • Shortened their test cycles
  • Gained robust and reliable automation
  • Enlarge testing coverage
• Realized a 10% – 20% (saved 3 – 6 hours a week) increase in productivity after using Ranorex Studio for test automation.
• Reports the following as important features when they evaluated Ranorex automation tool:
  • Ease of use
  • Excellent object recognition
  • Easy integration with build pipeline
  • The ability to fit into technology stacks (.NET, C#/VB.Net)
  • A helpful and responsive support team
  • Price