TechValidate Research on Ranorex

Introduction

This case study of a large enterprise industrial manufacturing company is based on a June 2019 survey of Ranorex Studio customers by TechValidate, a 3rd-party research service. The profiled company asked to have their name blinded to protect their confidentiality.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select Ranorex Studio:

• Prioritizing the following tests for automation:
  • Database
  • Functional UI
  • Integration
• Have the following primary goals for UI test automation:
  • Automating end-to-end testing

Use Case

The key features and functionalities of Ranorex Studio that the surveyed company uses:

• 3-4 people are using Ranorex Studio to automate tests.
• Testing the following technologies/platforms with Ranorex:
  • C#
• Testing the following mobile or web platforms with Ranorex:
  • Web app on desktop (using Ranorex Studio)
• Has integrated TeamCity with Ranorex Studio.

Results

The surveyed company achieved the following results with Ranorex Studio:

• Seen a 10% – 20% (save 3 – 6 hours per week per person) increase in productivity since using Ranorex Studio for test automation.
• Ranorex Studio has done the following:
  • Increased efficiency in testing
  • Resulted in shorter test cycles
  • Resulted in more robust and reliable automation
  • Improved application quality / fewer defects
  • Improved technical testing skills/knowledge

Introduction

This case study of a S&P 500 computer software company is based on a December 2017 survey of Ranorex Studio customers by TechValidate, a 3rd-party research service. The profiled company asked to have their name blinded to protect their confidentiality.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select Ranorex Studio:

• Top challenges associated with test automation:
  • Identifying and improving flaky tests
  • Maintaining deployment pipeline and automation environments (VMs)
  • Management not understanding the costs and limitations of automated testing

Use Case

The key features and functionalities of Ranorex Studio that the surveyed company uses:

• Has 50+ people on their team performing Automated Testing.
• Automating the following tests with Ranorex:
  • Functional UI
  • Integration
• Integrated Jenkins with Ranorex.
• Is using Jira for test management.
• Testing the following application interfaces/platforms with Ranorex:
  • Desktop
  • Web

Results

The surveyed company achieved the following results with Ranorex Studio:

• Ranorex Studio has helped in the following ways:
  • Increased their testing efficiency (less manual tests)
  • Shortened their test cycles
  • Gained robust and reliable automation
  • Improved their level of technical knowledge/skills
• Realized a greater than 20% (saved 6+ hours a week) increase in productivity after using Ranorex Studio for test automation.
• Reports the following as important features when they evaluated Ranorex automation tool:
  • Ease of use
  • Excellent object recognition
  • A strong automation API
  • The ability to fit into technology stacks (.NET, C#/VB.Net)
  • The ability to bring people with different skill sets closer together
  • Price