TechValidate Research on Ranorex

24 Charts


Ranorex Customer Research

How has using Ranorex Studio for test automation impacted your company?

10-20% 21-35% 36-50% 50+%

Increased tester productivity
Increased product quality
Increased product revenue
Reduced testing costs
Reduced development time to market
Reduced manual testing
Reduced tester fatigue
Reduced developer time used for testing

Ranorex Customer Research

What are the key features, functionalities, and factors that led you to choose Ranorex Studio?

Ranorex Recorder capture and replay
60%
Ranorex Spy tool and RanoreXPath
71%
Ranorex code editor and automation helpers
47%
Robotic Process Automation capabilities
21%
Central object repository
38%
Flexible API interface for CI/CD integrations
16%
Cross environment testing
38%
Cross browser testing
38%
Remote testing
42%
Customizable test reports
23%
Data-driven testing
51%
Full development environment for C# or VB.NET
47%

Ranorex Customer Research

What are the key features, functionalities, and factors that led you to choose Ranorex Studio?

Ranorex Recorder capture and replay
60%
Ranorex Spy tool and RanoreXPath
71%
Ranorex code editor and automation helpers
47%
Robotic Process Automation capabilities
21%
Central object repository
38%
Flexible API interface for CI/CD integrations
16%
Cross environment testing
38%
Cross browser testing
38%
Remote testing
42%
Customizable test reports
23%
Data-driven testing
51%
Full development environment for C# or VB.NET
47%

Ranorex Customer Research

What are the key features, functionalities, and factors that led you to choose Ranorex Studio?

Ranorex Recorder capture and replay
60%
Ranorex Spy tool and RanoreXPath
71%
Ranorex code editor and automation helpers
47%
Robotic Process Automation capabilities
21%
Central object repository
38%
Flexible API interface for CI/CD integrations
16%
Cross environment testing
38%
Cross browser testing
38%
Remote testing
42%
Customizable test reports
23%
Data-driven testing
51%
Full development environment for C# or VB.NET
47%

Ranorex Customer Research

Before using Ranorex Studio, what challenges did you have in testing your application?

Not a challenge Minor challenge Significant challenge

Test Coverage
Test reporting
Staffing
UI object identification and automation
Flaky/unstable tests
Missing delivery deadlines
Testing quality

Ranorex Customer Research

What are the key features, functionalities, and factors that led you to choose Ranorex Studio?

Ranorex Recorder capture and replay
60%
Ranorex Spy tool and RanoreXPath
71%
Ranorex code editor and automation helpers
47%
Robotic Process Automation capabilities
21%
Central object repository
38%
Flexible API interface for CI/CD integrations
16%
Cross environment testing
38%
Cross browser testing
38%
Remote testing
42%
Customizable test reports
23%
Data-driven testing
51%
Full development environment for C# or VB.NET
47%

Ranorex Studio Customer Research

Before using Ranorex Studio, what challenges did you have in testing your application?

No challenge at all Minor challenge Significant challenge
Test coverage - testing enough of the application

13%

30%

57%

Test reporting

22%

50%

28%

Staffing

19%

48%

33%

UI object identification and automation

20%

34%

46%

Flaky / unstable tests

22%

47%

31%

Ranorex Studio Customer Research

What tools have you integrated with Ranorex Studio?

Jenkins
42%
Jira
31%
Azure DevOps Server
24%
TestRail
20%
GitLab CI/CD
18%
Microfocus ALM
6%
Zephyr for Jira
6%
Bamboo
4%
Other
19%

Ranorex Studio Customer Research

What platforms/technologies do you test with Ranorex Studio?

Web app
55%
Desktop - C#
48%
Desktop - .NET or VB.NET
25%
Desktop - Java
22%
Desktop - C/C++
21%
Desktop - WinForms
21%
Desktop - WPF
20%
Mobile - native Android app
17%
Mobile - native iOS app
13%
Desktop - JavaScript/Node.js
11%
Desktop - Delphi
8%
Mobile - web app in mobile browser
7%
Desktop - PHP
4%
Other
3%

Ranorex Studio Customer Research

What types of tests do you automate with Ranorex Studio?

Functional UI
87%
Regression
72%
End-to-end
51%
Smoke
44%
Integration
30%
Performance
24%
Web service / API
22%
Database
20%
Visual regression (page layout, responsiveness)
20%
Other
2%

Ranorex Studio Customer Research

In your best estimate, how much improvement have you seen in the following areas?

0-5% 5-10% 10-20% 20-40% 40%+

Increase in product revenue
Increase in productivity

Ranorex Studio Customer Research

How has Ranorex Studio helped your team?

Efficiency increase in testing (less manual tests)
74%
More robust and reliable automation
46%
Shorter test cycles
44%
Improved technical testing skills / knowledge
43%
Improved application quality / fewer defects
40%

Ranorex Studio Customer Research

Over 80% of Ranorex Studio customers report measurable increases in productivity

If you are currently using Ranorex Studio for test automation, what increase in productivity have you realized?

More than 20% (save 6+ hours per week, per person)
32%
10% - 20% (save 3 - 6 hours per week per person)
32%
5% - 10% (save 2 -3 hours per week per person)
17%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Case: Web and Mobile Testing

Are you testing mobile or web applications with Ranorex?

Web app on desktop - using Ranorex Studio
83%
Mobile - native Android app
20%
Mobile - native iOS app
15%
Mobile - web app in mobile browser
11%
Web app on desktop - using Selenium WebDriver
10%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Cases: Development Technologies

Are you testing any of the following desktop development technologies or platforms with Ranorex?

C#
64%
.NET
45%
WPF
29%
WinForms
29%
Java
23%
JavaScript/Node.js
19%
C/C++
18%
VB.NET
12%
Delphi
8%
PHP
4%
Python
4%
SAP
4%
ERP
3%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Cases: Test Types

What type of tests are your priorities for automation?

Functional UI
81%
Regression tests
75%
Smoke tests
49%
End-to-end
48%
Integration
30%
Web service / API
22%
Performance
20%
Database
17%
Visual regression (page layout, responsiveness)
16%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Case: Team Size

At your company, how many people use Ranorex Studio to automate tests?

1-2: 38%
3-4: 29%
5-9: 18%
10-49: 11%
50+: 3%

Ranorex Studio Customer Research

Desktop Technologies

Are you testing any of the following desktop development technologies or platforms with Ranorex?

C#
64%
.NET
45%
WPF
29%
WinForms
29%
Java
23%
JavaScript/Node.js
19%
C/C++
18%
VB.NET
12%
Delphi
8%
PHP
4%
Python
4%
SAP
4%
ERP
3%
Other
11%

Ranorex Studio Customer Research

What application interfaces/platforms are you testing with Ranorex?
Desktop
79%
Web
63%
Mobile
23%

Ranorex Studio Customer Research

What type of tests are you automating with Ranorex?

Functional UI
91%
End to end
45%
Integration
33%
Web service / API
24%
Database
16%
Visual regression (page layout, responsiveness)
29%
Performance
18%
Other
4%

Ranorex Studio Customer Research

Which of the following were important features when you were evaluating test automation?

Ease of use
76%
Excellent object recognition
64%
Fits into technology stack (.NET, C#/VB.Net)
53%
Strong automation API
41%
Helpful and responsive support team
36%
Good community support (forum)
27%
Easy integration with build pipeline
24%
Price
24%
Bringing people with different skill sets closer together
19%
Open file formats
9%

Ranorex Studio Customer Research

Since using Ranorex Studio for test automation, what increase in productivity have you realized?

More than 20% (save 6+ hours a week): 29%
10% - 20% (save 3 – 6 hours a week): 28%
5% – 10% (save 2 – 3 hours a week): 23%
Less than 5% (save less than 2 hours a week): 20%

Ranorex Studio Customer Research

Benefits of Test Automation

How has Ranorex Studio helped your team?

Efficiency increase in testing (less manual tests)
78%
Robust and reliable automation
45%
Shorter test cycles
43%
Improved level of technical knowledge/skills
34%

Ranorex Studio Customer Research

What are the top challenges associated with test automation?

Maintaining existing automated tests due to changes in the UI
67%
Creating new automated tests for new features in the software under test
45%
Identifying and Improving flaky tests
37%
Maintaining deployment pipeline and automation environments (VMs, etc.)
27%
Insufficient technical skills on the existing team
23%
Management does not understand the costs and limitations of automated testing
23%



More Research on Ranorex