TechValidate Research on Ranorex

18 Charts


Ranorex Studio Customer Research

Before using Ranorex Studio, what challenges did you have in testing your application?

No challenge at all Minor challenge Significant challenge
Test coverage - testing enough of the application

13%

30%

57%

Test reporting

22%

50%

28%

Staffing

19%

48%

33%

UI object identification and automation

20%

34%

46%

Flaky / unstable tests

22%

47%

31%

Ranorex Studio Customer Research

What tools have you integrated with Ranorex Studio?

Jenkins
42%
Jira
31%
Azure DevOps Server
24%
TestRail
20%
GitLab CI/CD
18%
Microfocus ALM
6%
Zephyr for Jira
6%
Bamboo
4%
Other
19%

Ranorex Studio Customer Research

What platforms/technologies do you test with Ranorex Studio?

Web app
55%
Desktop - C#
48%
Desktop - .NET or VB.NET
25%
Desktop - Java
22%
Desktop - C/C++
21%
Desktop - WinForms
21%
Desktop - WPF
20%
Mobile - native Android app
17%
Mobile - native iOS app
13%
Desktop - JavaScript/Node.js
11%
Desktop - Delphi
8%
Mobile - web app in mobile browser
7%
Desktop - PHP
4%
Other
3%

Ranorex Studio Customer Research

What types of tests do you automate with Ranorex Studio?

Functional UI
87%
Regression
72%
End-to-end
51%
Smoke
44%
Integration
30%
Performance
24%
Web service / API
22%
Database
20%
Visual regression (page layout, responsiveness)
20%
Other
2%

Ranorex Studio Customer Research

In your best estimate, how much improvement have you seen in the following areas?

0-5% 5-10% 10-20% 20-40% 40%+

Increase in product revenue
Increase in productivity

Ranorex Studio Customer Research

How has Ranorex Studio helped your team?

Efficiency increase in testing (less manual tests)
74%
More robust and reliable automation
46%
Shorter test cycles
44%
Improved technical testing skills / knowledge
43%
Improved application quality / fewer defects
40%

Ranorex Studio Customer Research

Over 80% of Ranorex Studio customers report measurable increases in productivity

If you are currently using Ranorex Studio for test automation, what increase in productivity have you realized?

More than 20% (save 6+ hours per week, per person)
32%
10% - 20% (save 3 - 6 hours per week per person)
32%
5% - 10% (save 2 -3 hours per week per person)
17%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Case: Web and Mobile Testing

Are you testing mobile or web applications with Ranorex?

Web app on desktop - using Ranorex Studio
83%
Mobile - native Android app
20%
Mobile - native iOS app
15%
Mobile - web app in mobile browser
11%
Web app on desktop - using Selenium WebDriver
10%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Cases: Development Technologies

Are you testing any of the following desktop development technologies or platforms with Ranorex?

C#
64%
.NET
45%
WPF
29%
WinForms
29%
Java
23%
JavaScript/Node.js
19%
C/C++
18%
VB.NET
12%
Delphi
8%
PHP
4%
Python
4%
SAP
4%
ERP
3%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Cases: Test Types

What type of tests are your priorities for automation?

Functional UI
81%
Regression tests
75%
Smoke tests
49%
End-to-end
48%
Integration
30%
Web service / API
22%
Performance
20%
Database
17%
Visual regression (page layout, responsiveness)
16%

Ranorex Studio Customer Research

Ranorex Studio Customer Use Case: Team Size

At your company, how many people use Ranorex Studio to automate tests?

1-2: 38%
3-4: 29%
5-9: 18%
10-49: 11%
50+: 3%

Ranorex Studio Customer Research

Desktop Technologies

Are you testing any of the following desktop development technologies or platforms with Ranorex?

C#
64%
.NET
45%
WPF
29%
WinForms
29%
Java
23%
JavaScript/Node.js
19%
C/C++
18%
VB.NET
12%
Delphi
8%
PHP
4%
Python
4%
SAP
4%
ERP
3%
Other
11%

Ranorex Studio Customer Research

What application interfaces/platforms are you testing with Ranorex?
Desktop
79%
Web
63%
Mobile
23%

Ranorex Studio Customer Research

What type of tests are you automating with Ranorex?

Functional UI
91%
End to end
45%
Integration
33%
Web service / API
24%
Database
16%
Visual regression (page layout, responsiveness)
29%
Performance
18%
Other
4%

Ranorex Studio Customer Research

Which of the following were important features when you were evaluating test automation?

Ease of use
76%
Excellent object recognition
64%
Fits into technology stack (.NET, C#/VB.Net)
53%
Strong automation API
41%
Helpful and responsive support team
36%
Good community support (forum)
27%
Easy integration with build pipeline
24%
Price
24%
Bringing people with different skill sets closer together
19%
Open file formats
9%

Ranorex Studio Customer Research

Since using Ranorex Studio for test automation, what increase in productivity have you realized?

More than 20% (save 6+ hours a week): 29%
10% - 20% (save 3 – 6 hours a week): 28%
5% – 10% (save 2 – 3 hours a week): 23%
Less than 5% (save less than 2 hours a week): 20%

Ranorex Studio Customer Research

Benefits of Test Automation

How has Ranorex Studio helped your team?

Efficiency increase in testing (less manual tests)
78%
Robust and reliable automation
45%
Shorter test cycles
43%
Improved level of technical knowledge/skills
34%

Ranorex Studio Customer Research

What are the top challenges associated with test automation?

Maintaining existing automated tests due to changes in the UI
67%
Creating new automated tests for new features in the software under test
45%
Identifying and Improving flaky tests
37%
Maintaining deployment pipeline and automation environments (VMs, etc.)
27%
Insufficient technical skills on the existing team
23%
Management does not understand the costs and limitations of automated testing
23%



More Research on Ranorex