TechValidate Research on TestRail by Gurock

Introduction

This case study of Datrium Inc. is based on a June 2019 survey of TestRail customers by TechValidate, a 3rd-party research service.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

• Said the following are their top software testing pain points:
  • Managing the test environment including data, scripts, automation code, etc.

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

• Has 21-40 Testers on their team.
• Used TestLink prior to using TestRail by Gurock.
• Integrated TestRail by Gurock with the following issue tracking tools:
  • Bugzilla
• Using the following as test automation tools:
  • Custom

Results

The surveyed company achieved the following results with TestRail:

• TestRail by Gurock helped solve the top challenges of:
  • Documenting test cases and plans
  • Tracking the progress of test runs
  • Balancing the testing team’s workload
• Realized the following benefits with TestRail:
  • Increased efficiency
  • Enjoyed the user and team friendly User Interface (UI)
  • Improved productivity because it was easy to train users

Introduction

This case study of Ript Labs is based on a July 2017 survey of TestRail customers by TechValidate, a 3rd-party research service.

Challenges

The business challenges that led the profiled company to evaluate and ultimately select TestRail:

• Top pain points as a Tester:
  • Testing the product / project / people / process to identify risks and issues (bugs)
  • Communicating what has been identified, in the right way, to the right person, at the right time so it gets the necessary attention
  • Managing their environment for testing and development (of scripts, test code, etc.)
  • Learning about the product / project / domain to better identify and contextualize risks / issues and how best to communicate them
  • Focusing energies on the most important things and knowing when to escalate or ask for help
  • Developing strong relationships with developers, other testers, BA’s/PO’s/PM’s
  • Staying on top of trends, tools, techniques, and technologies so as to be best placed to deal with current and emerging challenges
• Top challenges that require Test Management:
  • Clearing requirements (dev team is building the wrong product)
  • Insight into development progress (tests as indicators of progression, tests as documentation, bugs and issues as indicators of risks, process challenges, etc.)
  • Deployment and the idea that progressing through various environments with associated (possibly automated) testing will increase confidence that the product can be deployed successfully and will work properly in a production situation
  • Maintenance and reproduction / documentation / communication of customer support issues, production telemetry, and testing

Use Case

The key features and functionalities of TestRail that the surveyed company uses:

• Has a single Testers on their team.
• Used the following test management tools prior to TestRail:
  • TestLink
  • Zephyr Enterprise
  • Spira Team
• Integrated the following tool with TestRail:
  • JIRA

Results

The surveyed company achieved the following results with TestRail:

• Increased their productivity by more than 20% (saved 6+ hours a week) after switching their software testing solution.
• Realized the following benefits with TestRail:
  • Increased efficiency
  • Improved flexibility due to ease of use
  • Received transparent pricing with good value
  • Enjoyed the user and team friendly User Interface (UI)
  • Agreed it was easy to integrate with 3rd party tools
  • Improved productivity because it was easy to train users