Data Quadrant Awards 2023
Software Testing
SoftwareReviews names Azure DevOps, Selenium, OpenText ALM Octane, CucumberStudio, and Appium as Software Testing Data Quadrant Award Winners.
View Category
Software Testing
Data Quadrant
Data Quadrants are proudly founded in 100% user review data and are free of traditional "magical" components such as market presence and analyst opinion, which are opaque in nature and may be influenced by vendor pressure, financial or otherwise.
The SoftwareReviews Data Quadrant evaluates and ranks products based on feedback from IT and business professionals. The placement of a software in the Data Quadrant indicates its relative ranking as well as its categorization.
Read The In-Depth Report
A thorough evaluation and ranking of all software in an individual category to compare software across every dimension.
- user satisfaction rankings
- |
- vendor capability comparisons
- |
- business value scores
- |
- individual feature evaluations
- |
- emotional connection to products
Note The axes ranges are dynamically adjusted based on minimum and maximum values in the dataset
Evaluate the Complete
Software Experience
When distilled down, the software experience is shaped by both the experience with the software and the relationship with the vendor. Evaluating enterprise software along these two dimensions provides a comprehensive understanding of the product and helps identify vendors that can deliver on both.
Product Features and Satisfaction
The satisfaction is captured in the overall satisfaction score, which is driven by the likelihood of users to recommend the software, combined with user satisfaction across top product features.
Vendor Experience and Capabilities
The vendor relationship is calculated in a weighted average of the satisfaction scores tied to vendor capabilities (e.g. software implementation, training, customer support, product roadmap) as well as emotional response ratings toward the vendor (e.g. trustworthy, respectful, fair).
Gold Medalists
Microsoft Corporation
Azure DevOps
Plan smarter, collaborate better and ship faster with Azure DevOps Services, formerly known as Visual Studio Team Services.
8.9
Composite
Score
Composite
Score
+92
Emotional
Footprint
Emotional
Footprint
91%
Likeliness to
Recommend
Likeliness
to Recommend
Selenium
Selenium
Selenium automates browsers. That's it! What you do with that power is entirely up to you. Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should) also be automated as well.
8.7
Composite
Score
Composite
Score
+91
Emotional
Footprint
Emotional
Footprint
86%
Likeliness to
Recommend
Likeliness
to Recommend
OpenText Corporation
OpenText ALM Octane
OpenText™ ALM Octane includes integrated planning, continuous integration, test management, and release management. With these capabilities, Agile teams and DevOps toolchains deliver high-quality software with insight, traceability, analytics-focused end-to-end visibility, and continuous quality.
8.7
Composite
Score
Composite
Score
+97
Emotional
Footprint
Emotional
Footprint
87%
Likeliness to
Recommend
Likeliness
to Recommend
SmartBear Software
CucumberStudio
Behavior-Driven Development is revolutionizing how organizations build software. CucumberStudio gives your team the platform to succeed with BDD. It's a single source of truth for BDD development your whole team will love.
8.5
Composite
Score
Composite
Score
+98
Emotional
Footprint
Emotional
Footprint
93%
Likeliness to
Recommend
Likeliness
to Recommend
Appium
Appium
Appium is an open source test automation framework for use with native, hybrid and mobile web apps. It drives iOS, Android, and Windows apps using the WebDriver protocol.
8.2
Composite
Score
Composite
Score
+84
Emotional
Footprint
Emotional
Footprint
88%
Likeliness to
Recommend
Likeliness
to Recommend
Vendor Capability Awards
Availability and Quality of Training
CucumberStudio
Breadth of Features
Appium
Business Value Created
CucumberStudio
Ease of Customization
Appium
Ease of Data Integration
CucumberStudio
Ease of IT Administration
CucumberStudio
Ease of Implementation
CucumberStudio
Product Strategy and Rate of Improvement
Appium
Quality of Features
CucumberStudio
Usability and Intuitiveness
CucumberStudio
Vendor Support
Ranorex Studio
Vendor Capability Awards
Availability and Quality of Training
CucumberStudio
Breadth of Features
Appium
Business Value Created
CucumberStudio
Ease of Customization
Appium
Ease of Data Integration
CucumberStudio
Ease of IT Administration
CucumberStudio
Ease of Implementation
CucumberStudio
Product Strategy and Rate of Improvement
Appium
Quality of Features
CucumberStudio
Usability and Intuitiveness
CucumberStudio
Vendor Support
Ranorex Studio
Other Evaluated Vendors
Tricentis
Tricentis Tosca
Tricentis Tosca, the #1 Continuous Testing platform, accelerates testing with a script-less, no-code approach for end-to-end test automation. With support for over 160+ technologies and enterprise applications, Tosca provides resilient test automation for any use case.
7.9
Composite
Score
Composite
Score
+90
Emotional
Footprint
Emotional
Footprint
82%
Likeliness to
Recommend
Likeliness
to Recommend
Inflectra
Inflectra SpiraTeam
Inflectra offers a complete ALM solution. Why only address part of the lifecycle? SpiraTeam has the entire process covered, from requirements, testing, tasks, code, builds and bug-tracking all integrated. Therefore, take control of your project's development and software testing.
7.8
Composite
Score
Composite
Score
+89
Emotional
Footprint
Emotional
Footprint
85%
Likeliness to
Recommend
Likeliness
to Recommend
T-Plan
Test Automation Suite
Supporting all of the major operating systems from Windows, Mac and Linux, desktop GUI automation can be achieved across a network (through VNC) or even locally using a single machine. Automate your entire desktop environment, or a select number of features and applications. Drive the desktop, physical or virtual machines, using the standard interaction methods of mouse and keyboard.
7.6
Composite
Score
Composite
Score
+95
Emotional
Footprint
Emotional
Footprint
87%
Likeliness to
Recommend
Likeliness
to Recommend
Idera Software
TestRail
A complete web-based test case management solution to efficiently manage, track, and organize your software testing efforts.
7.6
Composite
Score
Composite
Score
+85
Emotional
Footprint
Emotional
Footprint
82%
Likeliness to
Recommend
Likeliness
to Recommend
Ranorex
Ranorex Studio
Test Automation for All. Everyone from novice to expert can build sophisticated tests for desktop, web, and mobile. Ranorex Studio also integrates with a new product in the suite, Ranorex DesignWise. DesignWise is a test design optimization tool used to ensure tests are created for automation that maximize coverage with as few tests as possible. Users can create Gherkin, BDD-style optimized scripts inside DesignWise that are then executed by Studio.
7.6
Composite
Score
Composite
Score
+79
Emotional
Footprint
Emotional
Footprint
86%
Likeliness to
Recommend
Likeliness
to Recommend
Parasoft
Parasoft Continuous Quality Suite
Parasoft’s suite of automated software testing tools integrates quality into the software delivery process for early prevention, detection, and remediation of defects. The continuous quality suite covers static code analysis, unit testing and code coverage, API testing and service virtualization, and UI testing enabling delivery at speed and compliance with industry and security standards.
7.4
Composite
Score
Composite
Score
+86
Emotional
Footprint
Emotional
Footprint
82%
Likeliness to
Recommend
Likeliness
to Recommend
Practitest
PractiTest
PractiTest is an end-to-end SaaS test management platform that enables you to manage all your QA efforts in one place. With PractiTest you can visualize your data to extract valuable actionable insights and collaborate with all teams to reach business goals.
7.4
Composite
Score
Composite
Score
+86
Emotional
Footprint
Emotional
Footprint
82%
Likeliness to
Recommend
Likeliness
to Recommend
SmartBear Software
TestComplete
Scale your automated testing efforts and maximize test coverage with the powerful capabilities of TestComplete.
7.1
Composite
Score
Composite
Score
+85
Emotional
Footprint
Emotional
Footprint
83%
Likeliness to
Recommend
Likeliness
to Recommend
IBM
IBM Engineering Test Management
IBM® Engineering Test Management (formerly RQM) offers comprehensive test planning, test construction, and test artifact management throughout the development lifecycle. It enables teams to meet their software quality goals and improve efficiency and accuracy in a continuous delivery environment.
7.1
Composite
Score
Composite
Score
+78
Emotional
Footprint
Emotional
Footprint
77%
Likeliness to
Recommend
Likeliness
to Recommend
Sauce Labs
Sauce Labs
Build the most comprehensive mobile app testing strategy, from development to production
7.0
Composite
Score
Composite
Score
+82
Emotional
Footprint
Emotional
Footprint
77%
Likeliness to
Recommend
Likeliness
to Recommend
SmartBear Software
Zephyr
Software Testing As Agile As You Need It to Be Spend less time testing and more time building. From agile development to predictive analytics, you'll achieve full Continuous Testing Agility.
6.8
Composite
Score
Composite
Score
+71
Emotional
Footprint
Emotional
Footprint
81%
Likeliness to
Recommend
Likeliness
to Recommend
For the full list of vendors in this space, click here.
About Gold Medal Awards and Software Reports
SoftwareReviews Gold Medal Awards recognize outstanding vendors in the technology marketplace as evaluated by their users. Gold Medals are the capstone of an in-depth software evaluation report, and awarded using a proprietary, transparent methodology based on a composite satisfaction score that averages four different areas of evaluation: Net Emotional Footprint, Vendor Capabilities, Product Features, and Likeliness to Recommend. The Net Emotional Footprint Score measures user emotional response ratings of the vendor (e.g. trustworthy, respectful, fair).
Software Reports present comprehensive evaluations of software vendors on the above elements. Software buyers can use this data to make more informed, data-driven software purchasing and renewal decisions.
