Case Study: Sports Fan Enthusiast App Provider Leverages Quick Start with QA-as-a-Service

Context:

Then

First mover Sports Fan Enthusiast Provider was running lean but was failing on deploying test execution at scale to meet the demand of their DevOps process. They understood they needed to apply firepower to their test efforts but also needed to maintain existing output at current resource levels. Their architecture – Mobile and Web Applications – was perfectly aligned to the use of using ML and AI for test. They needed a fast-track engagement and onboarding process that would ID bugs quickly with as much automation as possible. They also needed services to align with a fully deployed CICD model.

Now

Mammoth-AI’s seasoned professionals with their automation engineering expertise provided rapidly deployed automation using tried and true knowledge acquisition model of business flows and application execution, along with the most advanced software platform available to execute testing against web and mobile applications.

APPLICATION UNDER TEST:

Then

Based on Client’s DevOps and continuous feature set creation, test execution was interim, ad hoc and left many gaps. There was simply no way for testing efforts to keep pace with development.

Now

Today modification is handled very easily with the help of Machine Learning. Execution after every release is very smooth and delivery and release to production is seamless and fast.

TESTING REGIME:

Then

Creation, execution, and maintenance of new scripts was a tedious task to perform in existing conventional automation tool. In addition, execution results were poor and not detailed enough to understand scope and impact of results.

Now

Today automated test scripts are run daily in production and in client’s staging environment with a very detailed dashboard and useful execution report. AI blueprinting is performed weekly and identifies issues prior to a build going to production. Client gains near real-time visibility of any issues. In addition, performance tests are run in production and in staging.

TEST CREATION:

Then

Maintenance and creation of new scripts was stopped as it required too much effort and produced results that were not meaningful nor actionable.

Now

Test automation set-up and script creation cycle times are now massively reduced, taking 1 to 2 days. Most modifications are completed within hours.

RELIABILITY:

Then

Modifications and site changes were performed without knowing if there were any performance implications. No visibility of potential downstream impacts on any given release.

Now

Today test execution is fast, vast and meaningful in that Client is receiving near 100% coverage and visibility of the application being tested. With unrivaled speed of execution and reliability, Client can now rest assured that bugs are identified quickly and do not slip into production on any release.