Case Study: Retail Apparel Powerhouse

Context:

Then

A retail apparel powerhouse had challenges performing end-to-end testing from their E-commerce site, mobile applications, and POS to their OMNI OMS application. They needed a competitive edge, that would provide a way to reduce their cycle times, increase their coverage and reduce their cost and risk using automation testing. They also needed a way to see if code changes impacted performance on their site.

Now

Mammoth-AI LLC using AIQ, has provided the retail apparel powerhouse with an end-to-end testing solution. The solution reduces the testing cycle times by over 70%. Client is now able to execute end-to-end tests across all channels, test applications in their entirety – not just happy path and gain real-time understanding of the health of each build. By adopting ML/AI in test, client has significantly increased test execution and automation across entire code bases while reducing effort.

APPLICATION UNDER TEST:

Then

Client’s use of automation was minimal and only for web and some tests for mobile apps. The OMS system was not tested regularly, and it was a tedious task to perform. No performance test capability existed. Testing was siloed based on application and type, and there was no end-to-end testing.

Now

Automation has been created for web, mobile-web, and mobile apps. In addition, the results of all tests regardless of application or device can be seen in a single dashboard. End-to-end testing is now able to be performed and includes orders from their OMNI and POS systems.

TESTING REGIME:

Then

Client’s use of automation was minimal and only for web and some tests for mobile apps. The OMS system was not tested regularly, and it was a tedious task to perform. No performance test capability existed. Testing was siloed based on application and type, and there was no end-to-end testing.

Now

Automation has been created for web, mobile-web, and mobile apps. In addition, the results of all tests regardless of application or device can be seen in a single dashboard. End-to-end testing is now able to be performed and includes orders from their OMNI and POS systems.

TEST CREATION:

Then

Test automation set-up and script creation could take several weeks. Modification to scripts would take several days.

Now

Test automation set-up and script creation cycle times are now massively reduced, taking 1 to 2 days. Most modifications are completed within hours.

RELIABILITY:

Then

Modifications and site changes were performed without knowing if there were any performance implications. No visibility of potential downstream impacts to systems.

Now

Performance scripts are run in lower-level environments and in production after a deployment – providing full visibility thru the build cycle, reducing run-rate and enhancing reliability.

QA Management Highlights

Automation engineers are now capable of creating and executing test cases by physically executing and recording scripts in with a low-code automation engine. End-to-end testing is performed by easily adding wait statements to adjust for processing times. International order creation and shipping are automated and testing cycles are reduced.
Performance and load testing has been built into the testing process and now performed on-demand. The unpredictability of impact downstream has been massively reduced.

Low code script execution
ML enabled self-healing of scripts with reduced maintenance by 90%
Keep pace with CICD process
End to end coverage at every build with Autonomous Testing using AI
On-demand AppPen testing built-in
Easy expansion and scalability
Significant risk reduction