The client is a fashion ecommerce leader in Spain and Portugal, with 3 development teams of approximately 5 members each.
They perform scheduled releases approximately every 3 weeks.
Manual regression testing consisted of 130 tests across 6 environments (desktop, tablet, and mobile, for Spain and Portugal) on a single device.
A full regression was never conducted as it would have taken approximately 16 hours.
The client had outdated test suites built with SpecFlow, which were not used. These tests were based on hardcoded literals, specific environments, and dependencies like database access. No modern patterns such as page objects or continuous integration were used.
The cost of resources needed to perform reliable regression testing for each release was very high. This resulted in defects being discovered by end-users in production, significantly impacting user experience.
Tests were automated using WebdriverIO, covering web, tablet, and mobile platforms. Execution was parallelized to increase speed.
The entire testing system is orchestrated via a CI/CD server, managed entirely by our team, freeing the client from this task.
A device farm was utilized to execute tests across different browsers, mobile devices, and operating system versions.
Tests can be executed on-demand or linked to a trigger associated with the repository.
The test execution time was reduced from 16 hours to 45 minutes.
An immediate automatic report of all test results is now available.
The green light from automated tests is now considered a guarantee for production deployment. This requirement has increased the product team's confidence in the robustness of every release that passes automated testing.
The number of defects detected in production has drastically decreased, improving the user experience.