Case Study Vodafone Portugal Test Automation

Optimising Release Testing Through Automation, reducing validation cycles and manual activities to the essential.

In the digital economy, where speed is king, organisations seek to deliver solutions with shorter release cycles, while still ensuring high-quality standards. Testing, as part of a Quality Assurance process, is a crucial stage in the software development lifecycle as it provides the delivery of reliable software.

Automation is gradually gaining acceptance and trust among business and IT teams, either following Waterfall or Agile and DevOps delivery methodologies. Automated testing is particularly critical for regression testing – as, when delivering constant streams of change, several scenarios must be tested across multiple systems and environments.

The Challenge

As part of Vodafone Portugal’s BSS core IT systems, the Siebel upgrade project was a critical piece to continue unleashing the value of the undergoing CSP digital transformation. There was a strong need to automate and streamline the entire process to achieve smaller release cycles, while maintaining the defined quality standards.

Vodafone Portugal challenged Celfocus to accelerate the Siebel upgrade and unlock test automation for the business acceptance validations. Predominantly manual testing activities were being performed, resulting in thorough and time-consuming releases, as well as unproductive human resource management.

The goal was to decrease release approval time for small and large releases, covering automated regression and sanity testing, while also reducing business teams’ workload and effort on tasks that could be automated.

The Solution

With a clear mission to build an automated testing ecosystem, a collaborative Vodafone Portugal and Celfocus team was composed to execute a Siebel testing update and define a set of tests to be automated.

Following the Agile Scrum methodology, the team used Celfocus Automated Testing Framework (ATF) - a proprietary technology-agnostic technical framework for complete and complex testing systems - to automate Siebel regression tests.

The solution applies industry best practices and standards to design and implement rapid, robust, scalable and easily configurable scenarios for multiple testing environments, with highly reduced maintenance efforts. The created test suites can be triggered to run automatically with every release, promoting an ongoing testing under continuous integration/continuous development (CI/CD) contexts. These test suites can also be activated on request or scheduled to be executed at desired times and frequencies.

The team reached three key milestones:

final.png

The delivered test cases covered 12 functional Siebel work areas – such as inventory, configuration orders and user support, and the different scopes of the continuous testing pipelines included mandatory and non-mandatory Siebel regression tests, sanity (also known as smoke) tests and tests per work area.

Vodafone Portugal’s proprietary Test Data Management tool (TDM) was integrated into the  automated testing ecosystem through Celfocus Automated Testing Framework, allowing for an easier and more effective way to build user stories for automate test cases.

Benefits

Celfocus helped Vodafone Portugal to significantly shorten validation cycles, decrease the reliance on business analysts and developers to perform testing-related activities while reducing manual activities to the essential. Furthermore, the framework delivered the following benefits:

  • Easy set-up, configuration and use;
  • State-of-the-art open-source technology;
  • On-demand and scheduled execution capability;
  • Versatility;
  • Reusability.