Building a Test Strategy in DevOps is not only about Test Automation, but how built-in-quality can be achieved in all steps of the SW development, within and outside of your CI/CD pipeline.
What is the goal of your testing? What quality aspects are more and what are less important for your domain? What are the major risks? What testing steps should be included in a Continuous Integration/Continuous Delivery pipeline, and where to focus with Exploratory Testing? How to utilize the new QA opportunities available by applying DevOps practices? Don’t just string together existing manual processes! – in this tutorial, we will use simple, collaborative tools to design something better!
The interactive workshop will help teams to learn how QA is extended to the left and to the right in DevOps, how to design QA pipeline with simple cards and what other testing related activities to be agreed on, to have a full test strategy.
In this remote compliant, hands-on workshop for teams of 5-6 people, we will use MIRO as an interactive canvas, several digitized card games, as well as Sticky notes to identify parts of a Test Strategy and to design a CI/CD pipeline into its core. (however, we do not use actual CI/CD tools as the technical implementation of the pipeline is not the scope here).
In case the workshop is delivered in real (face-to-face), we use Card Games as well as Sticky notes.
The format is a series of lectures and discussions to share the needed theory, and exercises to practice what we have learnt. Throughout the exercises, teams will build a full Test Strategy for preselected scenarios and contexts in breakout sessions, followed by presentations and discussions.
After the Tutorial the participants shall be able to:
– understand Testing in DevOps
– understand the concepts of CI and CD
– discuss the different product quality aspects of their given business scenario, and their importance
– to design a continuous delivery pipeline (using cards), in line with the business expectations
– to understand what else is needed to build a Test Strategy, like Testing Techniques to be used, Technology that helps to achieve the our goals, as well as skills needed in the testing team.
- understand Testing in DevOps
- understand the concepts of CI and CD
- discuss the different product quality aspects of their given business scenario, and their importance
- to design a continuous delivery pipeline (using cards), in line with the business expectations
- to understand what else is needed to build a Test Strategy, like Testing Techniques to be used, Technology that helps to achieve the our goals, as well as skills needed in the testing team.
The workshop is intended for anyone who is in charge of defining – or just wants to understand how to define – a Quality Assurance Strategy, design a high level Pipeline, describe how and where product risks are reduced, and what other activities are needed. Test Managers, Test Architects, Test Process owners, Development Leads, DevOps leads, OPS, SRE, SDET, DevTest and any Tester who want to see the bigger picture.
The online version of the Workshop is using MIRO, so be prepared with a browser that can handle MIRO, and conference calls. We will work in small teams, so have everything to be able to contribute (camera on, mic on).
In case the Workshop is face-to-face we will just use a few card games, sticky notes and whiteboard.
Duration: 1 day
- Part 1: Build base understanding of a CI/CD Pipeline:
- Understand the base Quality Assurance related steps in a Pipeline
- Understand the Pipeline Game card
- Part 2: Work with different views of Quality and prioritize based on Risk:
- Understand Different views of Quality
- Understand different Quality characteristic of your product (utilizing Test Sphere cards)
- Understand Risk based Testing and assess Quality Characteristics of you product
- Part 3: Redesign the built CI/CD pipeline based on the learnt identified Quality Risks:
- Re-design the pipeline to make Quality Assurance and Risk coverage visible
- Learn to align between Business needs (speed vs. quality)
- Get an overview behind CI/CD practices
- Part 4: Extend to a QA Strategy
- Understand what other aspects a QA Strategy has, that are not covered by a well designed pipeline
- Define additional aspects of the Strategy based on the gathered information (for example: competence development, test environment and data management, reporting, metrics, etc.)
- Part 5: summarize learning by each team
- Each team captures their learning points at each exercise
- We walk through these as part of summary
Some grand rules:
- We discuss in teams, and present
- We learn together, and from each other
- There will be some lectures as well
- Ask, ask, ask There are no bad ideas, or stupid questions