Please enable JavaScript.
Coggle requires JavaScript to display documents.
MASTER - Test process & coverage health check (Dev/Test process ?…
MASTER - Test process & coverage health check
Product
Brief demo/use case
what is the architecture ?
customers ?
roadmap
new features vs maintenance distribution ?
Tech stack ?
Revenue that this product set brings ?
Dev/Test process ?
High level process to manage incoming work for a "squad"?
Rituals/ceremonies?
Plot a timeline of Dev & Test work for a new feature
from inception to Production
Plot a timeline for Dev & Test work for a new feature and bug fix
Where do Dev/Test roles collaborate? Could we collaborate more/early ? if yes, on what ?
How are bugs triaged?
Are Testers involved in testability of features (exploratory & automation perspective)
Are Devs involved in review of test coverage/"plans"?
Are test cases/ideas challenged?
How do we something is ready for testing by a specialist Tester ( QA staff) ?
How do we know Testing is completed?
How do Testers prioritize their testing work ? Do you have a common backlog for work?
Does the Team perform analysis on what could be automated ?
Is there Dev input to it ?
How is it recorded ?
What are the artefacts produced during a typical test cycle ?
Do task/story/bug fix estimates invovle Testing Team and effort ?
Do Devs provide feedback to Testers on how to improve test process,effectiveness of testing ? examples ? forum ?
Are automated tests written for new features that are delivered ?
And/Or for critical bug escapes ?
Test coverage?
Plot the automated test coverage pyramid for your Team
% coverage - unit,integration,UI vs exploratory/manual
For each level understand metrics- frequency of running the tests, maintenance responsibility, stability of tests, business value they provide
Capture metrics for smoke and regression testing , fill matrix .
https://docs.google.com/spreadsheets/d/1t5l1JT_cZz7qpf1qEdnxXjHXHvIlmPENMZW1qVusts8/edit#gid=0
What is the test process when a branch is cut ?
how much of it is automated ?
what is the test coverage when changes are merged ?
how much of it is automated?
Who do you think is responsible for developing automated tests and why ?
Who do you think is responsible for maintaining automated tests and why ?
Non functional Test coverage ? Perf,UX,Security,reliability etc
who should be involved in analyzing what to automate vs not?
Are there dedicated environments for testing?
Are they reflective of PROD ?
No ? In which ways are they not reflective of PROD ?
Test debt?
Has Test Automation feasibility been performed previously in your Team ? If yes, outcomes ?
Top 3 "pain points" for Testing in your Team ?
e.g. Slowing testing down, making testing inefficient, not be able respond to customer issues/feature requests, technical skills, resourcing
why is this a pain point ? what is the impact ?
Legend
What is the customer impact of this?
What is the non-commercial impact of this ?
how are we currently mitigating this ?
Dot voting - 3 options each, what you want to see changed ?
Tool set for testing?
Unit testing framework?
API testing?
Web/Mobile UX testing ?
Web/Mobile functional testing?
Perfformance?