Tag: Test Execution

Test Case – a set of input values – steps to follow for pre-conditions- and post conditions for a particular test condition.

Major objective of testing- to prevent the defects (focus mostly on tester activity and ignore if generally mentioned as it may reflect to all the team members)

Example of failure – UI feature not working as expected from the customer point of view. (Need to see what are debugging steps and what ui issues)

Which of the following is defect and not a root cause – UI issue noticeable by the customer.

Risk Analysis- focus on areas where defects are noticed earlier – defect clustering

Pesticide paradox- repeating same test cases again and again- improvise to new test cases.

test Design – identifying the data to support test cases

Test implementation – prioritizing hte test procedures and create test data

Test Execution – Analyzing discrepancies to determine their cause

Test completion – Entering CR for open defect reports

Traceability-> test basis and test artifacts-? new test cases has increased the coverage of the requirements.

Tester mindset- ability to see what might go wrong

Fundamentals test process – STLC (Software Testing Life Cycle)

Test Process in context – factors influencing testing

1. SDLC model – and project methodologies influence the entire process of testing
2. Test levels and types considered – based on the functional and non functional
3. Project and product risks based on BA/PO knowledge on similar projects worked or home work made on analysis of the domain.
4. Business Domain
5. Operational constraints
   1. Budgets
   2. Resources
   3. Timeline
   4. Complexity of the code
   5. contractual and regulatory requirements
   6. Organizational practices and practices- no remote work,
6. Internal and external standards – each company involved on the product built may have to be considered.

Test Process

1. Test Planning
2. Test monitoring and Control
3. Test Analysis
4. Test Design
5. Test Implementation
6. Test Execution
7. Test Completion

1. Test Planning – Considers all major plan/layout steps of testing to be done
   1. Overall objective on coverage, defects, severity, risks are decided in this phase.
   2. Scheduling of the testing activities overall on all levels of testing.
   3. Assigning resources based on when the testing will start, who will be doing it – experience versus new comparison and analyze and provide accordingly- share responsibilities
   4. Documentation template- traditional heavy – agile- documentation is simple and light with
   5. Matrices for monitor and controlling
   6. Defining entry and exit criteria
   7. Deciding about automation
2. Test Monitoring and control
   1. Test Monitoring is for the measuring the progress in the project,
      Create matrices to measure the progress of the testing activities. Ex: Coverage Matrix, Traceability Matrix, Execution summary
      Execution rate = total test cases executed/total created*100 = ex: 45%
   2. Test Control – defect closure
      When the plan is made, the control action is also defined so we are prepare whwn te things don’t go right, Steps to take to control the issues and meet the objectives of the test plan.
3. Test Analysis
   1. Analyzing on test Basis – which is used for documentation used for reference for testing, ex: requirements, – sometimes we find defects in the documents like a spec-walk thru form the BSA, where u can see some omissions, inaccuracy etc.
   2. Identify the features to test by going thru the doc – to see what is testable and non-testable.
   3. Define test conditions while finding scenarios
   4. functional and non-functional to be analyzed and filtered separately.
4. Test Design – Phase designing and prioritizing the test cases
   1. you have analyzed know what’s the requirement, and what test cases/scenarios can be written
   2. Test data creation to support the test cases crated
   3. Design the environment- parallelly create the template for the test bases and the test cases, to make sure the requirements are converted to test cases – can be validated either way- as it is suggested as bidirectional matrix (Requirement Traceability matrix)
5. Test Implementation – this is the step to get prepared for Execution
   1. the pre-requisites to be done before test execution- test procedures are the set of actions to do before test execution.
   2. test suite- Collecting all test cases together and say these are the cases to be executed in the phase
   3. test scripts to automate will be prepared in this implementation phase.
   4. Execution schedule- defines the technical, logical, flow and hierarchy for the requirement
   5. Building the QA/Stage/prod environment- confirm the environment is ready and we are good to go with the execution
   6. Test data- required are confirmed and completed here
   7. Bi-directional matrix is reviewed here so all requirements are covered
6. Test Execution – it mainly what testing is all about
   1. Start executing all test cases one by one – each will start with the order of – pre-requisite- and test steps with the test data defined
   2. results are provided as pass/fail – based on the comparison of the expected vs Actual.
   3. if the test case fails- a defect is created and sent to fix
   4. once its fixed confirmation testing is done
   5. once CT is done regression testing is done
7. Test Completion – in traditional we call test closure- in agile we call it as retrospective
   1. In between TE and Test completion – once all te is complete like functional, non functional, upgrade, migration, test data to be added etc.. the exit criteria is evaluated
   2. Exit criteria is met is to confirm, once all the test cases are executed- like objective of the testing is met. once its met we call of testing phase and move to test completion phase- which is a post the test execution phase.
   3. Log reports for the activities done during the earlier phases
      1. defects closed
      2. deferred defects
      3. change request proposed
      4. any new updates
      5. test Summary report which generally contains the overview of all major activities
      6. Finalizing the test cases for regression for future release. this deals with lot of updates and upgrades on the existing release.
      7. Lessons learnt form the completed activities – from all contributor and tester- to improve the process- contributes to maturity- minimize defects- add value to process- more quantitative and qualitative approach.