Successful Test Engineering and The ISTQB Programme for Professional Capability Development | The Specialist Stream

The Specialist Stream

The Specialist Stream contains a number of units that have been developed specifically to address:

• Non-functional Testing and its constituent parts;
• Industry specific requirements;
• Technical requirements.

It differs from the other streams in that it is boundless on what it can achieve as new qualifications are launched to expand upon the three-points immediately above, where the other qualifications specifically address the functional, strategic and management aspects of testing and test management.

Building on the principles taught at Foundation Level, the Specialist stream contains 11 key syllabi, each constructed to meet specific requirements beyond the functional aspect options:

• Usability Testing, which looks at how systems are used, both in terms of flexibility and disability access.
  
  
• Game Testing, which has been developed to manage the complications of distributed games in real time.
  
  
• Gambling Industry Sector, developed specifically for organizations offering online betting, payment management, etc.
  
  
• Automotive Software Tester, developed specifically to manage the increasing complication of software in cards, such as satellite navigation, infotainment and internal systems management.
  
  
• AI Testing, developed to help testers plan and execute testing in the increasingly complex space of artificial Intelligence;
  
  
• Acceptance Testing, addresses User Acceptance, contractual & Regulatory Testing I.e., do systems meet all acceptance criteria in order for them to be made ‘live.’
  
  
• Security Tester, an increasingly complex aspect of IT, the syllabus has bene developed to build security in, rather than afterwards;
  
  
• Performance Tester, which helps designers and specialists think about the performance of a system when made live and increased usage in the future;
  
  
• Model Based Tester, which helps develop models for te4sting, rather than a simple functional approach.
  
  
• Test Automation Engineer to help individuals build test automation strategies and frameworks.
  
  
• Mobile Application Testing for specifics to meet the needs of mobile and tablet-based applications.

People intending to sit and gain a certification in this stream will need to have obtained a certificate at Foundation level first.

There is no interdependency between the certifications in this stream; although to attempt them requires a prior pass at Foundation Level (at any Version level).

The Usability Tester

The Usability Tester focuses on usability testing methods and approaches. It covers set up procedures from a usability, user experience, and accessibility, as well as relevant standards and risks.

The syllabus addresses key subjects that include:

• Basic Concepts;
• Risks in Usability, User Experience and Accessibility;
• Usability and Accessibility Standards;
• Usability Reviews;
• Usability Testing;
• User Surveys;
• Selecting Appropriate Methods
• Summary of Roles and Responsibilities.

The syllabus is shown on page 46, and can be further downloaded here. The exam is multiple choice, with 40 questions identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Understand the basic concepts of usability and usability testing;
• Identify and classify the severity of usability risks and potential accessibility violations in a given product at any stage of a development cycle;
• Cite relevant standards for usability, user experience, and accessibility and verify their implementation in a given product;
• Set up procedures so that stated usability, user experience and accessibility goals may be verified in practice for a given product;
• Design and monitor the implementation of a test plan for achieving stated usability, user experience and accessibility goals;
• Explain the rationale, process and results of usability, user experience and accessibility evaluations to non-specialist stakeholders.
  
  

ISTQB Usability Tester Syllabus

Game Testing

The Game Testing certification focusses on the understanding and skills needed to perform and manage testing on all levels in game projects. It covers the basic concepts of video and game testing as well as how to determine risks and goals for gaming software. It includes conceptually designing, implementing and executing game software tests, approaches to games testing (Game Testing Mechanics, Sound Testing, Graphics Testing and Localization) and recognizing games testing tools.

The syllabus addresses key subjects that include:

• Specificity of Game Testing;
• Testing Game Mechanics;
• Graphics Testing;
• Sound Testing;
• Game Level Testing;
• Game Controllers Testing;
• Localization Testing.

The syllabus is shown on page 48, and can be further downloaded here. The exam is multiple choice, with 40 questions identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Describe basic concepts of video games and game software testing;
• Determine risks, goals and game software requirements under the needs and expectations of stakeholders;
• Conceptually design, implement and execute basic game software tests;
• Know the approaches to game software testing and their purpose;
• Recognize the tools supporting game testing;
• Determine how testing activities align with the software development lifecycle and reduce the cost of developing and publishing video games.

ISTQB Game Tester Syllabus

Gambling Industry Sector

The Gambling Industry Tester (CT-GT) certification covers the key concepts in the gambling industry, the gambling industry ecosystem, and the different test types common to the gambling industry. It includes aspects such as gambling industry compliance testing, fun factor or player perspective testing, math testing, audio testing, multiplayer testing, and interoperability testing.

The syllabus addresses key subjects that include:

• Introduction to the Gambling Industry;
• The Gambling industry Ecosystems;
• Testing in the Gambling Industry.

The syllabus is shown on page 50, and can be further downloaded here. The exam is multiple choice, with 40 questions identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Promote efficient and effective communication by using a common vocabulary inside the gambling industry;
• Understand specific quality attributes that require testing within the gambling industry;
• Understand typical test practices by describing the standard software development and testing methodologies within the gambling industry;
• Understand gambling hardware and software certification which is the main difference between the gambling industry and other industries;
• Use established techniques for designing tests aligned with gambling specific needs;
• Appreciate the importance of jurisdictions and regulatory bodies in the gambling industry.
• In general, a Certified Foundation Level Gambling Industry Tester Specialist is expected to have acquired the necessary skills to working effectively within a Gambling Industry testing team and environment.

Automotive Software Tester

The Automotive Software Tester (CT-AuT) certification focuses on the specific requirements for “testing E/E systems” in the automotive environment on the basis of established standards (Automotive SPICE®, ISO 26262, AUTOSAR®, etc.). It also covers testing in virtual environments (including XiL), and automotive-specific static and dynamic test techniques.

The syllabus addresses key subjects that include:

• Introduction to Automotive Software Testing;
• Standards for the Testing of E/E Systems;
• Testing in a Virtual Environment;
• Automotive Specific Static and Dynamic Test Techniques.

The syllabus is shown on page 52, and can be further downloaded here. The exam is multiple choice, with 40 questions identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Collaborate effectively in a test team;
• Adapt the test techniques known from the ISTQB® Certified Tester Foundation Level (CTFL®) to the specific automotive project requirements;
• Consider the basic requirements of the relevant automotive standards (Automotive SPICE®, ISO 26262, etc.) and select suitable test techniques;
• Apply the virtual test methods (e.g., HiL, SiL, MiL, etc.) in test environments.

 ISTQB Automotive Tester Syllabus

Artificial Intelligence (AI) Testing

Increasingly in demand and growing in importance t out everyday lives, AI Testing (CT-AI) certification extends understanding of artificial intelligence and/or deep (machine) learning, most specifically testing AI-based systems and using AI in testing.

The syllabus addresses key subjects that include:

• Introduction to AI;
• Quality Characteristics for AI Based Systems;
• Machine Learning (ML) Overview;
• ML Data;
• ML Functional Performance Metrics;
• ML Neural Networks and Testing;
• Testing AI-Based Systems – Overview;
• Testing Ai Specific Quality Characteristics;
• Methods and Techniques for Testing of AI-Based Systems;
• Test Environments for AI-Based Systems;
• Using AI for Testing.

The syllabus is shown on page 54, and can be further downloaded here. The exam is multiple choice, with 40 questions of varying value totalling 47 points. 31 points be gained in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Understand the current state and expected trends of AI;
• Experience the implementation and testing of a ML model and recognize where testers can best influence its quality;
• Understand the challenges associated with testing AI-Based systems, such as their self-learning capabilities, bias, ethics, complexity, non-determinism, transparency and explainability;
• Contribute to the test strategy for an AI-Based system;
• Design and execute test cases for AI-based systems;
• Recognize the special requirements for the test infrastructure to support the testing of AI-based systems;
• Understand how AI can be used to support software testing.
  
  

ISTQB Artificial Intelligence Tester Syllabus

Acceptance Testing

The Acceptance Testing (CT-AcT) certification focuses on the concepts, methods, and practices of collaboration between product owners/business analysts and testers in acceptance testing. It covers user acceptance testing (UAT), contractual and regulatory acceptance testing, as well as alpha and beta testing.

The syllabus addresses key subjects that include:

• Introduction and Foundations;
• Acceptance Tests, Acceptance Criteria;
• Business Process and Business Rules Modelling;
• Acceptance Testing for Non-Functional Requirements.

The syllabus is shown on page 56 and can be further downloaded here. The exam is multiple choice, with 40 questions identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following outcomes:

For business analysts and product owners:

• Contribute to an organization’s acceptance testing activities by participating in the acceptance test design phase and supporting the alignment of the product with the business requirements;
• Contribute to an organization’s acceptance testing activities by participating in the acceptance test design phase and supporting the alignment of the product with the business requirements;
• Contribute to the quality of the acceptance testing process, including validation and verification of produced artifacts.

For testers:

• Contribute to the definition of acceptance criteria during the requirements definition phase;
• Collaborate efficiently with business analysts and other stakeholders during all acceptance testing activities:
• Understand the business objectives, communicate with business units, and share common objectives for acceptance testing.

ISTQB Acceptance Tester Syllabus

Security Tester

Increasingly important in today’s world of widespread online fraud and hacking, the Security Tester (CT-SEC) certification focuses on planning, performing, and evaluating security tests from multiple perspectives including risk, requirements, vulnerability, and human factors. It also covers security testing tools and standards.

The syllabus addresses key subjects that include:

• The Basis of Security Testing;
• Security Testing Purpose, Strategy and Goals;
• Security Testing Processes;
• Security Testing Throughout the Software Lifecycle;
• Testing Security mechanisms;
• Human Factors in Security Testing;
• Security Test Evaluation and Reporting;
• Security Testing Tools;
• Standards and Industry Trends.

The syllabus is shown on page 58 and can be further downloaded here. The exam is multiple choice, with 48 questions of varying value totalling 80 points. 52 points need to be gained in 120-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Plan, perform and evaluate security tests from a variety of perspectives – policy-based, risk-based, standards-based, requirements-based and vulnerability-based.
• Align security test activities with project lifecycle activities.
• Analyze the effective use of risk assessment techniques in a given situation to identify current and future security threats and assess their severity levels.
• Evaluate the existing security test suite and identify any additional security tests.
• Analyze a given set of security policies and procedures, along with security test results, to determine effectiveness.
• For a given project scenario, identify security test objectives based on functionality, technology attributes and known vulnerabilities.
• Analyze a given situation and determine which security testing approaches are most likely to succeed in that situation.
• Identify areas where additional or enhanced security testing may be needed.
• Evaluate effectiveness of security mechanisms.
• Help the organization build information security awareness.
• Demonstrate the attacker mentality by discovering key information about a target, performing actions on a test application in a protected environment that a malicious person would perform, and understand how evidence of the attack could be deleted.
• Analyze a given interim security test status report to determine the level of accuracy, understandability, and stakeholder appropriateness.
• Analyze and document security test needs to be addressed by one or more tools.
• Analyze and select candidate security test tools for a given tool search based on specified needs.
• Understand the benefits of using security testing standards and where to find them.

ISTQB Security Tester Syllabus

Performance Tester

The Performance Testing (CT-PT) certification provides knowledge of the principal aspects of performance testing, including technical aspects, method-based aspects, and organizational aspects. Specifically pertaining to performance testing, it covers areas such as basic concepts, measurements, activities, tasks, and tools.

The syllabus addresses key subjects that include:

• Basic Concepts;
• Performance Measurement Fundamentals;
• Performance Testing in the Software Lifecycle;
• Performance Testing Tasks

The syllabus is shown on page 60 and can be further downloaded here. The exam is multiple choice, with 40 questions identical value, of which 26 must be answered correctly in 90-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Understand the basic concepts of performance efficiency and performance testing;
• Define performance risks, goals, and requirements to meet stakeholder needs and expectations;
• Understand performance metrics and how to collect them;
• Develop a performance test plan for achieving stated goals and requirements;
• Conceptually design, implement, and execute basic performance tests;
• Analyze the results of a performance test and state implications to various stakeholders;
• Explain the process, rationale, results, and implications of performance testing to various stakeholders;
• Understand categories and uses for performance tools and criteria for their selection;
• Determine how performance testing activities align with the software lifecycle.

ISTQB Performance Tester Syllabus

Model Based Tester

The Model-Based Testing (CT-MBT) certification focuses on an advanced test approach of using models for testing. It extends and supports classic test design techniques such as equivalence partitioning, boundary value analysis, decision table testing, state transition testing, and use case testing. It is an innovative approach to improve effectivity and efficiency of the test process.

The syllabus addresses key subjects that include:

• Introduction to Model Based Testing (MBT);
• MBT Modelling;
• Selection Criteria for Test Case Generation;
• MBT Test Implementation and Execution;
• Evaluating and Deploying an MBT Approach.

The syllabus is shown on page 62 and can be further downloaded here. The exam is multiple choice, with 40 questions of identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Collaborate in a model-based testing team using standard terminology and established MBT concepts, processes and techniques;
• Apply and integrate model-based testing in a test process;
• Effectively create and maintain MBT models using established techniques and best practices of model-based testing;
• Select, create and maintain test artifacts from MBT models considering risk and value of the features tested;
• Support the organization to improve its quality assurance process to be more constructive and efficient.
• In general, an ISTQB® Model-Based Tester has acquired the necessary skills to successfully contribute to MBT projects in a given context.

ISTQB Model Based Tester Syllabus

Test Automation Engineer

The Test Automation Engineer (CT-TAE) certification focuses on the design, development, and maintenance of test automation solutions. It also covers the concepts, methods, tools, and processes for automating dynamic functional tests, and the relationship of those tests to test management, configuration management, defect management, software development processes, and quality assurance. Methods described are generally applicable across a variety of software life cycle approaches, types of software systems, and test types.

The syllabus addresses key subjects that include:

• Introduction and Objectives for Test Automation;
• Preparing for Test Automation;
• The Generic Test Automation Architecture;
• Deployment Risk and Contingencies;
• Test Automation Reporting and Metrics;
• Transitioning Manual Testing to an Automated Environment;
• Verifying the Test Automation Suite (TAS);
• Continuous Improvement.

The syllabus is shown on page 64 and can be further downloaded here. The exam is multiple choice, with 40 questions of varying value totalling 70 points. 49 points need to be gained in 90-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Contribute to the development of a plan to integrate automated testing within the testing process;
• Evaluate tools and technology for automation best fit to each project and organization;
• Create an approach and methodology for building a test automation architecture (TAA);
• Design and develop (new or modified) test automation solutions that meet the business needs;
• Enable the transition of testing from a manual to an automated approach;
• Create automated test reporting and metrics collection;
• Manage and optimize testing assets to facilitate maintainability and address evolving (test) systems.

 ISTQB Test Automation Engineer Syllabus

Mobile Application Testing

The Mobile Application Testing (CT-MAT) certification provides an insight into methods, techniques, and tools a professional may use to test mobile applications. It covers the required mobile project activities, roles, methods, and methodologies.

The syllabus addresses key subjects that include:

• Mobile World – Business and Technology Drivers;
• Mobile Application Test Types;
• Common Test Types and Test Process for Mobile Application;
• Mobile Applications, Platforms, Tools and Environments;
• Automating the Test Execution.

The syllabus is shown on page 66 and can be further downloaded here. The exam is multiple choice, with 40 questions of identical value, of which 26 must be answered correctly in 60-minutes to be awarded a pass.

People sitting and passing an exam should expect the following business-based outcomes:

• Understand and review business and technology drivers for mobile apps in order to create a test strategy;
• Identify and understand the key challenges, risks and expectations associated with testing a mobile application;
• Apply test types and levels specific to mobile applications;
• Apply common test types, such as those mentioned in ISTQB® Certified Tester Foundation Level syllabus 2018, in the mobile specific context;
• Carry out the activities required specifically for mobile application testing as part of the main activities of the ISTQB® test process;
• Identify and use suitable environments and appropriate tools for mobile application testing;

Understand methods and tools specifically to support mobile application test automation.