Please enable JavaScript.
Coggle requires JavaScript to display documents.
Principles of Good Practice - Coggle Diagram
Principles of Good Practice
Fitness for Purpose
The development of VRIPQ
VALIDITY
RELIABILITY
IMPACT
PRACTICALITY
QUALITY MANAGEMENT
Fairness
Tests need to have equal opportunities for test takers.
Test materials should be kept secured for the test takers' answers to not be influenced by other questions/answers.
Test takers' personal data is private.
The results obtained by the test takers should be clear and well explained.
Quality and Accountability
Cambridge English Language Assessment is certified to the ISO 9001 international standard for quality management systems.
Defyning quality:
The system management includes quality assurance activities like:
Risk management: The staff is prepared for the future, so risks are always analyzed.
Non-conformances and corrective actions: Errors are not common, but if they occur they are corrected right away.
Records management: Since data is protected, this helps the staff to follow legsal requirements.
Document control: Staff needs to keep up to date with the correct use of documents.
Delivering Quality:
They work with 2,700 examination centres, and around 40,000 registered preparation centres
They work collaboratively.
There are around 400 staff members, and 40+ offices around the world.
A Process approach:
Defining processes helps with the quality levels.
The Cambridge English Continual Improvement Cycle
Routine test production
Examination Administration
Post Exam processing
Product development
Review and Evaluation
Improvements
A Model for Test Development and Validation
Plan: Product development.
Plan, design and develop a new or a revised test.
Do: The opperational phase.
Routine production of test versions, administrate the test, and exam processing.
Review: Review and assessment.
Elimination of an exam or changes are made.
Communication and Collaboration
Communication and stakeholder support
Information should be clear and accurate.
Opinions and knowledge from the stakeholders are accepted and useful.
Two-way communication is vital.
Information available for stakeholders:
Websites for key markets.
Teacher resources.
Teachers' handbooks.
Coursebooks, tests and extra materials.
Collaborative Arrangements:
Collaborative relations include:
IELTS, BULATS, EAQUALS, IATEFL, etc.
Government departments
Universities
Publishers and media
Validity and validation
Validity can be seen as the ability of a test to produce scores that are true to what the learners know.
The elements in the VRIPQ cannot be evaluated independently.
Building a validity argument:
Usefulness of the test for its intended purpose.
Justification is necessary for every result.
Provide evidence for support.
Validity:
The construct of a test is the theory that the test is based on. So each designed test becomes valid if it reflects on that theory.
The cognitive processes that the takers use to respond the test is also part of its validation.
Reliability:
Reliability concerns the extent to which test results are stable, consistent and free from errors of measurement.
Criterion-related validity, therefore, aims to demonstrate that examination marks are systematically related to some other indicator of what is being measured.
Impact by design:
Maxim 2:support.
Maxim 3: communicate.
Maxim 1: plan.
Maxim 4: monitor and evaluate.
Practicality:
Defined as to what extent to which an examination is practible in terms of resources.