In vocational education and training, what is assessment?

In vocational education and training, what is assessment?

  • In the VET sector, assessment refers to the process of collecting evidence for making judgments about an individual’s competence or ability to perform a task or role against a standard expected in the workplace.
  • This usually involves collecting evidence of performance and making comparisons to pre-determined standards.
  • The purpose of assessment in the VET sector is to provide a way for students to demonstrate their skills and knowledge in relation to specific competencies.
  • This allows students to show that they have the ability to perform tasks and meet standards required for particular occupations or roles.

The assessments are also used for:

  • Determining how far along one is in the process of becoming competent.
  • Meeting licensing and/or regulatory requirements and guidelines.

The assessments are also used for:

  • Potential strengths and development areas
  • Suitability for a particular role or task
  • LLN needs
  • Training gaps
  • Recognise current existing competency of candidates 
  • Measure work performance 
  • Meet organisational requirements for work

As part of vocational education and training, assessment is the process of gathering evidence to make judgements about whether a learner has displayed the required skills, knowledge and attitudes to meet the standards for a particular qualification or training product. This evidence can come in many forms, including observation, tasks or projects completed, tests or written examinations. Once gathered, it is used to make a judgement about whether the learner has met the standards required. If they have, they will be awarded the training product. If not, they may be given feedback and guidance on how to improve.

Assessment is an important part of vocational education and training as it ensures that learners are receiving a quality education and that they are able to demonstrate the skills and knowledge required for their chosen field. The assessment provides a way for trainers/assessors to measure a learner’s progress and identify areas where they need more support. It can also be used to help learners understand their own strengths and weaknesses, and set goals for their future learning.

There are two main types of assessment: formative and summative.

Formative assessment is ongoing and happens throughout a course, while summative assessment usually takes place at the end of a course. Both types of assessment are important in vocational education and training. Formative assessment is used to help learners understand what they need to do to improve. It gives them feedback on their progress and allows them to make changes to their learning. Formative assessments are often given in small chunks as part of regular classwork.

The principles of formative assessment

  • Assessment should be closely linked to learning objectives.
  • Assessment tasks should be designed to allow learners to demonstrate their full range of knowledge, skills and abilities.
  • Assessment tasks should be realistic and authentic, where possible.
  • Feedback on performance should be timely, specific and constructive.
  • Learners should be given opportunities to reflect on their own learning and assess their progress against agreed goals.
  • Assessments should provide opportunities for collaboration and cooperation between learners.
  • The use of technology can enhance the effectiveness of formative assessment by providing real-time feedback and enabling collaboration between learners in different locations.
  • Assessments should be designed to promote lifelong learning skills such as self-awareness, problem-solving and reflection.
  • The purpose and process of assessment should be made explicit to learners.
  • Assessment practices should be regularly reviewed and revised in light of changing needs and developments in educational research.

Summative assessment is used to judge whether a learner has met the standards for a particular qualification. Summative assessments are usually more comprehensive than formative assessments, and they often include multiple assessments or tests over time.

The principles of summative assessment

  • The summative assessment should focus on the individual’s needs and requirements and align with the learning outcomes.
  • Summative assessment should be used to make decisions about learners’ competency.
  • Summative assessment should meet principles of assessment and rules of evidence.
  • Summative assessment should involve all stakeholders.
  • Summative assessment should use a variety of assessment methods to gather evidence.
  • Summative assessment should focus on the product rather than the process.
  • Summative assessment should be conducted over a time period.
  • Summative assessment should be transparent and understandable. The product should be a stand-alone product with all instructions included.
  • Summative assessment should cover and assess students on all aspects of the training product.
  • Summative assessment should be used to promote lifelong learning.

Both formative and summative assessments have their place in VET. Each has different purposes and uses different methods to gather evidence. By understanding the principles of each type of assessment, VET practitioners can choose the most appropriate assessment methods to meet the needs of their students, employers and the wider community.

As discussed both formative and summative assessments are important in vocational education and training. They both provide valuable information that can be used to improve the quality of education and training.

Both formative and summative assessment have their own advantages and disadvantages. Formative assessment is often seen as more beneficial to the student, as it can provide ongoing feedback and allow for modifications to the learning plan.

However, summative assessment can be more accurate in measuring achievement and may be necessary for making decisions about progression or certification. Ultimately, the decision of which type of assessment to use will depend on the specific needs of the learner and the goals of the vocational education and training program.

Principles of assessment

An easy way to learn them:

“Life isn’t fair, so you have to be flexible”
“What’s the point of being valid if you’re not reliable?”


What are the principles of assessment?

Fairness

During the RTO Assessment process, the Fairness principle considers the individual learner’s needs.

What steps do RTOs take to ensure that the assessment process is fair?

The learning needs of individual learners are the responsibility of the RTO, and this can be done by incorporating ‘reasonable adjustments’.

The term ‘reasonable adjustments must be understood to mean adjustments that do not compromise the integrity of the training/assessment or cause undue hardship to the RTO.

The concept of “reasonable adjustments” basically means that RTOs should be able to offer the same training and education opportunities to learners with disabilities or special needs as those without.

Additionally, the RTO must ensure that the learner understands the assessment process and has the right to challenge the assessment outcomes.

This should be documented in the RTO Assessment tool as evidence that the learner has been told about the process and understands it.

A reassessment can be conducted if needed according to the principles of fairness.

As a result of this principle, learners will be able to access training and will not be disadvantaged in the process if they require additional support. Creating a level playing field, ensures fairness.

Flexibility

During the RTO Assessment process, the flexibility principle considers the individual learner’s needs.

What steps do RTOs take to ensure that the assessment process is flexible?

When RTO Assessment is conducted, the Flexibility principle, like the Fairness principle, considers the various needs of learners.

It ensures that assessments are responsive to the needs of individual students and their particular learning styles and preferences.

There are a number of ways that RTOs can demonstrate flexibility in their assessment processes. Some examples include:

Allowing students to submit photos, audio recordings, or videos as evidence

Using drawing boards, visual aids, or sound recordings during the assessment process

Providing opportunities for students to interact with various mediums during the assessment process

Flexibility in assessment ensures that all students have an equal opportunity to demonstrate their knowledge and skills, regardless of their learning style or preference. This ultimately leads to more accurate and reliable assessment outcomes.

Validity

Training providers justify assessment decisions based on evidence of student performance.

What steps do RTOs take to ensure that the assessment process is valid?

This means that the assessments used must be able to accurately measure the skills and knowledge required for the particular job or task.

Demonstrating the principle of validity in the assessment process is essential to ensuring that assessments are fit for purpose and produce reliable results.

Qualified students are only awarded qualifications or recognised as competent for a particular job or task if they meet the required standards.

Based on performance evidence, the Validity principle ensures that RTO Assessment decisions are valid. In essence, it means that the assessment process does what it claims, that is, assesses each learner’s competency. This process must meet the following requirements in order to be valid:

Competent performance requires a broad range of skills and knowledge that are assessed

The assessment of knowledge and skills is integrated with the application of those skills

As a result of the assessment, the learner can demonstrate skills and knowledge when needed

A competency can be determined by aligning the learner’s performance with a unit or units of competency and the requirements for assessment

Your RTO Assessment tool must be able to confirm the repeatability of performance and address all requirements of each unit. In order for an assessment to be valid, it cannot omit anything from the unit or require anything beyond what is required.

The training and assessment process in the VET sector is underpinned by the principle of validity. There are a number of ways in which this principle can be demonstrated in the assessment process:

1. The content of the assessment must be relevant to the skills and knowledge required for the job or task.
2. The assessment tasks must be designed to allow candidates to demonstrate their skills and knowledge in a way that is meaningful and useful.
3. The assessor must have the necessary expertise and experience to properly understand and interpret the candidate’s performance on the assessment tasks.
4. The assessment process must be conducted in a fair and unbiased manner.
5. The results of the assessment must be accurately reported and used appropriately to make decisions about the candidate’s skills, knowledge and suitability for the job or task.

Reliability

RTO Assessments must be consistent, meaning that all assessors should reach the same conclusion regarding the learner’s competency given the same conditions for the same unit of competency.

What steps do RTOs take to ensure that the assessment process is Reliable?

One way to ensure reliability in the assessment process is to provide assessors with written questions and answers for each assessment task.

This allows assessors to familiarise themselves with the content of the task, and to identify any areas where they may need further clarification.

Additionally, providing space for assessors to make comments on each criterion helps to ensure that all aspects of the learner’s performance are taken into account.

Another way to maintain reliability in the assessment process is to conduct regular training sessions for assessors.

This allows assessors to keep up to date with changes to the assessment process, and to share best practices with other assessors.

It is important for evidence presented for assessment to be consistently interpreted, and for assessment results to be comparable regardless of who is assessing the evidence.

Furthermore, conducting regular audits of the assessment process can help to identify any areas where improvements can be made.

You should be confident about your RTO Assessment tool’s Fairness, Flexibility, Validity and Reliability. These assessment principles must be considered by your RTO when developing or purchasing resources for your RTO.

Rules of evidence

An easy way to learn them:

“I need something valid
like a current driver’s license
sufficient money for rent and
an authentic friend”


In the Rules of Evidence, important considerations around assessment evidence collection are highlighted in relation to the Principles of Assessment.

Validity

The assessor must be assured that the student has the skills, knowledge, and attributes as described in the unit of competency and associated assessment requirement.

In order for the validity rule to apply, the assessor must have confidence that the learner has the skills, knowledge, and attributes required within the module or unit of competency and assessment. This basically means that the assessment process assesses the competence of the learner, as it claims.

What do RTOs do to ensure the validity of their assessments?

For competent performance, assessments cover a wide range of skills and knowledge:

The assessment of knowledge and skills is integrated with the application of those skills

Upon completion of the assessment, the learner is able to demonstrate their skills and knowledge as needed

A competency can be determined by aligning the learner’s performance with a unit or units of competency and the requirements for assessment

You must ensure that your RTO Assessment tool meets the requirements of each unit and that it can confirm the repeatability of performance as well. Assessments must not omit anything from the unit, nor should they expect anything beyond what the unit requires

Sufficiency

The assessment must be assured that the quality, quantity, and relevance of the assessment evidence enable a judgement to be made of a student’s competency.

Under the Sufficiency rule, assessors must be confident in the quality, quantity and relevance of the assessment evidence before making a judgement.

This means that units or modules may specify a minimum number of times a task must be completed before learning is considered sufficient.

For example, an engineer may need to complete four welding tasks to demonstrate sufficiency, while a hairdresser may need to complete eight haircuts. The standards for determining sufficiency are usually established by RTOs in line with industry requirements.

There are various ways that assessors can gather evidence to satisfy the Sufficiency rule. This may include observing learners in action at their workplace, viewing videos of role plays at simulated workplaces, and using a checklist to ensure all required skills are being demonstrated.

Satisfying the Sufficiency rule is essential for making accurate and reliable judgements about a learner’s achievement. This, in turn, ensures that learners receive the appropriate training and assessment to meet industry standards.

Quality, Quantity and Relevance

Quality refers to the extent to which a program meets the needs of its participants. It is important to ensure that training and assessment programs are of high quality so that participants can gain the skills and knowledge they need to be successful in their chosen field.

Quantity refers to the amount of training and assessment that is required in order for participants to gain the desired skills and knowledge. It is important to ensure that there is enough training and assessment so that participants can gain a thorough understanding of the material covered.

Relevance refers to the extent to which a program is applicable to the real world. It is important to ensure that training and assessment programs are relevant so that participants can apply what they have learned in a practical setting.

Training and assessment programs that focus on quality, quantity and relevance will be more effective than those that do not. Therefore, it is important to ensure that these three factors are taken into account when designing training and assessment programs in the VET sector.

Authenticity

The assessor must be assured that the evidence presented for assessment is the student’s own work.

The evidence presented in vocational education and training (VET) assessments must be authentic in order for the rule of evidence to be applied correctly.

This can be challenging to ensure in a distance learning environment, but there are a few strategies that can help.

These include asking students to agree not to share logins and passwords, requesting IDs online prior to assessment, signing declarations that all evidence submitted is their own work, or using live-webcam proctoring during assessments.

By following these steps, assessors can be confident that the evidence presented is indeed from the learner and meets the Authenticity rule.

The evidence presented in vocational education and training (VET) assessments must be authentic in order for the rule of evidence to be applied correctly.

This can be challenging to ensure in a distance learning environment, but there are a few strategies that can help.

These include:

  • checking for plagiarism
  • asking students to agree not to share logins and passwords,
  • requesting IDs online prior to assessment,
  • signing declarations that all evidence submitted is their own work, or
  • using live-webcam proctoring during assessments.

By following these steps, assessors can be confident that the evidence presented is indeed from the learner and meets the Authenticity rule.

Currency

Currency refers to how up-to-date the evidence used in an assessment is. The reason this is so important is as vocational training is always changing and evolving. What was once considered best practice may no longer be relevant a few years down the line. This means that any assessments carried out need to use evidence that is current and relevant.

An assessor must be confident that the evidence presented in an assessment demonstrates current competency in order to apply the Currency rule. Students must present evidence from the recent past or the present.

How recent is the “very recent past”? Each industry will have its own definition of what is considered current, and in some cases, individual units will provide guidance. Most evidence gathered more than two years ago cannot be considered current; however, in some cases, it may be accepted. In determining what evidence is considered current, RTOs should refer to industry standards.

Validity of traditional assessment methods

There is a great deal of debate surrounding the validity of assessment methods in vocational education and training (VET). Some believe that traditional methods, such as open book and closed book examinations and long answer, essay-type questions, are no longer fit for purpose in the modern VET sector. Others argue that these methods are still the best way to assess students’ knowledge and skills.

So, what is the truth? Are traditional assessment methods valid in today’s VET sector?

The answer is not simple. It depends on a number of factors, such as the type of assessment being used, the context in which it is being used, and the specific goals of the VET program.

However, there is evidence to suggest that traditional assessment methods can still be valid and useful in VET. For example, examinations can test students’ knowledge of a subject matter. And essay-type long answer questions can assess students’ ability to communicate and argue a point.

At the same time, it is important to remember that no assessment method is perfect. Each has its own strengths and weaknesses. Therefore, it is important to use a range of assessment methods in order to get a complete picture of a student’s abilities.

There is a range of different methods that can be used to assess students in the VET sector. These can include written examinations, practical demonstrations, interviews, or work samples. The appropriate assessment approach will depend on the specific situation and context. However, there are some general principles that should be followed, such as ensuring that the assessment is fair, valid, flexible and reliable.

It is important to ensure that the assessment method chosen is valid for the purpose it is being used for. This means that it must accurately measure the desired outcome. For example, if a written examination is being used to assess students’ knowledge of a particular subject, then the test must be designed in a way that accurately assesses this knowledge. If an interview is being used to assess a student’s ability to communicate effectively, then the questions must be relevant and focused on this particular skill.

The chosen assessment method must also be fair. This means that all students should have an equal opportunity to demonstrate their knowledge or skills. The assessment should not be biased in any way. For example, if a written examination is being used, then the test should not be too difficult or too easy. All students should have a reasonable chance of passing the test if they have studied hard and prepared properly.

It is also important to ensure that the assessment is flexible. This means that it can be adapted to meet the needs of individual students. For example, if a student has a learning disability, then special arrangements can be made to ensure that they are not disadvantaged by the assessment.

Finally, the assessment must be reliable. This means that it produces consistent results. For example, if a student gets a high score on a written examination, then they should get a high score every time they take the test. This is important because it ensures that the assessment is an accurate measure of student’s knowledge or skills.

When choosing an assessment method, it is important to consider all of these factors. The most appropriate method will depend on the specific situation and context. However, following these general principles will help to ensure that the assessment is fair, valid, flexible and reliable.

In conclusion, the validity of assessment methods in VET depends on a number of factors. However, traditional methods such as examinations and essays can still be valid and useful tools for assessing students’ knowledge and skills.

The learner guide and presentations should not be the only source of answers for your students’

One of the biggest mistakes that students and some trainers/assessors can make is to think that the learner guide and presentations are the only sources of answers for summative assessments. This is not the case! The assessor should be looking for evidence that the student has actually understood the content and can apply it in a real-world context. Copying and pasting from the learner guide or presentations do not demonstrate this understanding and should likely lead to a not-yet-competent grade. So what should students do instead?

The best way to prepare for summative assessments is to make sure that the students have a thorough understanding of the content. This means going beyond just reading or listening to the material – students need to be able to explain it in their own words and apply it to real-world situations. A great way to test their understanding is to try and teach the content to someone else. If they can explain it clearly and answer any questions they have, then the trainers/assessors know they’re on the right track!

Another useful strategy is to create a mind map or summary of the key points for each topic. This will help students to remember the main points and will also give them something to refer back to if they get stuck during an assessment.

Finally, don’t forget that as an assessor you should be available to help – if they’re not sure about something, they should ask! You must be able to give them guidance and feedback that will help them improve their understanding.

If your students are only relying on the learner guide and presentations for their answers, they may also be at risk of plagiarism. Plagiarism is when someone copy-and-pastes text from another source without giving credit to the original author. This is considered cheating and can lead to serious consequences, like getting expelled from school.

To avoid plagiarism, make sure your students understand that they need to answer questions in their own words. They can use the learner guide and presentations as a resource, but they should not copy verbatim from these sources. Instead, they should paraphrase the information and cite any direct quotes.

If you’re not sure how to teach your students about plagiarism, there are many resources available online, such as this article from the Purdue Online Writing Lab https://owl.purdue.edu/owl/avoiding_plagiarism/index.html

So, don’t rely on the learner guide and presentations as the only source of answers for summative assessments. Make sure your learners understand the content thoroughly and can apply it in a real-world context. If they do this, they’ll be well on their way to success!

Assessment tools to support observation using simulation

Simulation can provide a realistic environment in which to observe and assess student performance. A variety of assessment tools are available to support observation using simulation, including checklists, global rating scales, observation guides and structured debriefing. Each has its own strengths and weaknesses, and the choice of tool should be based on the specific learning objectives for the simulation session.

Checklists are often used to assess basic technical skills, such as handwashing or equipment setup. They are easy to use and can be completed quickly, making them ideal for high-volume simulated experiences such as mass casualty drills. However, checklists may not capture more complex aspects of student performance, such as decision-making or team communication.

Global rating scales are another common assessment tool for simulation. These scales allow observers to rate a learner’s overall performance on a specific task or scenario. They are often used in conjunction with checklists to provide a more comprehensive assessment of student performance. However, global rating scales can be subject to observer bias, and it can be difficult to compare ratings across different learners.

Observation guides should be used as a way to focus observations and should not be used as a means of recording every single detail of the simulation.

Structured debriefing is a process in which the learner and observer(s) reflect on the simulation experience together. This type of debriefing can be beneficial in helping the learner to identify areas of improvement and develop a plan for addressing them. However, structured debriefing can be time-consuming, and it may not be feasible to use this approach for large-scale simulations.

The information collected through an effective assessment tool can then be used to help inform instructional decision-making. Additionally, using simulation for assessment can help reduce bias in evaluations, as it allows all students to be assessed on an equal footing. Therefore, simulation should be considered as a possible assessment tool to support observation in order to improve student learning outcomes.

It is also important to note that assessment tools should not be used in isolation, but rather should be used in conjunction with other methods of assessment such as debriefing and post-simulation discussion. By using a variety of assessment methods, educators can more accurately identify areas of strengths and weaknesses for individual students.

The choice of assessment tool should be based on the specific learning objectives for the simulation session. Checklists, global rating scales, and structured debriefing are all valid options for assessing student performance in simulation. The most appropriate tool for a given simulation will depend on the nature of the task or scenario being simulated, the number of learners participating, and the time available for debriefing.

An overview of assessment evidence

Assessment evidence in the VET sector refers to the process and methods used by assessors to gather, generate and judge the quality of evidence for the purpose of making informed judgements about vocational competence.

It includes how assessors:

  • Design and select assessment instruments
  • Plan and conduct assessments
  • Interpret and use assessment results as evidence of a student’s claim of competence

There are different types of assessment evidence that can be used in the VET sector, including:

Direct evidence: This is generated when an assessor observes a candidate undertaking a task or activity, or when the candidate provides a first-hand account of their own performance.

Indirect evidence: This is generated from sources other than the candidate themselves, such as witness testimony, video or audio recordings, or documents produced by the candidate.

Anecdotal evidence: This is information that is not directly related to the candidate’s performance, but which may nonetheless be useful in making a judgement about their vocational competence. This could include information from references, employer feedback, or third-party observations

Direct Evidence

Training and assessment in the VET sector relies heavily on direct evidence.

This is because learners in the VET sector are typically engaged in practical, hands-on activities that allow assessors to directly observe their skills and knowledge in action.

Direct evidence can take many forms, but it typically includes:

  • Observations of learners carrying out tasks
  • Interviews with learners about their experiences and learning
  • Products or artefacts produced by learners as part of their learning (e.g., essays, drawings, models)

Assessment tasks specifically designed to test specific skills or knowledge areas.

Direct evidence is usually collected by assessors during the normal course of teaching and assessment activities.

However, it can also be collected through specialised assessment tasks or activities that are specifically designed to assess particular skills or knowledge areas.

One of the advantages of using direct evidence is that it provides a clear link between the evidence and the relevant skill or knowledge area. This can make it easier for assessors to make judgements about whether a learner has demonstrated the required level of proficiency.

Another advantage of direct evidence is that it can be very specific. This means that it can provide detailed information about what a learner knows and can do, which can be very useful for diagnosis and planning purposes.

However, there are some disadvantages of using direct evidence. One of these is that it can be time-consuming and expensive to collect, especially if specialised assessment tasks are required.

Another disadvantage is that direct evidence is often open to interpretation without proper benchmarking in assessor’s copy of the training and assessment resources. This means that there can be scope for assessors to make different judgements about the same piece of evidence, which can lead to inconsistency in assessment decisions.

Indirect Evidence

Indirect evidence is often used to supplement direct evidence in order to get a more holistic picture of the learner’s achievement.

Indirect evidence has its advantages and disadvantages.

Advantages of indirect evidence:

  • Can be used to assess a wide range of skills and knowledge
  • Can be less time-consuming and expensive to collect than direct evidence
  • Can be used to assess learners who are not able to physically perform a task

Disadvantages of indirect evidence:

  • May be less reliable than direct evidence
  • May be prone to bias
  • May not provide as much detail as direct evidence

Indirect evidence can be collected in a number of ways, including through

  • questionnaires,
  • tests, and
  • interviews.

Each method has its own advantages and disadvantages.

Questionnaires:

Advantages:

  • Can assess a wide range of skills and knowledge
  • Can be administered to a large number of people at once
  • Can be relatively quick and easy to administer

Disadvantages:

  • May be subject to response bias
  • May not provide as much detail as other methods such as interviews or observations

Interviews:

Advantages:

  • Can assess a wide range of skills and knowledge
  • Can provide more detail than other methods such as questionnaires or tests

Disadvantages:

  • May be time-consuming and expensive to administer
  • May be subject to bias
  • May not be able to assess a large number of people at once

The type of evidence used will depend on the particular assessment context and the purpose of the assessment.

For example, direct evidence may be more appropriate where a candidate’s practical skills are being assessed, while indirect evidence may be more suitable for assessing theoretical knowledge.

Anecdotal evidence

Anecdotal evidence is also known as “Supplementary evidence”

As the VET sector continues to grow and evolve, so too does the need for high-quality training and assessment. A key part of ensuring that training and assessment are of a high standard is the use of evidence-based practices.

One type of evidence that can be used to inform training and assessment practices is anecdotal evidence. Anecdotal evidence consists of stories or accounts of events that have been experienced by an individual or group. This type of evidence can be useful in providing insights into the effectiveness of different approaches to training and assessment.

However, it is important to note that anecdotal evidence should not be used as the sole basis for decision-making. Rather, it should be used in conjunction with other forms of evidence, such as research evidence, in order to make informed decisions about training and assessment practices.

It is important that assessors use a range of evidence sources to build up a comprehensive picture of the candidate’s competence.

This will help to ensure that the assessment is fair and accurate and that any judgement made about the candidate’s vocational competence is well-informed.

The importance of having word limits in the summative assessment resources

One of the most important aspects of VET is summative assessment. Summative assessment resources play a vital role in ensuring that students are able to demonstrate their learning and progress. However, summative assessment resources can also be a source of frustration for both students and educators if they are not well managed and written. It is widely accepted that summative assessment resources in vocational education and training (VET) should have word limits. This is because having a word limit ensures that the focus is on the key learning outcomes and not on trivial matters. It also allows for a more efficient and effective assessment process, as well as ensuring that the results of the assessment are more reliable. It is a key element in ensuring that students have the opportunity to develop the necessary skills and knowledge to complete their qualification.

There are several reasons why it is important to have word limits in summative assessments.

It provides a level playing field for all students.

It allows trainers/assessors to focus on the quality of the work rather than the quantity. It ensures that students are able to focus on the key issues and provides a level playing field for all candidates. When students know they only have a certain number of words to write, they are more likely to focus on the most important information and leave out any superfluous details. This not only makes for a more concise and well-written essay, but also helps to ensure that the student is covering all of the key points required by the assessment task.

It helps to prevent plagiarism. When students are given a large amount of material to work with, they may be tempted to copy and paste sections from various sources in order to save time. However, if they know that they only have a limited number of words to use, they are more likely to take the time to paraphrase and reference properly. This not only benefits their own learning, but also helps to ensure the academic integrity of the assessment.

In addition, word limits can also help to ensure that students are not spending too much time on one particular section of the task. If students know they only have a limited amount of words to use, they are less likely to spend an excessive amount of time on one section and neglect other important parts of the task. This can often lead to poorer overall performance, as students who spend too much time on one section may find it difficult to move on to the next.

Then, setting word limits also allows educators to more easily identify which students need extra help or support. This is because students who struggle with writing often have difficulty meeting the required word limit.

Finally, they help to ensure that assessments are fair and objective. Word-limits ensures that the assessment process is more efficient and effective. This is because it is often difficult to assess large amounts of text. Having a word limit allows the assessor to read through the resources more quickly and identify the key points. This makes the assessment process more efficient and effective, as well as ensuring that the results are more reliable.

Word limits also help to ensure that assessments are manageable for both trainers/assessors. By setting a maximum word limit, it ensures that there is less material for trainers/assessors to mark and assess, making the process more efficient.

While word limits are important, it is also important to be realistic when setting them. It is unrealistic to expect students to write a perfect essay within the confines of a few hundred words, and doing so may actually lead to poorer performance. Instead, it is important to set a word limit that is achievable, but also challenging enough to ensure that students are still required to focus on the key points.

Ultimately, setting word limits is an important part of assessment in VET. By doing so, you can help to ensure that students focus on the key points, avoid plagiarism, and don’t spend too much time on one particular section. While it is important to be realistic when setting word limits, they can ultimately benefit both the student and the assessment process as a whole. Word-limits are there to ensure that the results of the assessment are more reliable. This is because if there is too much text, it can be difficult to identify any patterns or trends. Having a word limit means that there is less text to analyse, which makes it easier to identify any patterns or trends. This in turn makes the results of the assessment more reliable.

In conclusion, it is clear that there are several advantages to having word limits in summative assessment resources in VET. These advantages include the fact that it allows the assessor to focus on the key learning outcomes, makes the assessment process more efficient and effective, and helps to ensure that the results of the assessment are more reliable. As such, it is clear that summative assessment resources should have word limits.

Issuing qualifications to your own trainers, assessors and staff members

Qualifications are important. They ensure that trainers and assessors are current and competent in their fields. They also help to put a check on the quality of training provided by trainers and assessors. You may be tempted to issue qualifications to your own trainers, assessors and staff members for a number of reasons such as in an effort to save money or save the administration processes or you are the only or few RTO having the training product on their scope of registration. Let’s now understand what is the stand of the regulatory body:

The VET Quality Framework or the Standards for Registered Training Organisations 2015 do not prevent RTOs from providing and granting RPL and issuing AQF qualifications or statements of attainment to their own trainers, assessors and staff members. However, RTOs must be able to provide evidence that demonstrates how competence was determined prior to issuing AQF qualification or statement of attainment. For example, the RTO must be able to demonstrate compliance with Clause 1.8, ensuring that the assessment complies with the requirements of the training package, is conducted in accordance with the principles of assessment and is fair, valid and reliable.

We have learned from thousands of audits that awarding qualifications to your own trainers, assessors, and staff members can open a can of worms for a variety of reasons. Here are a few of them:

a. How do you provide evidence that staff did not have access to the student and assessor copy or RPL documentation before and during the assessment?

b. How do you make sure sufficient evidence has been collected?

c. Who assesses their competency and what are their credentials?

d. Where the evidence is kept and for how long? How do you demonstrate trainer/assessor has been assessed in a valid and reliable manner after the retention period of documentary evidence such as assessments ends?

e. How do you ensure the trainer/assessor meet the entry and admission requirements to enrol and complete a training product?

f. What sort of agreement is in place between your RTO and RTO personnel related to fees, other charges and refunds?

g. How does your policy framework reflect these practices?

So, before you go ahead and issue qualifications to your own employees, make sure you take all these things into account. It’s important to weigh up the pros and cons of doing this and to make sure that the benefits outweigh the risks. Otherwise, you could end up causing more problems than you solve.

RTO compliance guide to buy compliant assessment resources

According to almost all ASQA reports, getting an assessment right is one of an RTO’s most difficult compliance issues, with a substantial number of RTOs, audited being found to be non-compliant with clause 1.8 (ASQA’s 2017 report showed around 72% RTOs failed audit on assessment resources). This is what we notice as well whenever we have conducted any internal audits through CAQA.

It is a wise decision to get your training and assessment strategies and resources validated by independent industry experts to get honest feedback and an unbiased opinion.

The purpose of the assessment tool

The main purpose of an assessment tool, student assessment, or assessment pack is to ensure that trainers and assessors can effectively establish whether a learner is competent or not yet competent in a training product. There are three ways a trainer/assessor can establish competence:

  • Tell me what you can do (Demonstration of knowledge)
  • Show me what you can do (Demonstration of skills)
  • Make me something (Application of knowledge and skills)

Let’s look into some of the most important aspects in detail now:

Understand how the assessment materials meet the training package requirements

This step necessitates you concentrating on how the assessment materials fit the requirements of the training package. This is the step when you understand what competence in this particular unit of competency will look like.

Focus points include understanding of:

  • What is the AQF level where the unit of competency will be used?
  • What is the unit descriptor/application of the unit saying about work activities included in the unit of competency?
  • What are the prerequisite or corequisite requirements related to the unit of competency?
  • What level of skill is required for this unit according to where (which qualification) the unit of competency will be used
  • What are the elements, performance criteria, range of conditions, foundation skills, knowledge evidence, performance evidence, assessment conditions
  • Read the assessment conditions and foundation skills: What are the conditions under which this work activity should be conducted
  • Are there any other specific requirements applicable to this unit of competency?

Before moving on to practical task activities, the learner must first demonstrate that he or she understands the subject through demonstration of knowledge.

KNOWLEDGE – you need to have knowledge before you can perform

Look over the requirements for the training package and have a close look at the knowledge evidence to see if it says once is sufficient. If it does not state that, it implies that you must address each of the knowledge evidence criteria at least twice. We can address the knowledge evidence requirements using a variety of activities such as questions and answers, case studies, report writing, and other knowledge-based assessment methods.

PERFORMANCE – means that you have to do something

Then it’s time to look at performance criteria and performance evidence, and once again, pay attention to whether or not there are instructions on how many times this should be addressed. If this is not the case, each performance criteria and the performance evidence must be addressed in the assessment tasks and activities at least twice, if not more, utilising a variety of assessment methods and activities such as projects, portfolios, practical task activities, workplace tasks and observations and so on.

Focus on the action verbs and action keywords

Focus on all action verbs and action keywords included in the training package when developing your assessment resources. Each and every action verb and keyword must be addressed through the assessment resources.

Bloom’s taxonomy of measurable verbs is a good starting point to understand more about the action verbs.

Ensure if something is plural you have addressed them more than once.

If there is anything mentioned as plural such as strategies, you must ensure the assessment resources have at least two (2) or more strategies mentioned in them.

You must establish if each component of the training package requires evidence in the form of knowledge, skill or product.

Comprehensive mapping to training package requirements

A comprehensive mapping document is required to ensure all training package criteria has been addressed appropriately and comprehensively. Mapping is a cross-referencing activity where each component of the unit of competency is cross-referenced to one or more assessment criteria or questions in the assessment activities and tasks. Mapping is more a content validity process and not a process validity process.

Refer to the following articles for more information

Mapping document of assessment resources – do you need one? https://caqa.com.au/2021/10/04/mapping-document-of-assessment-resources-do-you-need-one/

Focus on evidence collection and assessment methods

Focus on evidence collection and assessment methods after ensuring that the assessment resources meet the training package requirements. The focus points should include:

  • What are the assessment methods selected for evidence collection?
  • Are these suitable and appropriate for evidence collection?
  • What are the other methods that may be used for evidence collection?
  • Where and how should evidence be collected?
  • What resources are required for evidence collection?

Foundation skills, assessment conditions, performance evidence, performance criteria and knowledge evidence should be taken into consideration when designing the evidence collection and assessment methods.

The evidence collection and assessment methods should change according to the AQF level where the units of competency will be used. For example, for a Certificate II, III level true or false, match the following statements with, multiple-choice questions, fill in the blanks might be appropriate but for Certificate IV and Diploma short answer questions, closed book, time-limited exams, contrast and separate, and other assessment methods could be used. We have included an AQF summary for you to understand how each AQF level requires a different set of requirements.

AQF Level Summary Qualifications Purpose of this Qualification
1 Graduates at this level will have knowledge and skills for initial work,

community involvement

and/or further learning

Certificate I basic functional knowledge and skills to undertake work, further learning and community involvement.
2 Graduates at this level will have knowledge and skills for work in a

defined context and/or

further learning

Certificate II qualify individuals to undertake mainly routine work and as a pathway to further learning.
3 Graduates at this level will have theoretical and practical knowledge and

skills for work and/or

further learning

Certificate III to qualify individuals who apply a broad range of knowledge and skills in varied contexts to undertake skilled work and as a pathway for further learning.
4 Graduates at this level will have theoretical and practical knowledge and

skills for specialised

and/or skilled work

and/or further learning

Certificate IV to qualify individuals who apply a broad range of specialised knowledge and skills in varied contexts to undertake skilled work and as a pathway for further learning.
5 Graduates at this level will have specialised knowledge and skills for

skilled/paraprofessional

work and/or further

learning

Diploma to qualify individuals who apply integrated technical and theoretical concepts in a broad range of contexts to undertake advanced skilled or paraprofessional work and as a pathway for further learning.
6 Graduates at this level will have broad knowledge and skills for

paraprofessional/highly

skilled work and/or

further learning

Advanced Diploma Associate Degree to qualify individuals who apply specialised knowledge in a range of contexts to undertake advanced skilled or paraprofessional work and as a pathway for further learning.
7 Graduates at this level will have broad and coherent knowledge and

skills for professional

work and/or further

learning

Bachelor Degree to qualify individuals who apply a broad and coherent body of knowledge in a range of contexts to undertake professional work and as a pathway for further learning.
8 Graduates at this level will have advanced knowledge and skills for

professional highly skilled

work and/or further

learning

Bachelor Honours Degree Graduate and

Vocational Graduate

Certificate

Graduate and

Vocational Graduate

Diploma

to qualify individuals who apply a body of knowledge in a specific context or range of contexts to undertake professional or highly skilled work and as a pathway for research and further learning.
9 Graduates at this level will have specialised knowledge and skills for

research, and/or

professional practice

and/or further learning

Masters Degree to qualify individuals who apply an advanced body of knowledge in a range of contexts for professional practice and as a pathway for further learning.
10 Graduates at this level will have a systematic and critical understanding of

a complex field of

learning and specialised

research skills for the

advancement of learning

and/or for professional

practice

Doctoral Degree to qualify individuals who apply a substantial body of knowledge to research, investigate and develop new knowledge, in one or more fields of investigation, scholarship or professional practice.

You must look if the assessment methods accurately and properly describe how many questions students must do correctly to be deemed satisfactory in the assessment task or activity and then check mapping to ensure your recommendation does not compromise the integrity of the assessment.

Always remember that each of the evidence collection and assessment methods must flesh out the details related to the assessment activities and tasks such as what, why, where, how, when something must occur.

Check the content for validity and reliability

Ensure all content is complete, error-free, plagiarism and copyright issues free, you also need to ensure that:

  • Assessment resources have sufficient and clear information regarding what, when, how, where, why for your assessment template and all assessment tasks and activities.
  • Assessment resources have robust benchmarking and/or trainers’ guidance.
  • Assessment resources are allowing the trainer/assessor to assess the skills and knowledge of students through different assessment tasks over a period of time to ensure consistency and sufficiency.
  • Each and every question and assessment task has very clear guidelines around what is expected from the students in terms of both quantity and quality.
  • You have customised the off-the-shelf resources according to your RTO needs and requirements and not using them as-is.
  • Your assessment resources are written by industry experts with subject matter experts and are industry-relevant and current.
  • Your assessment resources address all requirements of the training packaging rules
  • Your assessment resources have detailed and valid performance checklists/observation checklists for assessing and observing the students before, during and after any skill assessment activity or workplace task
  • Your trainers and assessors gather sufficient, valid evidence for competency assessment
  • Your organisation offers appropriate simulated environments for conducting assessments
  • The authenticity of assessment, particularly in distance and online delivery is established and maintained
  • The context and conditions of assessment. For example, an assessment tool is developed to cater for a particular language, literacy and numeracy requirements, the learner’s workplace experience or other learner needs that require reasonable adjustment.
  • The context of the assessment may also take into account assessments already completed, and the competencies demonstrated in these assessments. By looking at the context, you can consider the conditions under which evidence for assessment must be gathered.
  • All activities are conducted adequately using the required:
    • equipment or material requirements
    • contingencies
    • specifications
    • physical conditions
    • relationships with team members and supervisors
    • relationships with clients/customers
    • timeframes for completion.
  • Assessment methods or tasks are suitable to the requirements of the units of competency and students are assessed on the tasks and activities according to the requirements of the training package.
  • The language used is simple English
  • The evidence required to make a decision of competency is clearly outlined
  • The types of activities and tasks students need to perform are clearly outlined
  • The level of performance required for each assessment activity is clearly outlined
  • Adequate exposure to workplace conditions, including appropriate simulated environments, is provided
  • Sufficient knowledge-based assessment tasks and activities such as written questions and case studies etc.
  • Sufficient practical based assessment tasks and activities such as projects, role plays, workplace tasks and observations etc.
  • Assessment resources are error-free and free from any grammar, copyright or plagiarism issues

Assessment resources meet principles of assessments and rules of evidence

When constructing or reviewing the assessment tools, RTO compliance experts such as compliance managers, RTO management and trainers and assessors must ensure that the principles of assessment and rules of evidence are strictly followed.

The regulatory requirements specify that this is not only good practice but also a requirement for RTO registration. Validity, reliability, flexibility, and fairness are all requirements of the assessment evaluation process.

Validity

The validity of an assessment outcome refers to the extent to which the interpretation and use of the outcome can be supported by evidence. When the assessment methods and assessment materials used reflect all the training package requirements such as elements, performance criteria, etc. the assessment is considered valid. The assessment outcome is also considered valid when the evidence gathered fully supports the assessment outcome.

Reliability

The degree to which the assessment outcomes are consistent and accurate is referred to as reliability; that is, the extent to which the assessment will produce similar outcomes for students with equal competence at different times or places, regardless of the trainer who is conducting the assessment.

Flexibility

When students have the chance to negotiate specific components or aspects of their assessment (for example, timing) with their trainers and assessors, this is referred to as flexibility. All students should be thoroughly informed (for example, through an assessment plan) of the purpose of the assessment, the assessment criteria, the methods and tools that will be used, as well as the context and timing of the assessment, prior to taking part in it.

Fairness

A fair assessment does not favour or disadvantage any particular learners or groups of students in a discriminatory manner. Depending on the situation, this may imply that assessment procedures be tailored to specific learners (such as those with disabilities or those from diverse cultural backgrounds) in order to guarantee that they are not disadvantaged as a result of their circumstances. An evaluation should not set too high demands on students, as this may hinder them from demonstrating competency in the subject matter (for example, an assessment should not demand a higher level of English language or literacy than that required to perform to the workplace standard outlined in the competencies being assessed).

Evidence is governed by a set of rules.

A well-designed assessment tool will aid in ensuring that the evidence gathered is of the following types:

  • Valid – there is a clear relationship between the evidence criteria of the unit of competency and the evidence on the basis of which the assessment judgement is made;
  • Sufficient – the performance criteria and evidence guide is addressed; competence is demonstrated over a period of time; all dimensions of competency are addressed; competence is demonstrated in a variety of settings;
  • Current – the evidence reveals that the student possesses current knowledge and skills, and
  • Authentic – the evidence may be confirmed to show that it is the student’s own original effort.

In conjunction with industry, assessment evaluation strategies, methodologies and tools should be developed, and they should be evaluated on an appropriate sample of students before being implemented.

Easy to contextualise to your learner cohorts

Contextualising assessments and learner materials are one of the most thought-provoking tasks that RTOs face. Many RTOs are deemed non-compliant due to their contextualisation methods.

Regardless of whether you have developed the assessment resources in-house or you have purchased them as off-the-shelf resources, you must customise and contextualise each training product.

The customisation and contextualisation should occur in terms of

  • training context,
  • learner characteristics,
  • delivery modes,
  • cultural context,
  • technology requirements,
  • AQF level,
  • intent if the unit of competency is not addressed appropriately,
  • formatting,
  • grammar,
  • Your RTO’s templates and style guides

For more information, please read the following articles

https://caqa.com.au/2021/10/04/contextualisation-why-you-must-contextualise-the-training-and-assessment-resources/

https://caqa.com.au/2018/06/08/contextualising-assessment-resources-part-2/

How to make a reasonable adjustment in summative assessments

https://caqa.com.au/2021/07/14/how-to-make-reasonable-adjustment-in-summative-assessments/

Easy to modify to different delivery modes

Assessment resources should be adaptable to a variety of delivery modes, including online, offline, distance learning, workplace, and blended learning.

Clear guidance to the assessor

Assessment resources should provide clear instructions to assessors in terms of what they should look for.

  • what was expected from the learners
  • what they (trainers and assessors) should observe
    • have clear assessment (evidence-gathering) methods based on training package requirements
    • have clear assessment (evidence-gathering) tools
  • how they (trainers and assessors) should assess
    • have clear benchmarks and standards against which a student’s work is assessed
    • have clear evidence requirements to assess sufficiency and competency
    • have clear guidelines related to when assessments should occur and how they should occur
  • who should collect the evidence and when?
    • When determining who can collect evidence, the guidelines for training package assessment may be of use to you. It is critical that the instrument and instructions for your assessment tools clearly state what is expected of the students, the trainer/assessor, workplace supervisor or a third-party evidence gatherer. It is also critical that the instrument and instructions for your assessment tools provide a clear structure for the evidence gatherers to follow.
  • where they (trainers and assessors) should record
    • Focus on the requirements of the training package – is there any specific conditions, requirements and guidelines?
    • If workplace assessment is not possible or suitable, your alternative is to choose settings and procedures that allow students to demonstrate their competence to the level of performance indicated.
    • In a simulation, students should complete or deal with a task, activity, or problem in an off-the-job situation that is designed to mirror the workplace environment.
  • how they (trainers and assessors) should record
    • What are the RTO requirements and documentation?
  • who they (trainers and assessors) should report
    • Where do the assessors and trainers report the outcome of the assessment?
    • What is the procedure?
    • How students are informed about the assessment outcome?

Clear instructions to the learner

All assessment materials should provide very clear instructions to the learners in terms of:

  • What
  • When
  • Where
  • How
  • Why
  • Reasonable adjustments required

Observation checklists and benchmarking

All assessment resources should have comprehensive observation checklists and benchmarking to ensure

  • Learners know what is expected of them
  • Assessors know the scope of assessment in terms of what they should observe and assess, resources required and what should be considered when assessing
  • Clear guidelines and information related to how to use the observation checklists

All equipment, resources and facilities are available to conduct the assessment

Assessment conditions should be followed strictly and the training organisation should ensure that all equipment, resources and facilities are available to conduct the assessment.

Language, Literacy and numeracy requirements of the unit

The assessment tool must reflect the language, literacy and numeracy requirements related to the work task and work activities required to be assessed. Your focus points should include:

  • Reading
  • Writing
  • Numeracy
  • Oral communication
  • Learning

Ensure students are ready for the summative assessment

You must ensure that all students are ready for the summative assessment before you assess them.

For more information, please refer to

Formative vs Summative Assessment: A Comparison https://caqa.com.au/2022/01/31/formative-vs-summative-assessment-a-comparison/

Conduct pre and post validation checks

You must pre and post validate all assessment resources before and after you use them for your learners.

For more information, please refer to:

Different phases of assessment and learner validation processes (Part 1), Click here.

Different phases of assessment and learner validation processes (Part 2), Click here.

Different phases of assessment and learner validation processes (Part 3 of 4), Click here.

Different phases of assessment and learner validation processes (Part 4 of 4), Click here.

fact sheet, Click here.

Having a license of purchase

Training organisations should double-check that they have an authorised copy of the training and assessment resources from the publisher of the resource before using them for training purposes.

In a number of audits, the regulatory body has requested proof of purchase because a number of stakeholders are aware that there are some offenders in the sector who do not purchase the actual copies of the resources, resell when they do not have authority, or obtain materials in other illegal ways.

For more information, please click here.

How to protect the copyright of your training and assessment materials Margaret Ryan (lawyer and trade marks attorney), for more information click here.

References:

Guide – developing assessment tools https://www.asqa.gov.au/resources/guides/guide-developing-assessment-tools

One Of the Best Online platfrom

Get A Free Sample Of Our Resources

Contact Us

Lorem Ipsum is simply dummy text of the printing typesetting.

Send Us a Message

Questions? Concerns? We’re here to listen and respond!