Build success beyond the classroom: Critical thinking and assessment

Christina Cavage
A group of children stood at a table with their teacher watching her write something down on paper
Reading time: 4 minutes

There are some common myths related to critical thinking and assessment. Many people believe that it’s impossible to assess critical thinking, especially in classes where language is limited. However, it can be done! Here, the key to success is crafting tasks and rubrics that allow you to separate language skills and cognitive skills. After all, a low language level doesn’t necessarily reflect your student’s ability to think critically.

So, how can we measure how a student knows rather than just what they know?

How to measure critical thinking

Well, we first have to consider two types of assessment—formal and informal. Formal assessments tend to happen at the end of a task, lesson or skill-building activity and usually focus on the work the student has produced. Then, we have informal assessments. Those are the assessments that involve on-the-spot interactions. These types of assessments play a crucial role in measuring critical thinking.

Tips for teaching and assessing critical thinking
Reproducir
Privacy and cookies

By watching, you agree ÃÛÌÒapp can share your viewership data for marketing and analytics for one year, revocable by deleting your cookies.

Formal assessment

There is a common misconception that assessment should only focus on the final work that your students produce. The final ‘product’ is undeniably important and often an ideal measure of linguistic abilities. But the process of producing the final work is where you can see your students’ critical thinking skills in action.

When designing rubrics to measure both language and critical thinking, make sure that you only focus on one at a time—either language or critical thinking. Keeping these different skills in mind will help you to differentiate language skills and critical thinking skills, and evaluate them separately, when it comes to formal assessment.

When measuring language skills, use Bloom’s early or foundational cognitive domains as a model:

If we measure these items, we are really measuring language skills. For example, with a reading activity, we might ask the following questions:

  • Who is the story about?
  • Where does the story take place?
  • What is the main idea of the story?

Can they understand the overall organization and the key vocabulary? These types of questions assess a student’s linguistic ability.

Then, when it comes to critical thinking, the more advanced levels of Bloom’s cognitive domains provide a useful guide:

These types of questions assess a student’s metacognition or critical thinking:

  • Which character is most important to the story?
  • Why?
  • Do you agree or disagree with the character’s actions?
  • Why or why not?

The clear separation of language and critical thinking in assessment will help you to get a measure of each student’s progress in both skills.

Informal assessment

What about those informal assessments? It can be harder to delineate critical thinking and language skills clearly in an on-the-spot assessment.

For example, if you’ve assigned group work, consider keeping a checklist of how students interact with one another. Some checklist items can be:

  • Who made an inference?
  • Who supplied reasoning for another student’s idea?
  • Who made a comparison?
  • Who drew a conclusion?

You can also ask your students to keep a checklist and post these questions on an electronic bulletin board. Like self-assessment, these peer-to-peer assessments can get students reflecting and noticing.

Rubrics can also be useful in informal assessment. Let’s say you’ve asked students to prepare or write an essay. To measure critical thinking, you can look at each student’s ideation process when they’ve been working on their essays:

  • Is a student looking at all possible topics?
  • What are the factors that make a student select the option they did?
  • Are they demonstrating an awareness of other ideas?

The answers to these questions will tell you whether or not your students are thinking critically.

Just like with any other skills, the assessment of critical thinking needs to happen both formally and informally. We need to consider both the process and the final product. And in doing so, we need to carefully design rubrics that differentiate language skills and metacognition.

More blogs from ÃÛÌÒapp

  • A woman holding a tablet stood in a server room

    The role of AI in English assessment

    Por ÃÛÌÒapp Languages

    Digital assessment is becoming more and more widespread in recent years. But what’s the role of digital assessment in teaching today? We’d like to give you some insight into digital assessment and automated scoring.

    Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students’ language proficiency.

    For example, ÃÛÌÒapp’s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ÃÛÌÒapp’s Benchmark and Level tests.

    So what makes automated scoring systems so reliable?

    Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we’re not replacing human judgment; we’re just teaching computers to replicate it.

    Of course, computers are much more efficient than humans. They don’t mind monotonous work and don’t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

    The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

    Speed

    The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that’s not just for multiple-choice answers but complex responses, too.

    The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

    The sooner you have scores, the sooner you can make decisions about placement and students’ language level or benchmark a learner’s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

    Flexibility

    The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

    Accessibility became key: how can your institution provide access to assessment for your learners, if you can’t deliver tests on school premises?

    The answer is digital assessment.

    For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.Ìý

    Free from bias

    Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn’t get tired, and it doesn’t have good and bad days like human markers do. And it doesn’t have a personality.

    While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who’s taking the test.

    If you’re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

    Additional benefits of automated scoring are security and cost.

    Security

    Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

    Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don’t cheat.

    For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

    Here are a few examples of suspicious behavior that our system might flag:

    Image monitoring:

    • A different face or multiple faces appearing in the frame
    • Camera blocked

    Browser monitoring:

    • Navigating away from the test window or changing tabs multiple times

    Video monitoring:

    • Test taker moving out of camera view
    • More than one person in the camera view
    • Looking away from the camera multiple times

    Cost

    Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

    ÃÛÌÒapp English proficiency assessments are highly scalable and don’t require extra time from human scorers, no matter how many test-takers you have.

    Plus, there’s no need to spend time and money on training markers or purchasing equipment.

    AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.Ìý

  • A woman and a man talking together

    4 ways to improve your students' intelligibility

    Por Charlotte Guest

    Intelligibility is the art of being understood by others. Many students think they need to speak a language flawlessly and with a native-like accent to make themselves clear, but this is not quite true.

    While there is a correlation between proficiency and intelligibility, even students of lower general proficiency are capable of expressing what they mean, in a way that the listener understands, if they are using good intelligibility practices.

    Being understandable in a second language is often extremely important in work environments, especially as the world becomes more connected and job markets more competitive.Ìý

    Intelligibility is a vital aspect of communication but it is not exactly a skill in itself. Instead, it is a combination of fluency, pronunciation, and managing your speed of speech. To reflect how important this is for language learners when studying, traveling or at work, we use an Intelligibility Index as part of our Versant English Test scoring.

    This index is based on factors affecting how understandable speech is to native English speakers. These include things like speed, clarity, pronunciation and fluency. Ranging from 1 (low) to 5 (high), the Intelligibility Index shows how intelligible someone’s speech in English is likely to be in a real-world situation.

    Let’s go into some activities and exercises you can try in class to help your students improve their intelligibility with their English and speaking skills.

    Ìý

  • Children singing in a line holding song sheets, with a teacher singing facing them

    How to incorporate music into the classroom

    Por ÃÛÌÒapp Languages

    Learning English with music can enhance learning and create a more engaging and dynamic classroom environment. In a previous post, we discussed if music can help you learn a language; this post looks at how music can be incorporated into the classroom.

    Using music in your classroom can help improve student motivation, focus, and retention of information. Here are some ways you can use music to enhance your classroom teaching:

    Ìý