Build success beyond the classroom: Critical thinking and assessment

Christina Cavage
A group of children stood at a table with their teacher watching her write something down on paper
Reading time: 4 minutes

There are some common myths related to critical thinking and assessment. Many people believe that it’s impossible to assess critical thinking, especially in classes where language is limited. However, it can be done! Here, the key to success is crafting tasks and rubrics that allow you to separate language skills and cognitive skills. After all, a low language level doesn’t necessarily reflect your student’s ability to think critically.

So, how can we measure how a student knows rather than just what they know?

How to measure critical thinking

Well, we first have to consider two types of assessment—formal and informal. Formal assessments tend to happen at the end of a task, lesson or skill-building activity and usually focus on the work the student has produced. Then, we have informal assessments. Those are the assessments that involve on-the-spot interactions. These types of assessments play a crucial role in measuring critical thinking.

Tips for teaching and assessing critical thinking
Play
Privacy and cookies

By watching, you agree app can share your viewership data for marketing and analytics for one year, revocable by deleting your cookies.

Formal assessment

There is a common misconception that assessment should only focus on the final work that your students produce. The final ‘product’ is undeniably important and often an ideal measure of linguistic abilities. But the process of producing the final work is where you can see your students’ critical thinking skills in action.

When designing rubrics to measure both language and critical thinking, make sure that you only focus on one at a time—either language or critical thinking. Keeping these different skills in mind will help you to differentiate language skills and critical thinking skills, and evaluate them separately, when it comes to formal assessment.

When measuring language skills, use Bloom’s early or foundational cognitive domains as a model:

If we measure these items, we are really measuring language skills. For example, with a reading activity, we might ask the following questions:

  • Who is the story about?
  • Where does the story take place?
  • What is the main idea of the story?

Can they understand the overall organization and the key vocabulary? These types of questions assess a student’s linguistic ability.

Then, when it comes to critical thinking, the more advanced levels of Bloom’s cognitive domains provide a useful guide:

These types of questions assess a student’s metacognition or critical thinking:

  • Which character is most important to the story?
  • Why?
  • Do you agree or disagree with the character’s actions?
  • Why or why not?

The clear separation of language and critical thinking in assessment will help you to get a measure of each student’s progress in both skills.

Informal assessment

What about those informal assessments? It can be harder to delineate critical thinking and language skills clearly in an on-the-spot assessment.

For example, if you’ve assigned group work, consider keeping a checklist of how students interact with one another. Some checklist items can be:

  • Who made an inference?
  • Who supplied reasoning for another student’s idea?
  • Who made a comparison?
  • Who drew a conclusion?

You can also ask your students to keep a checklist and post these questions on an electronic bulletin board. Like self-assessment, these peer-to-peer assessments can get students reflecting and noticing.

Rubrics can also be useful in informal assessment. Let’s say you’ve asked students to prepare or write an essay. To measure critical thinking, you can look at each student’s ideation process when they’ve been working on their essays:

  • Is a student looking at all possible topics?
  • What are the factors that make a student select the option they did?
  • Are they demonstrating an awareness of other ideas?

The answers to these questions will tell you whether or not your students are thinking critically.

Just like with any other skills, the assessment of critical thinking needs to happen both formally and informally. We need to consider both the process and the final product. And in doing so, we need to carefully design rubrics that differentiate language skills and metacognition.

More blogs from app

  • University students sat in a classroom at desks with a teacher speaking to them

    Planning for success with the GSE

    By Sara Davila

    The Global Scale of English (GSE) is the first truly global English language standard.

    It consists of a detailed scale of language ability and learning objectives, forming the foundations of our courses and assessments at app English.

    The GSE was developed based on research involving over 6000 language teachers worldwide. The objective was to extend the current descriptor sets to enable the measurement of progression within a CEFR level – and also to address the learning needs of a wider group of students.

    It can be used in conjunction with a current school curriculum and allows teachers to accurately measure their learners’ progress in all four skills of reading, writing, listening and speaking.

    GSE was introduced at the – an English language school run by the University of Toledo in Ohio, USA – with impressive results.

    The American Language Institute

    The Institute provides English courses for students who want to improve their English and prepares students to take the International Student English exam. They offer an intensive language program consisting of 20 hours of classes every week and 40 hours of self-study. This 60-hour week is designed to fast-track students from a lower level of English to a standard which allows them to participate successfully in college courses. There are five course levels offered, from A2+ to B2+ and class sizes average at around 10 students.

    Most students at the Institute are full-time international students planning to attend the University of Toledo once their English language proficiency reaches the required standard. On average, they are between 18 and 20 years old, and enter the language program with a B1 level of English.

    A mission statement

    At the Institute, the main aim of the language courses is to help students develop their English skills to a level that will allow them to integrate successfully into the university community, not just academically but socially. In their own words; “Our ultimate goal isn’t to teach them how to take and pass language tests, but to teach them how to use English and engage themselves with the local communities.”

    So how did the GSE, in conjunction with the Versant test and other app products, help to achieve this goal?

    Transitioning to a objectives-based curriculum

    First, the course coordinator Dr Ting Li adopted the GSE for a more detailed approach to the CEFR. She found that the GSE “made the CEFR more manageable because it broke out the levels and outlined CEFR goals into different categories.”

    Next, she replaced the current course materials with NorthStar Speaking & Listening, NorthStar Reading & Writing, and Focus on Grammar. These courses covered the areas taught in the previous curriculum, as well as the three key areas of study; literacy, speaking and listening, and grammar.

    The instructors also began using app English Connect, a digital platform for teachers and students.This gave them the flexibility to revise questions and reduce administrative burden due to the automatic grading feature.

    Finally, the Institute started using the Versant English placement test to decide which level students should enter when they first begin studying at the Institute.

    Key findings from the case study

    The new curriculum was a great success. Students, teachers and administrators all found that the courses and assessments, all underpinned by the GSE, made the language learning experience smoother and easier. Once students had completed the highest level of the course and achieved a 3.0 GPA, they were able to transition smoothly into their courses at the University of Toledo.

    The alignment between the NorthStar courses, the grammar study books and the Versant test was informed by the GSE. This meant students didn’t have to sit as many assessments as before, reducing time teachers had to spend setting and marking exams, and allowing them to focus more on supporting learners and the quality of their lessons.

    Dr Li highlighted the following key benefits:

    • The Global Scale of English supports the development of a standardized curriculum and a consistent framework for teaching English
    • The average student GPA was highly related to the University of Toledo’s undergraduate GPA, which indicates that if students do well at the Institute, they will have a successful academic career.
    • There was no group difference between graduates of the Institute and the average University of Toledo student GPA, which indicates that the Institute’s students perform as well as other international students who have been directly admitted to the university.
    • There was no difference between credits earned 2 years into the university program compared with the general student population.

    What’s more, the Institute was recently recognized by the , meaning that the course run by Dr Li is now nationally recognized. Using the GSE to inform the organization of the course curriculum made the accreditation process smoother and easier.

    Working as a team

    One of the main pieces of feedback from Dr Li and the Institute was how helpful they found the app representatives, who offered excellent customer support, building a sense of a team between their representatives and the school. This very teamwork helped the Institute to fulfill the ambition in their mission statement. It makes for an inspiring story of how one school used the GSE to transform their curriculum, and achieved their goal of helping students to improve their English and achieve their academic ambitions.

  • a young man sat in a lecture hall with other students behind him

    How the GSE helped Salem State University meet learner needs

    By Sara Davila

    Salem State University is one of the largest and most diverse public teaching universities in Massachusetts. In total, it has about 8,700 students enrolled, 37% of whom are people of color. It also educates 221 international students from 59 different countries – with China, Albania, Brazil, Morocco, Nigeria and Japan among the most represented countries on campus.

    The university runs an intensive English language program. Most students who enrol come from China, Brazil, Albania, Vietnam, and Japan. The program also has a number of part-time English language learners from the local community.

    In 2016, Associate Director Shawn Wolfe and teachers at the American Language and Culture Institute did a review and found that areas for growth included establishing a universal documentation for identifying learner needs, goals and progress.

    “The biggest challenge was that we needed to have a better way of placing students,” Wolfe says. “We also needed to have a way to have our curriculum, our assessment and our student learning outcomes unified.”

    The team lacked programmatic data related to learning gains and outcomes. Additionally, they realized that assessments could be used to inform students about entry requirements at the university and other programs. And that’s where the Global Scale of English (GSE) came in, as a tool which enabled the staff at the American Language and Culture Institute to personalize and diversity their English teaching program to meet learner needs.

    Cultural and linguistic diversity

    David Silva PhD, the Provost and Academic Vice President, highlights the need for this type of personalization when it comes to education.

    “We have to be prepared for an increasing variety of learners and learning contexts. This means we have to make our learning contexts real,” he says. “We have to think about application, and we have to think about how learners will take what they learn and apply it, both in terms of so-called book smarts, but also in terms of soft skills, because they’re so important.”

    Silva makes the point that, as the world gets smaller and technology becomes a bigger part of our lives, we can be anywhere at any time, working with anyone from across the globe. “We need to be prepared,” he says, “for those cultural and linguistic differences that we’re going to face in our day-to-day jobs.”

    The ability to change and adapt

    So how does the curriculum at the American Language and Culture Institute help prepare students for the world of study and work?

    At the Institute, the general review led to the realization that the program needed to be adaptive and flexible. This would provide a balance between general English and academic preparation and would also encompass English for specific purposes (ESP).

    Wolfe says, “The GSE fit with what we were trying to do because it offers three different options; English for academic learners, English for professionals and English for adults, which is another area that we realized we needed to add to our evening program so that we can serve working adults that are English language learners in our community.”

    The English language instructors at the Institute were also impressed with the capabilities of the GSE. Joni Hagigeorges, one of the instructors, found the GSE to be an excellent tool for tracking student progress.

    “What I really like is that you can choose the skill – , listening, speaking – and you’re given the can-do statements, the learning objectives that each student will need to progress to the next level,” she said.

    Wolfe also commented on the GSE Teacher Toolkit and the way that it supports assessment and planning, allowing instructors to get ideas for specific learning objectives for groups or individual students. “It’s enabled us to personalize learning, and it’s changed the way that our teachers are planning their lessons, as well as the way that they are assessing the students.”

    A curriculum that will meet learner needs

    The GSE has allowed the team at the Institute to become more responsive to changing student expectations. The alignment of placement and progress tests to the GSE has allowed instructors to have more input into the courses they are teaching.

    Elizabeth Cullen, an English language instructor at the Institute, said, “The GSE helps us assess the strengths and weaknesses of various textbooks. It has helped us develop a unified curriculum, and a unified assessment mechanism.”

    This unification means that the curriculum can easily be tweaked or redesigned quickly to meet the needs of the students. What’s more, as Elizabeth points out, the students benefit too. “The Global Scale of English provides students with a road map showing them where they are now, where they want to go and how they’re going to get there.”

    Standing out from the crowd

    In this time of global hyper-competition, the challenge for any language program is finding innovative ways to stand out from the crowd while staying true to your identity. At Salem State, the staff found that the GSE was the perfect tool for the modern, data-driven approach to education, inspiring constant inquiry, discussion and innovation. It offers students, instructors and administrators a truly global metric to set and measure goals, and go beyond the ordinary.