Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of app’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they don’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at app, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from app

  • Children sat down on the floor reading books, with some looking up at their teacher who is sat with a book

    How to improve literacy in the classroom

    Por Katharine Scott
    Reading time: 5 minutes

    Katharine Scott is a teacher trainer and educational materials developer with over 20 years’ experience writing English language textbooks. She’s co-author of the app Primary course - English Code and is based in Spain. Katharine outlines a number of practical ways you can help English language learners develop key literacy skills.

    What is literacy?

    Teachers at all stages of education often complain about their students’ reading skills. The students are literate. In other words, they can interpret the graphemes, or letters on the page, into words. But they struggle to identify the purpose of a text or to analyze it in a meaningful way. We could say that the students have poor literacy skills.

    Literacy is a term used to describe an active, critical form of reading. Some of the skills of a critical reader include:

    Checking new information

    A crucial literacy skill involves discerning whether a text is factually true or not. A critical reader always checks new information against existing knowledge. As we read, we have an internal dialogue: Where does that information come from? That’s impossible because ….

    Separating fact from opinion

    This skill is essential for understanding many different types of texts from newspaper articles to scientific research.

    Understanding the purpose of a text

    All pieces of text have a main purpose. This may be entertainment, in the case of a story or persuasion, in the case of advertising. A critical reader will know how to identify the purpose of the text.

    In the classroom, different types of text require different responses from the students. It’s important, as students grow older, that they know how to read and respond appropriately to a piece of written information.

    Identifying key information in a text

    This is an essential skill for summarizing information or following instructions. It is also important when we transform written information into something else, like a chart.

    In many ways, literacy is the key skill that underpins learning at all stages. This may seem like an exaggeration, but consider the importance of the four skills outlined above.

    Strategies to promote literacy

    Many teachers and parents of early learners instinctively develop literacy skills before the children can even read.

    When we read a story out loud to a child, we often ask questions about the narrative as we turn the pages: What is going to happen next? How do you think …. feels? Why is …?

    These questions set the foundations for literacy.

    Working with a reading text

    Too often, the comprehension questions that teachers ask about a text are mechanical. They ask the student to “lift” the information out of the text.

    A tale of two dragons

    "Once upon a time, there was an island in the sea. One day, people were working in the fields. The sun was shining and there was one cloud in the sky. The cloud was a strange shape and moving towards the island. Soon the cloud was very big. Then a small boy looked up."

    Taken from English Code, Unit 4, p. 62

    Typical comprehension questions based on the text would be:

    • Where were the people working?
    • How many clouds were in the sky?

    These questions do not really reflect on the meaning of the text and do not lead to a critical analysis. While these simple questions are a good checking mechanism, they don’t help develop literacy skills.

    If we want to develop critical readers, we need to incorporate a critical analysis of reading texts into class work through a deep reading comprehension. We can organize the comprehension into three types.

    1. Text level

    Comprehension at “text level” is about exploring the meaning of individual words and phrases in a text. Examples for the text above could be:

    • Find words that show the story is a fairy tale.
    • Underline a sentence about the weather.

    Other text-level activities include:

    • Finding words in the text from a definition
    • Identifying opinions in the text
    • Finding verbs of speech
    • Finding and classifying words or phrases

    2. Between the lines

    Comprehension “between the lines” means speculating and making guesses with the information we already have from the text. This type of literacy activity often involves lots of questions and discussions with the students. You should encourage students to give good reasons for their opinions. An example for the text above could be:

    • What do you think the cloud really is?

    Other “Between the lines” activities include:

    • Discussing how characters in a story feel and why
    • Discussing characters’ motivation
    • Identifying the most important moments in a story
    • Speculating about what is going to happen next
    • Identifying possible events from fantasy events

    Literacy activities are not only based on fiction. We need to help students be critical readers of all sorts of texts. The text below is factual and informative:

    What skills do you need for ice hockey?

    "Ice hockey players should be very good skaters. They always have good balance. They change direction very quickly and they shouldn't fall over. Players should also have fast reactions because the puck moves very quickly."

    Taken from English Code, Level 4, p. 96

    “Between the lines” activities for this text could be:

    • What equipment do you need to play ice hockey?
    • What is the purpose of this piece of text?

    3. Behind the lines

    Comprehension “behind the lines” is about the information we, the readers, already have. Our previous knowledge, our age, our social background and many other aspects change the way we understand and interpret a text.

    An example for the text above could be:

    • What countries do you think are famous for ice hockey?

    Sometimes a lack of socio-cultural knowledge can lead to misunderstanding. Look at the text below.

    Is the relationship between Ms Turner and Jack Roberts formal or informal?

    73 Highlands Road Oxbo, Wisconsin 54552
    April 11th

    Dear Ms. Tamer,
    Some people want to destroy the forest and build an airport. This forest is a habitat for many wolves. If they destroy the forest, the wolves will leave the forest. If the wolves leave the forest, there will be more rabbits. This won't be good for our forest.
    Please build the airport in a different place. Please don't destroy the forest.

    Kind regards, Jack Robers

    Taken from English code, Level 4, unit 5, Writing Lab

    If your students are unaware of the convention of using Dear to start a letter in English, they may not answer this question correctly.

    Other “Behind the lines” literacy activities include:

    • Identifying the type of text
    • Imagining extra information based on the readers’ experiences
    • Using existing knowledge to check a factual account
    • Identifying false information

    Examples:

    • What job do you think Ms Turner has?
    • Do you think Jack lives in a village or a city?
    • Do wolves live in forests?

    Literacy is more than reading

    From the activities above, it’s clear that a literacy scheme develops more than reading skills. As students speculate and give their opinions, they talk and listen to each other.

    A literacy scheme can also develop writing skills. The text analysis gives students a model to follow in their writing. In addition, a literacy scheme works on higher-order thinking skills such as analysis, deduction and summary.

    Developing literacy skills so that students become active, critical readers should be a key part of educational programs at all ages. Literacy activities based on a reading text can be especially useful for the foreign language class.

    With literacy activities, we can encourage students:

    • To use the text as a springboard for communicating ideas and opinions
    • To analyze the text as a model for writing activities
    • To see how language is used in context
    • To explore the meanings of words

    More crucially, we are developing critical readers for the future.

  • A teacher sat in a classroom with a child, sharing crayons with eachother and smiling

    Four ways to keep kindergarten ESL students focused all day

    Por Heath Pulliam
    Reading time: 5 minutes

    Heath Pulliam is an independent education writer with a focus on the language learning space. He’s taught English in South Korea and various subjects in the United States to a variety of ages. He’s also a language learning enthusiast and studies Spanish in his free time.

    Those who have taught children anywhere between the ages of 4 and 8 know that one of the biggest challenges of getting through to them is keeping your presentation style interesting. As someone who taught ESL in South Korea to kindergarteners, there are a few factors that make keeping students engaged a challenge. In countries where students learn English, students often have a heavy courseload and high expectations. As a first-year teacher, I learned a lot about what worked and what didn’t through trial and error. These are four methods that I consistently used to keep my students interested and engaged all day.

    Students are quick to lose focus at such a young age. You’re not speaking their mother tongue and some parts of an ESL curriculum are less than exciting. With young students, you can’t lecture your way through the material all day. Kindergarteners have a small window of focus and it must be capitalized on. The following methods are ones that worked for me and can be modified to cover any topic you’ll run into in an ESL curriculum.

  • A teacher standing next to a student who is sat down, he has a pen and is gesturing to her work on the table.

    Assessing listening skills with the GSE

    Por
    Reading time: 4 minutes

    In today’s interconnected world, effective communication in English is more crucial than ever. As educators and language learners seek to measure and improve English proficiency, a resource like the Global Scale of English (GSE) offers a valuable framework for assessment. This blog post will explore how the GSE can be used to assess listening skills, providing insights into how it also helps tailor instruction and support language development.

    For listening skills, the GSE focuses on how well learners can understand spoken English in different contexts. It assesses comprehension at varying levels of complexity:

    Understanding simple information: At lower levels, learners are expected to understand basic information, such as simple instructions or everyday topics. The GSE provides learning objectives for how well learners can grasp essential details.

    Understanding main ideas: As proficiency grows, learners should be able to identify main ideas and key points in more complex spoken texts, such as conversations and broadcasts. The GSE outlines how well learners can extract important information from various sources.

    Understanding detailed information: At advanced levels, learners are expected to comprehend detailed and nuanced information, including implicit meaning and speaker intent. The GSE describes the level of detail and depth of understanding required at these stages.

    The GSE also shows how students engage in different operations of listening, from global comprehension, recognizing information and identifying specific information to extracting information. By taking this into account, teachers can monitor students’ progress and assess their listening skills. An example will show this in action.

    Let’s consider a level, say GSE 30-35 (equivalent to low A2 on the CEFR) and focus on how students process information. When checking a listening activity, rather than simply focusing on whether the answers are correct or incorrect, we can analyze our learners using the GSE and see what progress they are making and what we need to do as teachers to help them move on. Heres how: