Computer-based language assessment: The future is here

David Booth
David Booth
A blonde woman sat at a computer with headphones on in a room with more computers and desks in background

Many people are surprised at the idea of a computer program marking an exam paper. However, computer-based testing already exists in many different formats and many different areas. Many tests or exams that form part of our daily life are taken on computers. If you’ve ever learned to drive, sat a citizenship test, done a training course at work, or completed a placement test for a language course, the odds are that you’ve already taken an automated test.

Yet despite it being so common, there is still a lack of understanding when it comes to computer-based language assessment and how a computer can evaluate productive skills like speaking and writing.

Computer-based testing: a closer look

A common issue is that people have different ideas of what these tests entail. Computers can fulfill several essential roles in the testing process, but these often go unacknowledged. For example, a variety of test questions are needed to administer an exam, along with relevant data, and computers are used to store both the questions and the data. When it comes to creating randomized exams, computer software is used to select the exam questions, based on this data.

Computers can make complex calculations far more quickly and accurately than humans. This means that processes that previously took a long time are completed in days, rather than weeks.

Artificial intelligence (AI) technology is now capable of grading exam papers, for example. This means a shorter wait for exam results. In , candidates receive their results in an average of two days rather than waiting weeks for an examiner to mark their paper by hand.

The benefits for students and teachers

People take exams to prove their skills and abilities. Depending on their goals, the right result can open the door to many new opportunities, whether that is simply moving on to the next stage of a course, or something as life-changing as allowing you to take up your place on a university course in another country.

A qualification can act as a passport to a better career or an enhanced education, and for that reason, it’s important that both students and teachers can have faith in their results.

Computer programs have no inherent bias, which means that candidates can be confident that they will all be treated the same, regardless of their background, appearance or accent. , just one of app’s computer-based exams, offers students the chance to score additional points on the exam with innovative integrated test items.

This integration means that the results are a far more accurate depiction of the candidate’s abilities and provide a truer reflection of their linguistic prowess.

More than questions on a screen

It’s not as easy as simply transferring the questions onto a computer screen. All that does is remove the need for pen and paper; this is a missed opportunity to harness the precision and speed of a computer, as well as its learning potential.

Tests that have been fully digitized, such as PTE Academic, benefit from that automation; eliminating examiner bias, making the test fairer and calculating the results more quickly. Automated testing builds on the technological tradition of opening doors for the future – not closing them.

How technology enhances language testing

The development of automated testing technologies doesn’t merely make the examination process quicker and more accurate – it also gives us the chance to innovate. Speaking assessments are an excellent example of this.

Previously, this part of a language exam involved an interview, led by an examiner, who asked questions and elicited answers. But now that we have the technological capability, using a computer offers students the chance to be tested on a much wider range of speaking skills, without worrying about the inherent bias of the examiner.

Indeed, the use of a computer-based system facilitates integrated skills testing. Traditionally, language exams had separate papers focusing on the four skills of reading, listening, speaking and writing. But the more modern concept of language testing aims to assess these linguistic skills used together, just as they are in real-life situations.

Afterwards, the various scores are categorized to allow learners an insight into their strengths and weaknesses, which helps both students and teachers identify areas which need improvement. This useful feedback is only possible because of the accuracy and detail of automated exam grading.

The space race on paper

Back in the 1960s, during the space race, computers were still a relatively new concept. Kathleen Johnson, one of the first African-American women to work for NASA as a scientist, was a mathematician with a reputation for doing incredibly complex manual calculations. Although computers had made the orbital calculations, the astronauts on the first space flight refused to fly until Kathleen had checked those calculations three times.

This anecdote reminds us that - although computer technology is an inherent part of everyday life - now and then, we still need to check that their systems are working as they should. Human error still comes into play – after all, humans program these systems.

PTE Academic – a fully digitized exam

Every stage of PTE Academic, from registration to practice tests to results (both receiving and sharing them with institutions) happens online. It may come as a surprise to learn that the test itself is not taken online. Instead, students attend one of over 295 test centers to take the exam, which comes with the highest levels of data security.

This means that each student can sit the exam in an environment designed for that purpose. It also allows the receiving institutions, such as universities and colleges, to be assured of the validity of the PTE Academic result.

The future is here

We created computers, but they have surpassed us in many areas – exam grading being a case in point. Computers can score more accurately and consistently than humans, and they Dz’t get tired late in the day, or become distracted by a candidate’s accent.

The use of AI technology to grade student responses represents a giant leap forward in language testing, leading to fairer and more accurate student results. It also means more consistency in grading which benefits the institutions, such as universities, which rely on these scores to accurately reflect ability.

And here at app, we are invested in staying at the cutting edge of assessment. Our test developers are incorporating AI solutions now, using its learning capacity to create algorithms and build programs that can assess speaking and writing skills accurately and quickly. We’re expanding the horizons of English language assessment for students, teachers and all the other professionals involved in each stage of the language learning journey.

More blogs from app

  • A young girl sat at a desk smiling at the front of the class, with other students in the background.

    Four motivating activities to teach core values through reading

    Por Nicola Schofield
    Reading time: 4 minutes

    Teaching ourchildren corevalues is so important in helping them to becomehappy,well-balancedcitizens who will make a positive contributiontoour future society.

    Values are present and visible everywhere and they arethefoundation or starting point from where we make our decisions, which ultimately determine our futures. It is,therefore,important that our children learn a strong, moral set of values that will help guide them as they grow older,inform their decisions,help them toknow right from wrong, solve problems, assert themselves and build self-esteem and confidence.

    Values can bebuilton apersonal level or evenshared ata group level such as a family and friendship group.However, we often see them on a larger scale within communities, countries or even the whole world.

    Having a shared set of values connects peopleon a deeper leveland helps us to all work towards the same goals and standards – they caneven encourage people to see the similarities between each other, rather than thedifferences.

    Learning values through reading

    Children learn about values through their families, friends, and teachers, through what they watch or listen to and through their life experiences. They also learn about valuesthrough the books they read.These lessonscan be subtle but are oftenextremely powerful andcanhave a significant impact and influence.

    As an example, let’s have a look at how shared valuesareexplored in thenew graded readers series for young learners,Disney Kids Readers, where special emphasis has been put on exploring values within a story.At the end, you will find severalvalue-based activitiesthat you can download for use in the classroom orasan activity at home.

    Howdo Disney Kids Readers teach core values?

    1. Learning through stories that are already familiar can help children to trust in and take on board the key messages much more easily. Familiarity can break down many barriers to communication and help us understand that values are often universal.
    2. Many children are also familiar with the Disney characters and can find inspiration from reading how they react to situations in life, make decisions and behave. Children often look up to characters and can see them as role models within their own lives. As a result, the readers can be a reference point on how to respond to key life moments and how to incorporate values into real life.
    3. Also, depending on the child's age, some values may be new and children may not yet have experience with them in the real world. Therefore, the Disney stories allow them to explore these key messages through their favorite Disney character’s point of view.

    Each Disney Kids Reader is linked to a key valueand contains a ‘Values’ page with ashortcomicstripthat brings to life a specific value.

    The list below detailsa selection ofkey values taught across the readers.You could askthe childrenin your classto talk about which values are most important to them and why. Ask them to give an exampleofa time when they have demonstrated this value in their own lives.

    Friendship, positivity, curiosity, confidence, open-mindedness, courage, determination, self-belief, responsibility, resilience, respect, honesty.

    Examples of key values inDisney stories

    InThe Jungle Book,friendshipis a keyvalue,and we learn that it is important to help our friends. Baloo helps Mowgli when he is alone in the jungle and scared. An angry tiger wants Mowgli to leave the jungle, but when Mowgli meets Baloo, he finds a friend in him. Baloo sees that Mowgli is scared and looks after him.We learn that it is important to help our friends when they are in need.

    Do:Ask the children when they have helped their friends.

    InInside Out, we learn aboutsincerityandhowimportantit is to talk about how we are feeling. Riley is a teenager struggling with a whole range of emotions and we learn that life isn’t about being happy all the time and that it is okay to be sad sometimes. The children learn that this is a normal part of life and that talking it through with a friend, a parent or a teacher can help.

    Do:Ask the children if they share their feelings with others.

    Here are some activities for you to use with your class to help put into practice the core values from the readers. You can use these activities with any book, in and outside the classroom.

    1. My Values Road Sign (L3-4)

    This activityisa great way of talkingtochildrenabout their values. By creating a road sign poster,it will help them to decide which values are most important to them and it is something that they canreferto again and again in challenging times. They can stick it on their bedroom wall, display it on the fridge or you could even make a classroom display of shared valueswhen children have finishedtheirbooks!

    Download the worksheet

    2. Kindness Calendar (L4-6)

    This activity can be done as a family, with friends or as a class. The children fill in the calendar with kind actions they are going to do for 7 days. They can cut them out and placetheminto a jar and ask a different family member/friend/classmate to choose one a day. Do this for a week and discuss how carrying out kind actions makes them feel.Chances areit will make them feel good!

    Download the worksheet

    3. Core Values Quiz (L5-6)

    Try this quiz with your class and test their values. The questions focus on the following values: sincerity, honesty, positivity, resilience and friendship. If they answer mostly As, then they already demonstrate most of the values in their lives. If they answer mostly Bs, talk to them about why it is important to be honest, positive, strong and kind. The quiz will start a meaningful conversation about their own values and how they react to common situations in life.

    Download the worksheet

    4. My future self (L1-2)

    The childrenfill in the crystal ball with pictures of who they would like to be in the future. Do they want to be smart, funny, have a good job, live abroad, have a family, be rich, be a good friend or help the planet? Which of the plans make one person(themselves)happyand which plans make the world better? Do they need to change any of them?

    Download the worksheet

    Read our blog posts 'Fostering self-care and wellbeing through the world of reading'and 'The importance of teaching values to young learners'.

  • two business people sat together in a meeting both looking at a laptop

    Enhancing workplace communication: The new role of language assessments in business success

    Por Andrew Khan
    Reading time: 4 minutes

    The integration of AI tools into workplaces around the world is starting to change the way people communicate professionally. that the use of AI to help draft documents and emails is driven not only by convenience and efficiency but also by a desire to be clear and precise in language.

    While potentially useful, tools to translate, generate, or ‘correct’ written text won’t help with the effectiveness of the verbal communication that powers business relationships.

  • A teacher holding a tablet to a young student in a classroom sat at a table

    Talking technology: Teaching 21st century communication strategies

    Por
    Reading time: 4 minutes

    When my son created a web consulting business as a summer job, I offered to have business cards made for him. “Oh Dad,” he said, “Business cards are so 20th century!”

    It was an embarrassing reminder that communication norms are constantly changing, as are the technologies we use. Younger generations share contact information on their phones’ social media apps, not with business cards. A similar shift has been the move away from business cards featuring fax numbers. “What’s a fax?” my son might ask.

    Fax machines have had a surprisingly long life–the first fax machine was invented in 1843–but they have been largely retired because it’s easier to send images of documents via email attachments.

    More recent technologies, such as the 1992 invention of text messages, seem here to stay, but continue to evolve with innovations like emojis, a 1998 innovation whose name combines the Japanese words e (picture) and moji (character).

    The 55/38/7 rule and the three Cs

    Changing technologies challenge language teachers who struggle to prepare students with the formats and the strategies they need to be effective in academic, business, and social settings. These challenges start with questions about why we have particular norms around communication. These norms form a culture of communication.

    The artist/musician Brian Eno defines culture as what we Dz’t have to do. We may have to walk, but we Dz’t have to dance. Dancing, therefore, is culture. Communication is full of cultural practices that we Dz’t strictly need to do, but which make communication more successful. These include practices based on the 55/38/7 Rule and The Three Cs.

    The 55/38/7 rule is often misinterpreted as being about what someone hears when we speak. It actually refers to the insights of University of California professor, , who looked at how our attitudes, feelings, and beliefs influence our trust in what someone says.

    Mehrabian suggests words only account for seven percent of a message’s impact; tone of voice makes up 38 percent, and body language–including facial expressions–account for the other 55 percent. The consequence of this for our students is that it’s sometimes not so important what they are saying as how they are saying it.

    Another way of looking at this nonverbal communication is in terms of The Three Cs: context, clusters, and congruence.

    Context is about the environment in which communication takes place, any existing relationship between the speakers, and the roles they have. Imagine how each of these factors change if, for example, you met a surgeon at a party compared to meeting the same surgeon in an operating theater where you are about to have your head sawn open.

    Clusters are the sets of body language expressions that together make up a message; smiling while walking toward someone is far different than smiling while carefully backing away.

    Congruence refers to how body language matches–or doesn’t match–a speaker’s words. People saying, “Of course! It’s possible!” while unconsciously shaking their heads from side to side are perhaps being less than truthful.

    How does a culture of communication practices translate to new technologies? Mobile phone texts, just like 19th-century telegraph messages before them, need to be precise in conveying their meaning.

    In virtual meetings (on Teams and Google Hangouts, for example), students need to understand that tone of voice, facial expressions, and body language may be more important than the words they share.

    Politeness as one constant

    An additional key concern in virtual meetings is politeness. Once, in preparation for a new textbook, I was involved in soliciting topics of interest to university teachers. I was surprised that several teachers identified the need to teach politeness. The teachers pointed out that the brevity of social media meant that students were often unwittingly rude in their requests (typical email: “Where’s my grade!”). Moreover, such abruptness was crossing over to their in-person interactions.

    Politeness includes civility, getting along with others, as well as deference, showing respect to those who may have earned it through age, education, and achievement. But politeness is also related to strategies around persuasion and how to listen actively, engage with other speakers by clarifying and elaborating points and ask a range of question types. Online or in person, if students cannot interrupt politely or know when it is better to listen, whatever they have to say will be lost in the court of bad opinion.

    This is particularly important in preparation for academic and business contexts where students need to interact in groups, such as seminar settings and business meetings. Within these, it’s necessary for students to be able to take on a variety of roles, including leadership, taking notes, and playing devil’s advocate to challenge what a group thinks.

    Engaging students with project work

    Role-play can help raise awareness of these strategies among students, but it’s not enough to just take on a variety of roles found in common academic and business exchanges; students need to be able to reflect after each role-play session and infer what strategies are successful.

    Technology-based projects can also help students engage in a range of communication strategies. For example, a app series, StartUp, embraces technology in each unit by sprinkling various text messages and web-based research tasks. There are also multimedia projects where students use their phones to collect images or video and share the results in presentations that develop their critical thinking.

    For example:

    Make your own video

    Step 1 Choose a favorite restaurant or meal.

    Step 2 Make a 30-second video. Talk about the meal. Describe what you eat and drink. Explain why you like it.

    Step 3 Share your video. Answer questions and get feedback.

    This simple project subconsciously reinforces the unit’s vocabulary and grammar. It also allows students to personalize the project based on things that they need to talk about in daily life–their local foods in this case. This means that each student’s presentation is unique. Unlike with essay assignments, students tend to work hard to craft several versions until they are satisfied because they know their work will be seen by other students and that they will be asked questions that only they can answer.

    All this forces students to consider speaking strategies, as well as strategies for appropriate facial expressions and body language. Similarly, they have to use active listening strategies when listening to others’ presentations while asking questions. As technology continues to evolve, teachers need to integrate new applications into their teaching so students learn how to communicate with the tools they have at their disposal.