The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what’s the role of digital assessment in teaching today? We’d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students’ language proficiency.

For example, ÃÛÌÒapp’s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ÃÛÌÒapp’s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we’re not replacing human judgment; we’re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don’t mind monotonous work and don’t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that’s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students’ language level or benchmark a learner’s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can’t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.Ìý

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn’t get tired, and it doesn’t have good and bad days like human markers do. And it doesn’t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who’s taking the test.

If you’re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don’t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ÃÛÌÒapp English proficiency assessments are highly scalable and don’t require extra time from human scorers, no matter how many test-takers you have.

Plus, there’s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.Ìý

More blogs from ÃÛÌÒapp

  • Grammar 101: insider tips and tricks to instantly improve your writing (part 4)

    By
    Reading time: 7 minutes

    Punctuation makes your writing easier to read and understand, but it can be tricky to master. As an editor and proofreader, I often notice people confusing semi-colons and colons, so we'll explore the difference between them. And because both are often used in lists, we'll also look at the humble comma – and its sometimes-controversional cousin, the Oxford comma.Ìý

    Semi-colons and colons both connect phrases in a sentence but are used in different situations.Ìý

    Understanding colons

    Colons introduce important information and explanations. They're often used before lists as a replacement for phrases like "they are" and "which is":

    • He offered me a choice of drinks: tea, coffee or hot chocolate.Ìý
    • I packed the essentials in my bag: water, pens and a magazine.Ìý
    • She speaks three languages: English, French and Portuguese.Ìý

    You can also think of a colon as a spotlight, with the phrase that comes after the colon explaining or expanding what came before it.Ìý

    • In 1903, travel was changed forever by an important event: Orville and Wilbur Wright's first successful flight.
    • He loves visiting the animals at the farm: cows are his favourite.Ìý
    • There is one rule I live by: I treat others as I wish to be treated.

    The secrets of semi-colons

    A semi-colon links two ideas that are closely related and that would be two complete sentences if you used a period instead. They give a softer transition than a period would, and they're often used instead of conjunctions like "and", "but" and "because":

    • I love eating pizza; my sister loves eating burgers.
    • I wanted to go for a swim; I couldn't find my goggles.Ìý
    • I'm going to the park; the weather is beautiful.

    Semi-colons also seperate items in long lists to make life easier for the reader and stop a sentence becoming a sea of apostrophes. For example:

    • I've got my shopping list ready: peppers, carrots and oranges from the market; toothpaste, shampoo and pain relief from the drugstore; and a newspaper, snack and drink from the newsstand. Ìý

    Standard comma or Oxford comma?

    An Oxford comma goes before "and" or "or" at the end of a list. The first example has an Oxford comma, the second doesn't.Ìý

    • Please bring me a sandwich made with cheese, lettuce, and tomato.Ìý
    • Please bring me a sandwich made with cheese, lettuce and tomato.Ìý

    American English generally favors the Oxford comma, British English typically omits it, unless needed for clarity. Compare:

    • I love my parents, Taylor Swift and Keanu Reeves.
    • I love my parents, Taylor Swift, and Keanu Reeves.Ìý

    As with many areas of punctuation, whether you choose to use the Oxford comma is a matter of personal preference. However, the most important thing is to be consistent in your usage.Ìý

  • A person in a denim jacket and striped shirt holds glasses and a notebook, standing by a window with bright daylight.

    What happens in the brain when you learn a language?

    By
    Reading time: 7 minutes

    Whether you’re picking up Spanish for travel, Mandarin for business or French just for fun, you’re not only expanding your communication skills, you’re also giving your brain a powerful workout. But what actually happens inside your brain when you learn a language?Ìý

    The brain’s language centers

    Your brain is made up of many parts and two areas are significant for language:

    • : Located in the frontal lobe, this region helps you produce speech and form sentences.
    • : Found in the temporal lobe, this area helps you understand spoken and written language.

    When you start learning a new language, these areas get busy. They work together to help you listen, speak, read and write in your new language (Friederici, 2011).

  • What’s it like to teach English in Nepal?

    By
    Reading time: 3 minutes

    Anandi Vara was trained in teaching English in Kathmandu, Nepal before teaching at a monastery in Pokhara. There she taught students ranging from six to 10 years of age, both in groups and individually. Here she reveals the lessons she learned during her time thereÌý– including how to avoid being perturbed by a cockroach attack.

    Whatever you do: don’t freak out

    It just makes everything worse. It’s easy for things to get overwhelming – a sense that can be made worse by the feeling of homesickness, especially if it’s your first time living abroad – but thinking rationally, and getting to the source of what’s causing the worry, usually helps. It’s important, as you don't want to share your fear in lessons because you’re the teacher and need to show confidence.

    This was, however, tested to the limit when I had a cockroach dangled in front of my face. It took all my strength to stay calm. I gave an unimpressed look, thereby establishing myself as the figure of authority, which seemed to work.

    Be aware of cultural traditions

    It is important to remember that every country has its own traditions. I was teaching in a monastery, so I made sure to wear respectful clothing, even in the face of soaring temperatures. The more I learned about the Tibetan culture, the more fascinated I became by it. The students taught me how to write my name in Tibetan and the meaning behind it. I learned about Tibetan history and Tibetan culture.

    I also found that the more I showed willingness to learn about the Tibetan culture, the more I bonded with the students, so that when it was time to teach, the students were more cooperative in lessons, engaging and participating more.

    Teaching is two-way learning

    There is so much I learned teaching abroad, both in the classroom and out. Making mistakes as you begin is only natural, but it’s whether you can learn from these mistakes that counts. No two students are ever the same so it’s a constant process of learning as you go. As a result, I learned about the environment I was in – from traditional prayer ceremonies to the Tibetan alphabetÌý– and about myself, notably organizational skills and a renewed curiosity about the English language.

    Be Flexible

    Sometimes it doesn’t matter if you’ve planned your lesson down to the smallest detail – if it doesn’t take, then it doesn’t take. I was only 10 minutes into a lesson once and I could tell that I was beginning to lose the students’ attention. Not only did it show that they were uninterested, it also distracted me from what I was doing. It was at this point that I threw out my existing plan and tried a whole new lesson: I had the students up on their feet and engaging with each other and, although completely improvised, it was very successful.

    Patience is a must

    During my one-on-one mentoring session, my student seemed to have no motivation. He wasn’t learning as well as the other students and had therefore given up. No matter what I tried, he refused to cooperate, but I didn’t let it put me off. I kept trying different methods until finally finding one that he responded to. I made sentence structuring into a game. It wasn’t anything fancy and consisted of scraps of paper with words written on them.

    Although it took a lot of time to find the right angle, it was worth it because he soon realised that although it might take longer for him to pick things up, he would eventually get there and have a greater sense of accomplishment.