The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what’s the role of digital assessment in teaching today? We’d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students’ language proficiency.

For example, ÃÛÌÒapp’s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ÃÛÌÒapp’s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we’re not replacing human judgment; we’re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don’t mind monotonous work and don’t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that’s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students’ language level or benchmark a learner’s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can’t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.Ìý

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn’t get tired, and it doesn’t have good and bad days like human markers do. And it doesn’t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who’s taking the test.

If you’re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don’t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ÃÛÌÒapp English proficiency assessments are highly scalable and don’t require extra time from human scorers, no matter how many test-takers you have.

Plus, there’s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.Ìý

More blogs from ÃÛÌÒapp

  • Two young girls sat at a school desk reading a book

    8 first lesson problems and solutions for young learner classes

    By Joanna Wiseman

    The first class with a new group of young learners can be a nerve-wracking experience for teachers, old and new. Many of us spend the night before thinking about how to make a positive start to the year, with a mixture of nerves, excitement, and a desire to get started. However, sometimes things don’t always go as expected, and it is important to set a few ground rules in those early lessons to ensure a positive classroom experience for all throughout the academic year.

    Let’s look at a few common problems that can come up and how best to deal with them at the start of the school year.

  • A class of students sat at desks in a classroom looking at their teacher stood at the front

    5 ways to reinspire your students after the summer holidays

    By Joanna Wiseman

    The new academic year is here and we're getting ready to head back to the English classroom. Yet, after a long and relaxing summer holiday, some students may feel unmotivated to return to the same class routine, especially if they have been learning English for several years. So, how can we reinspire students to keep learning and reconnect with English? By bringing in new resources, learning approaches and targets, we are sure you'll be able to rekindle their love of learning.

    So let's look at five ways to reinspire your English students in the coming academic year.

    1. Set new goals

    Students may lose interest in classes or feel discouraged when they don't have a clear target to work towards. If this is the case with your class, have them write up a list of five new goals they'd like to achieve.Ìý

    These goals must be SMART: Specific, Measurable, Achievable, Relevant and Timely. So rather than just saying "I'd like to learn more vocabulary", have students make it SMART.Ìý

    For example:

    Specific: "I'd like to learn new advanced vocabulary to use in my writing."

    Measurable: "I'll test myself to see if I can define and use 20 new words in sentences."

    Achievable: "I will dedicate 2 hours a week to studying the definitions and writing example sentences in context."

    Relevant: "This will help me get a good score in myÌýÌýas I struggle with formal academic language."

    Timely: "I will learn 20 new words by the end of September."

    If learners find it difficult to think of goals, ask them to write one for each language skill: listening, reading, writing and speaking. You can also refer to the GSE Teacher Toolkit, which has hundreds of learning objectives organized by age, level, skill type and more.

    The idea is to encourage them to set clear objectives, giving them an exciting new challenge to work towards for the year ahead.

    2. Encourage students to find conversation partners

    Students may lose interest in improving their English if they've only been studying in a classroom. They may see it as something boring and unrelated to their real lives.Ìý

    A great way to tackle this is by encouraging them to talk with English speakers outside of class. By doing this, they'll pick up new vocabulary and expressions, giving them more confidenceÌýin their language abilities.Ìý

    Suggest that they attend a language exchange.ÌýÌýandÌýÌýareÌýgreat platforms to find regular language exchange events in their local area. While this is suitable for intermediate learners and above, it may be a bit daunting for beginners.Ìý

    In this case, the appÌýÌýmay be a suitable alternative. Similar to a language exchange, learners can connect with people from around the world. They can choose people with a similar level as them and either write messages, send short audios, or do video calls, depending on their ability and confidence.Ìý

    Communicating with real people is a fun and encouraging reason for your learners to want to improve.

    3. Introduce interesting new vocabulary

    Students may become disheartened if they've been learning for years but aren't seeing much progress. A simple and effective way to help them improve their level is by encouraging them toÌýexpand their vocabulary.Ìý

    They already have to study a lot of vocabulary from their textbooks, so why not give it a more personal twist and ask for suggestions of topics that interest them?Ìý

    Maybe they are gamers and want to learn how to communicate better with other players around the world. Select vocabulary about styles of games, turn-taking, and strategizing that they could use – they can practice in class and be thrilled to be given homework.

    Perhaps some of your students want to study or work abroad. This may be a common topic, but one thing that is not frequently discussed is how to deal with the paperwork of living in another country. For example, getting into more specific language about banking, housing rentals, or setting up wifi will help them feel more confident about their move. Though these things differ between countries, there is a lot of overlapping vocabulary and roleplaying will do wonders to reassure and excite them about their upcoming adventures.

    By allowing your students to take control of their learning, their motivation is naturally higher and you too will enjoy finding out specific language about their interests.

    4. Work on specific problem areasÌý

    Language learners may become frustrated and lose motivation if they continue to make the same mistakes. It may cause them to feel disheartened in their abilities and want to give up, especially for those who aim to sit exams. You can help them level up by identifying specific problem areas and tailoring your classes to work on these.Ìý

    Tests can help your learners discover their weaknesses and avoid the frustration of sitting and not passing an exam. They'll be able to pinpoint what they need to work on, and you can dedicate your classes to exactly what they need, rather than cover areas they may not have problems with.

    For example, if students are experiencing difficulties with reading comprehension, you could try introducing more varied reading materials. Ask them to bring in blog posts, magazines and news articles on topics that they find interesting. Highlight keywords in the text to enhance their understanding of the piece and create comprehension questions similar to the test format they'll take.Ìý

    By giving a little extra attention to fixing problem areas, learners will soon start to see their progress, encouraging and inspiring them to keep going.

    5. Change your class formatÌý

    Sometimes learners become demotivated simply because they have become too used to the format of the classes. If this is the case, you might want to take a break from the textbook and try more creative language learning methods. For example:

    Use interactive games

    Suitable for all levels, you can use platforms such asÌýÌýorÌý to test your learners. They offer a new dimension to the class, encouraging students to have fun with the language. Divide them into teams to add an element of competition – there's nothing like a friendly game to excite students!

    Set project work

    Put your class into small groups and have them work on a project to present to the rest of the group. Choose topics they might cover in their textbooks, such as occupations, travel or cultural traditions. Or even better – let students come up with their own! This activity can be modified to suit all levels and offers a challenge as learners will need to push their language limits.

    Hold class debatesÌý

    More suitable for intermediate learners and above, class debates get everyone talking. You can ask students to brainstorm topics they're interested in. You can offer prompts such as climate change, the advertising of junk food or the impacts of social media. They'll be happy to talk about things that concern them.

    Throw in some unexpected activities to bring students' attention back to class and spark their interest in learning again.

  • A child sat at a desk with a pen in hand, looking up at their teacher and smiling

    Dyslexia and ELT: How to help young learners in the classroom

    By Joanna Wiseman

    When you’re teaching English to young learners, you might find that there are a few students in your class who are struggling. But sometimes it can be hard to tell why. Is it because their language level is low? Or are they finding classroom work difficult because of a general cognitive difference, like dyslexia?Ìý