The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what¡¯s the role of digital assessment in teaching today? We¡¯d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students¡¯ language proficiency.

For example, ÃÛÌÒapp¡¯s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ÃÛÌÒapp¡¯s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we¡¯re not replacing human judgment; we¡¯re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don¡¯t mind monotonous work and don¡¯t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that¡¯s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students¡¯ language level or benchmark a learner¡¯s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can¡¯t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.?

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn¡¯t get tired, and it doesn¡¯t have good and bad days like human markers do. And it doesn¡¯t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who¡¯s taking the test.

If you¡¯re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don¡¯t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ÃÛÌÒapp English proficiency assessments are highly scalable and don¡¯t require extra time from human scorers, no matter how many test-takers you have.

Plus, there¡¯s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.?

More blogs from ÃÛÌÒapp

  • A overhead shot of a group of people working at a desk with papers and notebooks

    5 ways to make studying in a group work for you

    By Steffanie Zazulak

    There are many benefits to studying in a group, ranging from reducing procrastination and boosting your confidence to gaining new perspectives and learning faster. Many English language learners enjoy working in a group, and many English language teachers recommend it. Here¡¯s how to make studying in a group work for you or your students¡­

    1. Create an effective group

    Even though you love spending time with your friends, don¡¯t base study partners on friendship. Instead, look for people who stay alert in class, take notes, ask questions, and respond to the teacher¡¯s questions ¨C and don¡¯t make the group too big. An ideal size for a study group is three or four students.

    It¡¯s a great idea to try to meet on the same day and time each week because treating the study session as you would a class helps you to keep to a schedule and ensure that everyone attends.

    Finally, hold study group sessions in a place free of distractions with room to spread out the materials. This will help to ensure that you don¡¯t end up talking about the latest movies or songs instead of studying the future tense!

    2. Decide on the topics and set goals

    Before your study group, think about the topics you¡¯d like to discuss ¨C then agree on one. This will help you concentrate on that topic without straying away. Once you¡¯ve decided on your subject, also consider what you want to achieve at each session ¨C but don¡¯t take on too much material for one session.

    For example, if you¡¯re using a novel written in English to learn more about the language, just think about one aspect of it, such as a couple of the characters, rather than trying to discuss the entire book.

    3. Prepare effectively

    Before attending your study group, prepare by reading more about or researching the topic you¡¯re all going to discuss.

    Also, make a list of anything you aren¡¯t sure you understand so that you can discuss it with your fellow learners. There are sure to be different things you all need explaining in more detail, so you can help each other to understand. Which leads us on to¡­

    4. Learn from each other by communicating well

    Communicate openly ¨C it doesn¡¯t matter if one of you doesn¡¯t understand something or needs more explanation. And don¡¯t be shy about asking for your peers¡¯ feedback: ¡°Am I talking too much?¡± or ¡°Did I present your point of view correctly?¡±. It is often said that it is best to teach other material you understand, and learn from others who understand the material better than you do.

    If your study session reveals points of disagreement or confusion that you cannot resolve as a group, make a note of it and ask your teacher.

    5. Make it enjoyable

    Last on the list, but very important: try to make studying enjoyable in whatever way you can by keeping it interesting. Pick novels about subjects you all really enjoy reading about. Go to see an English-speaking movie together and discuss it at your study group. Or try a quiz together (online or in person) to see how you've picked the subject matter up.?

  • a hand reaching for a book from a bookshelf

    9 great novels to help improve your English

    By Steffanie Zazulak

    Reading is one of the most fun and effective ways to help improve your English language skills. It can help to expand your vocabulary and expose you to different sentence structures, all while you enjoy some wonderful stories.

    E-readers and tablets make learning English even easier because if you don¡¯t know a word, you can click on it to read its definition. On the Kindle, you can even add new words you¡¯ve learnt to its Vocabulary Builder feature, which is stored on the device. Others recommend listening to and reading text at the same time as an excellent way to enhance the learning process. Kindle¡¯s Whispersync for Voice is designed for just this purpose and includes audio with selected books, so you can listen and follow the text as you read.

    9 great novels to help improve your English

    Below, we reveal nine novels, including William Golding¡¯s Lord of the Flies and George Orwell¡¯s Animal Farm, to help improve your English.

    1. The Wind in the Willows ¨C Kenneth Grahame

    This classic tale takes place in the English countryside and shares the adventures of the animals that live by the river. Grahame¡¯s simple use of language with imaginative stories makes this a pleasurable read for adults and children.

    2. Lord of the Flies ¨C William Golding

    This book is a modern classic and a popular study text for schools all over the world. When a group of boys are isolated on a desert island, the society they create descends into ruthless behavior. Golding uses dramatic and descriptive language, almost like poetry, making you feel like you¡¯re in the scenes yourself.

    3. The Old Man and the Sea ¨C Ernest Hemingway

    Ernest Hemingway is well-known for his clear, straightforward writing style and short sentence structure, which is great for English language learners and many people have read it in school. It¡¯s the courageous tale of a Cuban fisherman and his battle to land a giant marlin and it¡¯s a perfect introduction to Hemingway as an author.

  • A Young woman smiling and gesturing at her friend

    Improve your English without saying a word

    By Steffanie Zazulak

    Communicating in English goes far beyond simply learning English vocabulary. In fact, there are many non-verbal strategies you can leverage to appear more confident as you improve your English. Below you¡¯ll find three of the most important aspects of non-verbal communication to work on:

    Make eye contact when you speak in English

    When you¡¯re talking to someone, it¡¯s best to look them in the eye as much as possible. This shows that you are engaged in the conversation and listening intently when not speaking. Especially in loud environments, you may find your eyes drawn to someone¡¯s lips as they talk. While it may help you better understand what they¡¯re saying in a noisy place, like a restaurant, aim to maintain eye contact as much as you can (but do remember to take a quick break away once in a while so as to not stare too intently).

    Be mindful of body language

    What you¡¯re doing with your hands and the facial expressions you make can say a lot¡ªsometimes more than words! Not only should you be aware of the body language of who you¡¯re talking with, but you also need to know what your body language is saying about you. Different cultures see hand gestures differently so it's good to be mindful of what gestures you make with your hands. If you want to appear open and friendly you may want to keep your arms open and avoid closed body language like crossing your arms.

    If someone is leaning away from you slightly, this may indicate they aren¡¯t interested in the topic you¡¯re speaking about. They may lean in closer if more interested in what you're talking about. If they smile a lot, this may mean they agree with you.

    Prepare yourself for English conversations you may have

    If you are planning to practice talking in English, it¡¯s OK to prepare yourself for the conversation. Create a script for yourself to speak from that allows you to practice difficult terms and phrases. Not only will this give you real-time experience bettering your skills, but it will allow you to speak English with confidence.

    Either in work situations or casual conversations, there¡¯s more than just English words being exchanged so remember to dedicate your full attention. It¡¯s an excellent opportunity to practice and improve your English skills and you¡¯re likely to learn more than just studying on your own.