The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what¡¯s the role of digital assessment in teaching today? We¡¯d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students¡¯ language proficiency.

For example, ÃÛÌÒapp¡¯s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ÃÛÌÒapp¡¯s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we¡¯re not replacing human judgment; we¡¯re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don¡¯t mind monotonous work and don¡¯t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that¡¯s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students¡¯ language level or benchmark a learner¡¯s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can¡¯t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.?

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn¡¯t get tired, and it doesn¡¯t have good and bad days like human markers do. And it doesn¡¯t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who¡¯s taking the test.

If you¡¯re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don¡¯t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ÃÛÌÒapp English proficiency assessments are highly scalable and don¡¯t require extra time from human scorers, no matter how many test-takers you have.

Plus, there¡¯s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.?

More blogs from ÃÛÌÒapp

  • Woman wearing headphones outside, smiling and looking hopeful

    6 easy ways to learn English

    By Steffanie Zazulak

    When you¡¯re learning English, it¡¯s important to keep your motivation up. As with any task, there may be times when it feels a bit more difficult, so switch up your methods and don¡¯t be afraid to make mistakes ¨C you¡¯ll reach the level you want to be at.

    We¡¯ve already provided some unique ways to teach English that you may now have experienced with your teacher. Here, we suggest some easy ways to learn English that you can try any time ¨C at home, at work or on the move. Why not try them today? Surround yourself with English and you¡¯ll see improvements in your language confidence and skills, while having fun at the same time¡­

    1. English words with friends

    Scrabble is a classic board game in which players use random lettered tiles to create words in a crossword fashion. It¡¯s a fantastic way to strengthen your English vocabulary, and there¡¯s also a Scrabble Junior version for beginners. Playing Scrabble challenges you to really think in English as you try to come up with different words using your set of letters.

    If you¡¯re taking an English class, buy the board game and invite your classmates to play with you. You can also play Scrabble online through websites like Facebook, where it is called Words With Friends.

    2. Add some music

    Not only will your favorite song wake up your mind and put you in a positive mood to learn English, but the lyrics can help you expand your skills. acquire grammar and vocabulary and improve spelling.

    Songs almost always contain a lot of useful vocabulary, phrases and expressions. And since the intended audience is fluent English speakers, the latest tunes include up-to-date language and colloquialisms. The language used in songs is casual and usable, if you pick the right music. Music also has an uncanny ability to stick in our heads, which can help you remember your new English words.

  • a hand holding a remote control

    8 easy tricks for improving your English skills

    By Steffanie Zazulak

    As you work to improve your English skills, it¡¯s always helpful to have some tricks and tips to help you stay motivated. With that in mind, we¡¯ve collated these eight simple tips from fellow English language learners, to help you on your quest¡­

    1. Set yourself small goals

    Learning English is a long process, and it may take years to progress from one level to the next. That¡¯s why it¡¯s important to set yourself achievable goals. At ÃÛÌÒapp, we work with thousands of English teachers worldwide to define what it means to ¡®be at a level¡¯ in English.?

    2. Create a study schedule

    Ensure this schedule works around your daily responsibilities and make sure to keep it simple! Try breaking up your English language learning over the course of an entire day, which may make it feel more manageable.

    3. Practice a little bit every day

    Even if it¡¯s listening to an English podcast during your commute or practicing your favorite words while having breakfast, every little bit of practice helps!

    4. Discover what type of learner you are

    Auditory, visual, or tactile. Use this as a basis for how you spend time studying. For instance, a visual learner may benefit from flashcards (see point 7), while an auditory learner may benefit from watching a television program in English.

    5. Turn on music in English

    Rhythms and rhymes have been found to stimulate the brain and improve learning. Our research found that music can be an invaluable tool when learning English, as it helps with pronunciation, word boundaries and vocabulary.

    6. Watch movies with English dialogue

    Movies are a great source of native conversation and vocabulary. Plus, the visual nature of film allows you to experience nonverbal context too ¡ª such as facial expressions and hand gestures ¡ª accompanying and contextualizing the film¡¯s dialogue. Above all, watching a movie is a fun and motivational way to develop English language skills.

    7. Learn new vocabulary with flashcards

    While this may be the oldest studying trick in the book, students around the world use flashcards because they work!

    8. Track your progress

    To gain a sense of accomplishment, it¡¯s important to know where you¡¯ve started. We¡¯ve just introduced a new way to measure progress in English. Have a look at it to quickly discover what your areas of strength and weakness are.

    Finally, it¡¯s important to remember that not every learning trick will work for you. So, if you find that chatting with fluent English speakers helps you progress faster but you¡¯re not always able to converse with them face-to-face, spend more of your time communicating online with your English-speaking friends and contacts.

  • A overhead shot of a  person sat on a chair with a laptop to their left is icons of envelopes

    6 things to consider when writing English emails

    By Steffanie Zazulak

    Every day, an astonishing number of emails are sent and received worldwide. While a considerable amount of these are informal messages between friends, the majority are for business purposes. Whether you¡¯re emailing someone you work with, applying for a new job or making new connections, here are some general rules to follow when writing English emails¡­

    1. Know your tone

    Always consider who you are writing to and adapt your language accordingly. Emails are less formal than letters, so it¡¯s fine to start your email with ¡°Hi¡± or ¡°Good morning¡± ¨C but it may be better to write ¡°Dear¡­¡± if you are emailing someone for the first time or if they are senior to you. Similarly, ending emails with ¡°Best/kind regards¡± rather than ¡°Yours sincerely/faithfully¡± works well, with the latter being more appropriate for a formal email. Whatever the relationship, though, don¡¯t feel tempted to use laid-back, colloquial expressions like ¡°Hey, you guys¡±, ¡°Yo!¡±, or ¡°Hi folks¡±.

    2. It¡¯s all about the titles

    It¡¯s increasingly common to use first names in international business communications, so don¡¯t be afraid to do so. Another title to consider is your email subject header: a short, clear text is important as busy people often decide whether to even open an email depending on the subject header. Examples of a good subject header include ¡°Meeting date changed¡±, ¡°Quick question about your presentation¡±, or ¡°Suggestions for the proposal¡±.

    3. Use a professional email address

    If you work for a company you¡¯ll be using your company email address. But if you¡¯re using a personal email account because you¡¯re self-employed or looking for a new job, you should be careful when choosing that address.

    You should always have an email address that includes your name so that the recipient knows exactly who is sending the email. Email addresses that you created while you were in school or college (IloveJohn@¡­ or ¡°Beerlover@¡­) are not appropriate for the workplace!

    4. Limit the small talk

    Small talk can help to build relationships but it doesn¡¯t need to be overly personal. A simple ¡°I hope you are well¡± or ¡°How are things?¡± will usually suffice. Also, be cautious with humor as it can easily get lost in translation without the correct tone or facial expressions that accompany face-to-face meetings. It¡¯s safer to leave out humor from emails unless you know the recipient well.

    5. Keep it simple

    Emails are intended to be written, read and understood quickly, so only include the important details ¨C and avoid saturating your message with unnecessary information.

    6. Proofread every message

    Always check your emails before pressing Send. Read and re-read your email a few times, preferably aloud, to ensure there are no spelling or grammatical mistakes. And never just rely on the auto spell-check; spell-checking software doesn't always understand the context of your writing and can throw you off with incorrect suggestions.?

    Happy emailing.