The role of AI in English assessment

Jennifer Manning
A woman holding a tablet stood in a server room

Digital assessment is becoming more and more widespread in recent years. But what’s the role of digital assessment in teaching today? We’d like to give you some insight into digital assessment and automated scoring.

Just a few years ago, there may have been doubts about the role of AI in English assessment and the ability of a computer to score language tests accurately. But today, thousands of teachers worldwide use automated language tests to assess their students’ language proficiency.

For example, ÃÛÌÒapp’s suite of Versant tests have been delivering automated language assessments for nearly 25 years. And since its launch in 1996, over 350 million tests have been scored. The same technology is used in ÃÛÌÒapp’s Benchmark and Level tests.

So what makes automated scoring systems so reliable?

Huge data sets of exam answers and results are used to train artificial intelligence machine learning technology to score English tests the same way that human markers do. This way, we’re not replacing human judgment; we’re just teaching computers to replicate it.

Of course, computers are much more efficient than humans. They don’t mind monotonous work and don’t make mistakes (the standard marking error of an AI-scored test is lower than that of a human-scored test). So we can get unbiased, accurate, and consistent scores.

The top benefits of automated scoring are speed, reliability, flexibility, and free from bias.

Speed

The main advantage computers have over humans is that they can quickly process complex information. Digital assessments can often provide an instant score turnaround. We can get accurate, reliable results within minutes. And that’s not just for multiple-choice answers but complex responses, too.

The benefit for teachers and institutions is that they can have hundreds, thousands, or tens of thousands of learners taking a test simultaneously and instantly receive a score.

The sooner you have scores, the sooner you can make decisions about placement and students’ language level or benchmark a learner’s strengths and weaknesses and make adjustments to learning that drive improvement and progress.

Flexibility

The next biggest benefit of digital assessment is flexible delivery models. This has become increasingly more important since online learning has become more prominent.

Accessibility became key: how can your institution provide access to assessment for your learners, if you can’t deliver tests on school premises?

The answer is digital assessment.

For example, Versant, our web-based test can be delivered online or offline, on-site or off-site. All test-takers need is a computer and a headset with a microphone. They can take the test anywhere, any time of day, any day of the week, making it very flexible to fit into someone's schedule or situation.Ìý

Free from bias

Impartiality is another important benefit of AI-based scoring. The AI engine used to score digital proficiency tests is completely free from bias. It doesn’t get tired, and it doesn’t have good and bad days like human markers do. And it doesn’t have a personality.

While some human markers are more generous and others are more strict, AI is always equally fair. Thanks to this, automated scoring provides consistent, standardized scores, no matter who’s taking the test.

If you’re testing students from around the world, with different backgrounds, they will be scored solely on their level of English, in a perfectly objective way.

Additional benefits of automated scoring are security and cost.

Security

Digital assessments are more difficult to monitor than in-person tests, so security is a valid concern. One way to deal with this is remote monitoring.

Remote proctoring adds an extra layer of security, so test administrators can be confident that learners taking the test from home don’t cheat.

For example, our software captures a video of test takers, and the AI detection system automatically flags suspicious test-taker behavior. Test administrators can access the video anytime for audits and reviews, and easily find suspicious segments highlighted by our AI.

Here are a few examples of suspicious behavior that our system might flag:

Image monitoring:

  • A different face or multiple faces appearing in the frame
  • Camera blocked

Browser monitoring:

  • Navigating away from the test window or changing tabs multiple times

Video monitoring:

  • Test taker moving out of camera view
  • More than one person in the camera view
  • Looking away from the camera multiple times

Cost

Last but not least, the cost of automated English certifications are a benefit. Indeed, automated scoring can be a more cost-effective way of monitoring tests, primarily because it saves time and resources.

ÃÛÌÒapp English proficiency assessments are highly scalable and don’t require extra time from human scorers, no matter how many test-takers you have.

Plus, there’s no need to spend time and money on training markers or purchasing equipment.

AI is helping to lead the way with efficient, accessible, fair and cost-effective English test marking/management. Given time it should develop even further, becoming even more advanced and being of even more help within the world of English language learning and assessments.Ìý

More blogs from ÃÛÌÒapp

  • College students sitting together working on a project

    Five ways to apply startup thinking in your classroom

    By Nicole Kyriacou
    Reading time: 3 minutes

    Startups are generally considered to be new, technology-focused companies that are less than five years old. For the most part, they aim to disrupt industry with innovations, grow in terms of users and revenues and provide value to customers and shareholders.

    It may not appear that startups have much in common with English Language Teaching (ELT), but there is, in fact, plenty to learn from startups and the way they work.

    By understanding how startups think and looking at their best attributes, we can bring more creativity to our classrooms. Not only can we find new ways for our students to learn, collaborate and grow together, but we can also help our students develop much-needed leadership and critical thinking skills.

    What is startup thinking?

    At its core, startup thinking is about problem-solving and growth. User-focused and data-driven, startup teams theorize, research, plan and test their products on new markets. Their strength is in their agility, being able to "pivot" quickly: change products, services and technology based on feedback from their customers.

    They also operate on a number of key principles, all of which can be applied in the classroom:

    1. Be entrepreneurial

    Startups are entrepreneurial by definition. Their staff work in teams, but also have no problem going it alone, finding solutions and taking responsibility for new projects and initiatives. These are all excellent traits to encourage in the classroom as they will not only help your learners in an educational context, but in their professional lives too.

    By learning to be accountable to themselves, measuring their own progress and seeing their achievements, autonomous learners develop self-confidence and progress faster as a result.

    It’s therefore important to encourage students to take responsibility for their own learning. Rather than being solely reliant on their teacher, autonomous learners seek out ways to practice and improve their language skills in ways that appeal to them.

    To do this, brainstorm strategies with your students to help them find ways to use English outside the classroom. They could, for example, keep a journal in English, watch English language films and take notes, read short stories or news articles, or even set their technology and social media language settings to English.

    2. Collaborate and learn from each other

    Startups have a common goal: to establish a business model and achieve a product-market fit. This goal focuses people’s attention and develops rapport among team members. As an additional benefit of working together, startuppers learn their own strengths and weaknesses and begin to collaborate with team members with complementary skills.

    By learning about your students’ interests, objectives and needs, you can find inspiration to design relevant class projects. These give your students a common goal and the chance to collaborate effectively. What’s more, project work is rich in language learning opportunities and makes students accountable to one another. This in turn increases motivation and provides a genuine context for language learning.

    3. Reward effort

    Startups are not afraid to get things wrong. In fact, all entrepreneurs embrace mistakes, as they are part of coming to the right solution. As Thomas Edison once said "I have not failed 10,000 times – I’ve successfully found 10,000 ways that will not work." ÌýSome startups go as far as to reward and celebrate failure – saying that it’s a sign that a person is trying to succeed.

    Encourage students to see mistakes as learning opportunities. Creating a safe space in the classroom where everyone is treated with respect and mistakes are viewed as natural learning experiences. This will help your students learn the language at their own pace, without fear of ridicule.

    4. Foster a growth mindset

    Startups are famous for focusing on growth and believing in improving their products. They see both negative and positive feedback as opportunities to grow. By always seeking to optimize their products and services, they improve the user experience and earn loyalty.

    Similarly, it’s key to foster a growth mindset in your learners. ÌýA growth mindset perceives intelligence and ability as attributes to be developed, whereas a fixed mindset sees intelligence and ability as innate and unchanging.

    Students with a growth mindset will therefore believe they can improve, be more motivated and see more progress as a result.

    5. Mentor and support

    Startup founders mentor and support their team members when they face challenges, when they need to grow and when they are not reaching their potential. This increases the value of the workforce and enables them to be more productive.

    Teachers are often already naturals at this. We know how important it is to offer support to our students, especially when they are feeling frustrated or disappointed with their progress. With our encouragement and support, our students can achieve things they never thought possible. So perhaps, in this final point, startup leaders could learn a thing or two from us.

  • Children sat in a classroom with raised hands, their teacher stands at the front of the class

    GSE Partner School Program: Batari School and Maitreyawira School

    By Thomas Gardner
    Reading time: 4 minutes

    The Global Scale of English (GSE) Partner School program by ÃÛÌÒapp stands as a beacon of innovation and excellence. This initiative is not just about enhancing English language ability: it's about transforming the educational journey for both teachers and students. Today, we celebrate the success stories of two institutions: Batari School and Maitreyawira School, both of which have embraced the GSE Partner School program with inspiring results.

  • Two people sat togther with phones smiling

    Don't give up when it comes to learning English

    By Steffanie Zazulak
    Reading time: 2 minutes

    We love sharing stories of English learners and educators whose lives have been positively transformed by the language. One such inspiring story comes from Rodrigo Tadeu in São Paulo, Brazil. Discover why he holds a special appreciation for mastering English.

    Motivations for learning English?

    Rodrigo grew up speaking Portuguese in South America. As a child, he never thought about learning another language. However, when he became an adultÌýand began aspiring to a career, he realized that expanding his language abilities would help him achieve these dreams.

    "I worked as an accountant for an American company," he said. "So, to communicate and achieve professional success, I had to learn English!"

    Rodrigo has changed jobs since then. And even though he’s no longer required to speak English with his new company, he still feels a responsibility to himself to continue his education.

    The road to English fluency

    There are many tools that you can use to improve your English language skills, and Rodrigo used several – some he’s still using to this day. First, he started learning English formally by taking classes in high school. However, his shy disposition made it difficult for him to practice because he was afraid of failing in front of others. At the time, he didn't haveÌýcareer goals motivating him to learn the language either.

    Later, however, our adventurous accountant decided to learn English in earnest, so he traveled to Canada to study and become aÌýconfident speaker. When he returned to Brazil, he kept studying and continues to do so. Reading books and articles, listening to podcasts and copying other English speakers have also helped develop his conversational skills. Among his favorite podcasts are "English as a Second Language" and "Freakonomics".

    English learning is not without challenges

    Rodrigo noted that he struggles with pronunciation most.Ìý“The way English speakers say words is very different than the way you would say something in Portuguese.â€

    He thinks the issue is the same for Spanish speakers as well.Ìý"In Portuguese or Spanish, if you know the words,Ìýyou can basically speak exactly what you read. In English, it's totally different. You cannot speak the words that you are reading. So you have to know about this!"

    This might be the most challenging part of learning the language for Rodrigo, but he assured us that he’s not giving up.

    English for enjoyment

    Rodrigo may have initially studied English as a way to progress his career, but the language quickly became something he enjoyed.ÌýAnd instead of being content with the skill that he has now, Rodrigo dreams of continuing his English-speaking education so he can travel and further enjoy his life.

    "These days, English has become fun!" he said. "Now it's better to watch movies and TV in English."

    He also mentioned that he eventually would like to visit Europe. But when asked about his dream destination, Rodrigo said that:Ìý“I’d like to move back to Canada, maybe live in Vancouver for a year or two!â€

    Advice for English language learners

    After working hard for years to learn English, Rodrigo now offers advice to fellow Brazilians (and others) who wish to speak another language:

    "You have to be confident, and don’t give up. You have to keep your dreams. It's difficult to ... speak one language that's not your mother language ... If you can imagine, you can achieve, and you can do. So 'don't give up' is the perfect phrase."