Oxford University Press

English Language Teaching Global Blog


3 Comments

Assessment for the Language Classroom – Q&A Session

proofreading for English language students in EAPProfessor Anthony Green is Director of the Centre for Research in English Language Learning and Assessment at the University of Bedfordshire. He is a Past  President of the International Language Testing Association (ILTA). He has published on language assessment and in his most recent book Exploring Language Assessment and Testing (Routledge, 2014) provides teachers with an introduction to this field. Professor Green’s main research interests are teaching, learning, and assessment. Today, we share some of the questions and answers asked of Tony during his recent webinar, Assessment for the Language Classroom.

 

Should placement tests be given without students’ doing any preparation so that we can see their natural level in English?

Ideally, placement tests should not need any special preparation. The format and types of question on the test should be straightforward so that all students can understand what they need to do.

How should the feedback from progress tests be given? Should we give it individually or work with the whole class?

It’s great if you have time for individual feedback, but working with the whole class is much more efficient. Of course good feedback does not usually just involve the teacher talking to the class and explaining things, but encouraging students to show how they think. Having students working together and teaching each other can often help them to understand concepts better.

Besides proficiency exams, are there any tools to compare the students’ level to the CEFR? How I can evaluate them according to the CEFR? For example, a B2 student should be able to do this and that.

One of the aims of the CEFR is to help teachers and students to understand their level without using tests. Students can use the CEFR to judge their own level, to see what people can use languages for at different levels of ability and to evaluate other peoples’ performance. The European Language Portfolio (http://www.coe.int/en/web/portfolio) is a great place to start looking for ideas on using the CEFR in the classroom.

Practice tests can be practice in class, where students are asked to practice with new points of language…right?

I think this kind of test would be what I called a progress test. Progress tests give students extra practice with skills or knowledge taught in class as well as checking that they have understood and can apply those skills.

Ideas for testing lesson progress?

Course books and their teachers’ guides have a lot of good suggestions and materials you can use for assessment. There are also some good resource books available with ideas for teachers. I would (of course) recommend my own book, Exploring Language Assessment and Testing (published by Routledge) and (a bit more theoretical) Focus On Assessment by Eunice Jang, published by Oxford University Press.

Why does level B1 always take a longer time to teach? I notice from the books we use…there is B1 and B1+.

The six CEFR levels A1 to C2 can be divided up into smaller steps. In the CEFR there are ‘plus’ levels at A2+, B1+ and B2+. In some projects I have worked on we have found it useful to make smaller steps – such as A1.1, A1.2, A1.3. Generally, real improvements in your language ability take longer as you progress. Thinking just about vocabulary, the difference between someone who knows no words and someone who knows 100 words of a language is very big: the person who knows a few words can do many more things with the language than the person who knows none. But the difference between someone who knows 5,000 words and the person who knows 5,100 words is tiny.

Could you please tell us more about assessment?

I’d love to! At the moment I am working with some colleagues around Europe on a free online course for teachers. Our project is called TALE and you can follow us on Facebook: https://www.facebook.com/TALEonlinetrainingcourse/

What CEFR aligned placement test would you recommend?

The best placement test is the one that works most effectively for your students. I’m happy to recommend the Oxford Online Placement Test (OOPT), but whatever system you use, please keep a record of how often teachers and students report that a student seems to be in the wrong class. If you find one placement system is not very useful, do try to find a better one.

How reasonable is to place the keys to the tests in students books?

In the webinar I said that different tests have different purposes. If the test is for students to check their own knowledge, it would be strange not to provide the answers. If the test results are important and will be used to award grades or certificates, it would be crazy to give the students the answers!

Is cheating an issue with online placement tests?

Again, the answer is ‘it depends’. If cheating is likely to be a problem, security is needed. Online tests can be at least as secure as paper and pencil tests, but if it is a test that students can take at home, unsupervised, the opportunity to cheat obviously exists.

Could you please explain how adaptive comparative judgement tests work? Which students are to be compared?

Adaptive comparative judgement (ACJ) is a way of scoring performances on tests of writing and speaking. Traditionally, examiners use scales to judge the level of a piece of student work. For example, they read an essay, look at the scale and decide ‘I think this essay matches band 4 on the scale’.

ACJ involves a group of judges just comparing work produced by learners. Rather than giving scores on a predetermined scale, each judge looks at a pair of essays (or letters, or presentations etc.) and uses their professional judgement to decide which essay is the better of the two.

Each essay is then paired, and compared, with a different essay from another student. The process continues until each essay has been compared with several others. ACJ provides the technology for the rating of Speaking and Writing responses via multiple judgements. The results are very reliable and examiners generally find it easier to do than rating scales. Take a look at the website nomoremarking.com to learn more.

Besides the CEFR, what we can use to evaluate students in a more precise way?

See my answer to the last question for one interesting suggestion. A more traditional suggestion is working together with other teachers to agree on a rating scale to use with your students. Then have training sessions (where you compare the marks you each award to the same written texts or recordings of student work) to make sure you all understand and use the scale in the same way.

Can you suggest applications for correcting MCQ tests?

Online test resources like the ones at www.oxfordenglishtesting.com include automatic marking of tests. For making your own, one free online system I like is called Socrative.

How can placement tests be applied in everyday classrooms where they are split-level classes and students with disabilities learning together with others? What about people with some sort of disability/impairment (eg. dyslexia)

Sometimes there are good reasons to mix up learners of different levels within a class – and tests are not always the most suitable means of deciding which students should be in which class. Where learners have special needs, decisions about placement may involve professional judgement, taking into consideration the nature of their needs and the kinds of support available. In most circumstances placement should be seen as a provisional decision, if teachers and learners feel that one class is not suitable, moving to another class should be possible.

What about just giving a practice test before a major summative assessment at the end of a semester?

Yes, that seems a good idea. If students aren’t familiar with the test, they may perform poorly because they get confused by the instructions or misjudge the time available. Having a little practice is usually helpful.

If you missed Tony’s or any of our other PD webinars, why not explore our webinar library? We update our recordings regularly.


1 Comment

Assessment for the Language Classroom – What’s on the menu?

shutterstock_271564088Professor Anthony Green is Director of the Centre for Research in English Language Learning and Assessment at the University of Bedfordshire. Today, he joins us to preview his upcoming webinar Assessment for the Language Classroom.

What’s on the menu?

If there’s one topic in language education that’s guaranteed to get people worked up, it’s assessment. But, in truth, assessments are just tools. Like tools we use for other purposes, problems crop up when we use them to do things they aren’t designed for, when we lack the skills to operate them properly, or when they are poorly made. Knives are great tools for cutting bread, but are not so useful for eating soup. Some people are more skilled than others at using chopsticks, but chopsticks made of tissue paper are of no use to anyone.

“… different kinds of language assessment are right for different uses.”

Just like tools made to help us eat and drink, different kinds of language assessment are right for different uses. All assessments help us to find out what people know or can do with language, but they are designed to tap into different aspects of knowledge at different levels of detail.

Assessment ‘bread and butter’

The best known English language tests are the national examinations taken in many countries at the end of high school and international certificates, like the TOEFL© test, or Cambridge English examinations. For many students, these tests can seem make or break: they may need to pass to get into their chosen university or to get a job offer. Because of their importance, the tests have to be seen to be fair to everyone. Typically, all students answer the same questions within the same time frame, under the same conditions. The material used on the best of these tests takes years to develop. It is edited, approved and tried out on large numbers of students before it makes it into a real test.

‘Make or break’ testing

The importance of these tests also puts pressure on teachers to help their students to succeed. To do well, students need enough ability in English, but they also need to be familiar with the types of question used on the test and other aspects of test taking (such as the time restrictions). Taking two or three well-made practice tests (real tests from previous years, or tests that accurately copy the format and content of the real tests) can help students to build up this familiarity. Practice tests can show how well the students are likely to do on the real test. They don’t generally give teachers much other useful information because they don’t specifically target aspects of the language that students are ready to learn and most need to take in. Overuse of practice tests not only makes for dull and repetitive study, but can also be demotivating and counterproductive.

Home-cooked, cooked to order, or ready-made?

“What’s good for one [exam] purpose is not general good for another.”

When teachers make tests for their classes, they sometimes copy the formats used in the ‘big’ tests, believing that because they are professionally made, they must be good. Sadly, what’s good for one purpose (for example, judging whether or not a student has the English language abilities needed for university study) is not generally good for another (for example, judging whether or not a student has learnt how to use there is and there are to talk about places around town, as taught in Unit 4).

Many EFL text books include end-of-unit revision activities, mid-course progress tests and end-of-course achievement tests. These can be valuable tools for teachers and students to use or adapt to help them to keep track of progress towards course goals. When used well, they provide opportunities to review what has been learnt, additional challenges to stretch successful learners and a means of highlighting areas that need further learning and practice. Research evidence shows that periodic revision and testing helps students to retain what they have learnt and boosts their motivation.

Getting the right skills

Like chefs in the kitchen or diners using chopsticks, teachers and students need to develop skills in using assessments in the classroom. The skills needed for giving big tests (like a sharp eye to spot students cheating) are not the same as those needed for classroom assessment (like uncovering why students gave incorrect answers to a question and deciding what to do about this). Unfortunately, most teacher training doesn’t prepare language teachers very well to make, or (even more importantly) use assessments in the classroom. Improving our understanding of this aspect of our professional practice can help to bring better results and make language learning a more positive experience.

In the webinar on 16 and 17 February, I’ll be talking about the different kinds of assessment that teachers and students can use, the purposes we use them for, the qualities we should look for in good assessments and the skills we need to use them more effectively. Please feel free to ask Anthony questions in the comments below.

webinar_register3

References:
Green, A.B. (2014) Exploring Language Assessment and Testing. Abingdon Oxon: Routledge: Introductory Textbooks for Applied Linguistics.


Leave a comment

Discover the NEW International Express Tests and Teacher’s Guides

Students Sitting at Desks and WritingBruce Wade, Managing Editor of International Express, introduces his upcoming webinar on 11th September about the new International Express Tests and Teacher’s Guides.

The new International Express launched earlier this year, and now, plenty of extra resources to support the course are available for free on Oxford Teachers’ Club.  In this webinar, I’ll be exploring how the new Teacher’s Guides can help you quickly plan your lessons, and I’ll show you around the new tests and Student Progress Report, which help you to regularly and quickly check your students’ performance.

Plan your lessons in a flash

International Express comes with extensive extra resources including photocopiable activities, videos for every unit, and worksheets to support each video – so you won’t be short of material, but how do you make the best use of it all?  We’ve developed Teacher’s Guides for every level, which give a clear, one-page overview of the course, meaning that you can see all the syllabus items, target language and skills, and resources in one go. I’ll be exploring how you can use these to plan your lessons quickly and easily.

Regularly check students’ progress

Tests are an important part of every course, and International Express tests provide comprehensive coverage of all the language in the Student’s Book.  Most test items are written as A‒B exchanges to reflect the communicative nature of the course.   There is a separate test for each section so teachers can test their students after completing a section, or a unit.  I’ll explain the different ways you can use these with your class, and we’ll look at how you can analyse the results to make direct comparisons of your students’ performance across sections, and whole units.

Analyse students’ performance

We developed the unique Student Progress Report to help you measure students’ performance unit-by-unit, and across different skills.  I’ll explain how you can use this tool to see how a student is performing across the four sections of a unit, and we’ll look at how you can customise it, for example, by drawing different types of graphs, or by adding comments on your students’ performance.

I look forward to helping you making the most of all of these resources on 11th September.  In the meantime, you can take a look at them on Oxford Teachers’ Club – you just need to sign in with your usual log in details.


22 Comments

Bring your ELT coursebook to life!

Students with a textbook in the parkKolos Esztergályos, an Oxford ELT Consultant based in Hungary, gives his tips for how to breathe new life into your ELT coursebooks.

Most teachers would agree that no matter how attractive an ELT coursebook might look, its real strengths and hidden weaknesses will unfold only in action, that is, in actual classroom use. And then, it’s not long before teachers start saying things like “Oh, that text didn’t go down particularly well with my students” or “My group couldn’t care less about pop stars”. With the new academic year looming ahead, it looks like a good time to start thinking about your new classes, your present coursebook, and how to match the two by tweaking some elements to your and your students’ tastes.

Generation gap 1: You know the movie star? Chances are, your students won’t

You have a charming Pierce Brosnan smiling at you next to a reading text about James Bond movies. You might find that your students will have a different idea of a heart-throb. With today’s online resources it’s only a matter of a few clicks to revive the personality and put them into a present-day context through Wikipedia or IMDb facts and links. Start off with a topical bit of information or a recent photograph that can spark a discussion about a life event, a controversial topic, or the social issues a celebrity is likely to stand up for. With less advanced groups you can use the photos only: in pairs, one student describes the person in the photo from years ago, the other will do the same with a more recent one. Later, they will show their pictures to each other and find out that they have been describing the same person – with a lot of differences!

There are many various possibilities, but the main thing is to find a way to relate the person to your students’ present reality.

Generation gap 2: You can’t relate to a topic

You’ve never followed the Premier League events. You can’t see how designer brands make a difference. Your worst idea of a holiday is couchsurfing.

It’s very likely that your students will be experts on the topic, so the best thing is to own up. Argue that you don’t see why brands / clothes / having the latest gadgets / etc. are important. You’re sure to instigate a wild classroom debate, especially with the 14-18 age group.

Tom, Dick and Harry

By the very nature of coursebooks, exercises are often riddled with general, “faceless” names. You might want to try and add a little flavour by replacing these with the students in your group. “What time does Ivan get up?” will have a totally new interpretation if Ivan is the regular latecomer in your group! “What would Mr (eg. history teacher) say if he found out that you had copied your homework?” will also shed a new light on typical questions. But even without direct references, any mechanical exercise will benefit from turning fictitious names into flesh-and-blood people. Of course, it is your responsibility to avoid sensitive issues and to maintain the integrity of all people involved.

 “C, final answer”

Multiple choice tasks are prevalent in any ELT material, obviously, for good reasons. But don’t forget that any classic MC task can be turned into a ‘Who Wants to Be a Millionaire’ quiz item to involve groups of students and to increase motivation. There are some great online tools to create your own quiz show. You will have to introduce “cat mode” (ie. multiple lives) if you want to play it with more students or groups of students simultaneously; all students or groups will mark an answer, but those who get it wrong can also play on with a life lost, or, alternatively, by earning no points/”money” for that round. Even more engaging if played with toy money, where culturally acceptable.

Video killed the radio star

ELT materials today tend to cater for the fact that students are brought up in a multi-sensory environment. As a result, these materials make use of visual, auditory and kinaesthetic channels to accommodate different learner types and to make content more memorable. This, in turn, allows us to transform material by “switching off” channels to leave more to the imagination. If you have a listening text, first use the transcript only to let students make guesses about the age, sex, occupation, etc. of the characters. If you have a video, use the audio only and get students to make the same inferences. This may sound time-consuming but will help students focus on the linguistic material to make judgements and to work with the text more intensively.

My test, my learning

It is indeed very appealing and time-saving to print off a ready-made test, but you can make students part of the whole learning process by involving them in test design. Use your review lesson to get groups of learners to write tasks for an ideal test they would be happy to take. This will make them go through the material covered and they will be likely to use the task types found in the coursebook. Collate and correct the tasks, go through some of the items together. The remainder will give you the basis of a test, ideally to be used as it is. When compiling the actual test, give students credit for an extra morale booster. I’ve found that this works especially well with students who need extra support.

Naturally, this is a list of recommendations only, but I hope that these ideas will give you enough inspiration to look forward to a new academic year!


7 Comments

Can informal testing methods be as beneficial as formal ones?

To celebrate the launch of Project Fourth edition, English teacher, Marina Kopilovic, from Serbia writes about how to make testing fun and your students enthusiastic.

Informal methods of testing and assessment are as useful as standardized tests. They are typically based on every day classroom activities to measure the progress of students toward the goals and objectives where students are not aware of being monitored and assessed. These activities are monitored and recorded by the teacher as an observer. They allow teachers to keep track of the progress of their students regularly. Portfolios are great ways of monitoring and assessing the students throughout the entire school year.

Can tests be fun? In order to avoid staleness it would be good to allow your students to do group tests from time to time. They will have to help one another and work together for a group grade. Besides the common benefits tests usually provide, this kind of testing will help your students develop collaboration skills.

Have you ever thought of how to make students projects more than just a decoration on the classroom walls? Have you ever tried a group quiz based on questions extracted from your students’ projects? I will describe something I usually do when I ask them to do a group project outside the classroom. The aim is to test reading and speaking skills and monitor and assess some social skills.

The first step is to be done by the teacher – to display students’ posters all around the classroom and prepare questions in advance. Students are divided into groups of five. Each group is given 15 questions (three per each member on a separate piece of paper). Their first task is to move around the classroom (from one poster to another) to read (scan the text) and find the answers to their questions in 10 minutes. Once they have finished this, they go back to their groups to put their answers together and write them in the order of the questions (1 – 15) that are given on a new piece of paper. Then groups switch papers with their answers for checking, marking and correction – group 2 gets the answers from group 1, group 3 from group 2, and so on until group 1 gets the answers from the last group. Now the quiz can start. Teacher reads the questions and answers aloud, students check, mark and correct. Each correct answer earns one point for the group. It is advisable to use PowerPoint or another kind of visual support at this stage of the class. All the groups are rewarded according to the results they have scored. Teacher will decide how – by marking, giving written certificates, flags indicating their achievements etc. – depending on the age group s/he is teaching and on the level of the task students have to complete. Continue reading