The Big Idea
issue 40 jan / feb 2013

Assessment and Learning

Assessment is part of every teacher’s job. But there’s more to it than just finding out how much learning has taken place. Dr Jonathan Goh provides us with a broader perspective of assessment.

“Why is assessment needed?” asks Jonathan Goh, who is Associate Professor and Associate Dean (Research Support) in the Office of Education Research.

“Knowing how to do it is crucial to helping us know how well we have taught and how well the students have learned in school,” he says. “It is paramount that teachers know how to assess students properly.”

Proper assessment will let teachers have a clear picture of their students’ true abilities and how much they have progressed over time. “There are, however, a lot of issues that teachers need to be aware of,” adds Jonathan.

He guides us through the basics of assessment that every teacher must know.

The Role of Assessment in Learning

If we think of teaching and learning visually as a triangle, made up of curriculum, pedagogy and assessment, it often looks like a lop-sided one, notes Jonathan. This is because assessment is often given less attention than the other two components.

It is paramount that teachers know how to assess students properly.

– Jonathan GohOffice of Education Research

“Part of the reason, I suspect, is that people fear numbers,” he says. “They think of it as statistics. As soon as you mention Means and Standard Deviations, they get really uncomfortable! Well, we need to understand that numbers are just numerical representations of qualitative meanings.”

Assessment does indeed involve statistics. But it’s not all about the numbers, as some teachers may fear.

More importantly, Jonathan asks us to consider these: What is assessment? Why do we need it? And how do we know how much our students have learned based on their test results?

Key Aspects of Assessment

Many people see assessment primarily as a way to evaluate skills or knowledge of our students. Jonathan believes assessment can do more than that.

“For a start, it’s an opportunity for enhancing knowledge and skills through various modes of assessment, for instance, through projects, tests, assignments and presentations.”

He lists the three key issues of assessment that teachers need to think about:

  1. How to plan for assessment
  2. How to develop the test questions or instruments for testing
  3. How to interpret the test results

Planning for assessment

To start things off, teachers should sit down together to draw up a curriculum plan. Almost like drawing up a map, they need to ask themselves what they want to achieve with the assessment.

They then need to align the assessment with the curriculum. Looking at the curriculum, they then decide on the spread of topics and difficulty levels that should be covered, and also what constructs they’re really trying to test. All these would also help them in assessing the validity of their test.

“We can measure almost anything meaningfully” says Jonathan. “We just need to ‘unpack’ what (the variable) we are trying to measure, and ask questions on what we want to measure. In so doing, it will really help us better understand what we are trying to measure.”

Is your test valid?

Test validity is a fundamental to the design of a good test. The three types of validity that teachers should look out for are:

  1. Face validity: “If it’s a Science test, we had better be sure that we have questions related to Science and nothing else!”
  2. Content validity: “Test questions must be in accordance to what we have taught in the curriculum. It is also important to have a good spread of questions across the range of topics taught in class. Teachers need to also take into account of the difficulty levels of the questions asked in tests and exams.
  3. Construct validity: “It is important that our test questions measure the psychological construct we intent to measure. I have come across many examples where the psychological constructs shift.Here is a common one: often, teachers use complicated or bombastic language in a Math problem-solving question. The child may get the answer wrong not because he or she didn’t know the Math but rather, the student was confused by the language used. Are we testing for English language or Math ability?”

Find out more about test validity in “A Good Test” in this issue.

Developing test questions

“Tests questions should not be convoluted,” cautions Jonathan. “We should avoid words that are misleading or vocabulary that the students do not even understand.”

But tests shouldn’t be too easy either.

“You must have sufficient items and they should vary in terms of difficulty levels so that you have a good idea how the child is performing,” he advises. Don’t be afraid to “have questions that are difficult to really ‘stretch’ them”. Only then can you know their true ability.

If we remember that the aim is to evaluate and enhance knowledge, we can develop test questions that enable further learning.

Interpreting the results

When it comes to interpreting results, invariably, the bell curve gets mentioned.

It does serve a purpose, says Jonathan. However, teachers need to understand three basic statistical concepts (Mean, Standard Deviations and Standard Errors) to better understand how their students have performed.

Without a good grasp of these concepts, teachers may erroneously think that students are underperforming when their marks fall below the Mean, or celebrate when the class Mean for a particular subject is 80 out of 100.

Interpretation of test results gets more complicated when we make comparisons, either across time or levels, or between different students.

The scores alone do not tell us the full story. A student who scored 85 marks in Test 1 and then 75 marks in Test 2 may seem to be falling behind. But perhaps Test 2 was much harder than the first test.

Breaking It Down for Assessment

Setting a diverse range of questions with different difficulty levels – that sounds do-able for subjects like Math or Science. But what about assessing, say, English Language essays? Or something even more abstract, such as critical thinking?

“It is important to know what we are measuring. We need to see if you can unpack it (the variable) into its components,” says Jonathan. For an essay, for example, you can look for transitions, for creativity, for language use, and so on. Each component can be allocated a certain number of points out of 100. You can include weights if you feel one component is more important than another.

“When you break it down further, it begins to be more meaningful,” he explains. This is also the approach he would use to assess skills such as critical thinking.

“There are aspects or dimensions of critical thinking that we’re trying to assess. If I were to develop a test of 30 MCQs on critical thinking, I would develop the questions around these aspects or dimensions, and ensuring that there are enough questions for each dimension.”

The Formative Role of Assessment

Grades do matter, especially in high-stakes national exams, but educators also place much emphasis on formative assessment.

“If you think about it, assessment is mainly formative because it’s developmental,” notes Jonathan. “Formative assessment is useful for both teachers and students in modifying their practices to improve learning, often through qualitative feedback.”

Assessment reveals more than how much the students know. “It’s also for us as teachers, how we’re seeing growth and seeing how the students are learning the concepts we’re teaching.”

Assessment benefits not just students. It’s also an opportunity for teachers to improve on their own pedagogies.

“We may look at the students’ performances and reflect on how we teach. Then we adjust accordingly to make sure that these concepts are well understood by the students.”

Formative assessment is useful for both teachers and students in modifying their practices to improve learning, often through qualitative feedback.

– Jonathan on why formative assessment is needed

With the focus shifting towards 21st century competencies, the challenge for teachers today is not just to impart knowledge, but to create opportunities for students to show how well they have understood the concepts.

This may require teachers to create assessments that simulate real-life situations so that students can demonstrate learning through application.

Seen in this broader perspective, assessment can be formative for both students and teachers. Jonathan certainly thinks so.

“If teachers can see assessment as part of the whole teaching–learning process and continue to improve their assessment practices, it would certainly take our education system to new heights and the teachers to a new level of professionalism.”

Never Miss A Story