Showing posts with label Jan 2022. Show all posts
Showing posts with label Jan 2022. Show all posts

Editorial Note

Trust is an essential component of an effective functioning society. At the macro level, we trust the judicial system to mete out fair justice to criminal perpetrators. At the micro level, we trust in the integrity of other individuals whenever we purchase a product. In education, we place trust in the pedagogical efficacies of teachers and the curriculum knowledge of specialists. It is no different in the assessments that are administered. We trust that national examinations are successful in student placements and that the formative assessments we design would be able to sieve out learning difficulties of students. Certainly, regardless of purpose and design, the effectiveness of an assessment is proportional to the amount of trust that assessors and stakeholders place in it.

This issue will explore the roles and impact of trust in assessments. It begins in the Focus section where trust in both summative and formative assessments are examined. The impacts of (dis)trust in these assessments as well as approaches to enhance trust are gleaned from literature to provide the reader with a concise view of these issues. Following that, Dr Jessica To discusses the role of trust in feedback engagement. Strategies that can develop communication and competence trust in feedback processes are suggested for educators.

In the Featured section, we present how teachers’ and students’ trust in assessment can produce results. Shynn Lim and Maybellina Lim reflect how the social-emotional competencies of students in Juying Secondary School are enhanced through dialogic feedback and meaningful talk. They share the means in which teachers leverage on a social-emotional assessment tool (SEC Inventory) to increase the effectiveness of the approach. Next, a team of senior teachers in chemistry from five different schools illustrate how they co-designed a peer review workshop to enable student feedback literacy. Steven Wong, David Loh, Yew Kai Long, Tan Keng Hsin and Loy Hui Chun describe the provision of peer feedback in their chemistry lessons and how it has impacted students. Finally, a team of teachers from Riverside Secondary School share an ongoing science assessment journey undertaken by the school to develop students’ independence in learning. Fung Eng Chu, Tan Xing Yu, Tan Thiam Soon and Lee Min Huey elaborate on the various approaches that were implemented. When teachers and students trust the value of their assessments, change will ensue and learner outcomes will follow.

Can we trust students to shape education positively? In the Noteworthy Assignments section, a team of participants in the Leaders in Education program believe that tapping into student voice has the potential to amplify learning. Benjamin Quek, Ho Hil May, Leow Yen Ming, Martin Chan, and Nurazian Bajuri share an online platform in which they advocate for entrusting student voice. Next, Suja and Xinlin from the MTeach program examines their own AFL practices for primary one students. To conclude for this section, Han Zi Rui from the Management and Leadership in Schools program reflects on changing perceptions of assessment in schools.

In this issue, we are happy to be able to interview two of our long-time editorial board members, Sheree Kuek and Dr Rachel Goh as they share their personal assessment journeys. Sheree is currently the principal of Choa Chu Kang Primary School whilst Rachel is a teaching fellow in NIE who will be rejoining MOE/ELIS in 2022. Their involvement in the bulletin has undoubtedly enriched our dialogues and we leave it to the reader to read through the conversations in the News section. At the same time, we would also like to take this opportunity to welcome two new editorial board members into our executive committee: Lee Peck Ping and Devi Durka. Peck Ping is the current principal of Edgefield Secondary School and Devi will be joining the National Institute of Education as a Teaching Fellow. We will get to know more about them in the later issues of the bulletin.

Last, we are interested in involving you, our readers, to connect with us in discussing matters raised in this issue. Do join us at our post-publication conversation on 18 March 2022 (Friday), 3pm-4pm. If you are interested in joining us, please click here to register.

With that, I leave you to enjoy this issue.

 

Cheers,

Kah Loong

 

 

Trusting Assessments in Schools

by Chue Kah Loong, NIE

Assessment in education covers a wide field of different topics. Researchers expound on the benefits of formative assessment and explore the intricacies of feedback models. At the same time, other researchers investigate ways to tighten the rigor on summative assessments and debate the merits of standardised assessments. Regardless of the research areas involved, one underlying aim of these studies is the endeavour for more effective assessment practices. Yet, many of these studies tend to neglect one foundational mechanism that drives the efficacy of these practices. This mechanism is trust.

One of the most often cited definition of trust in literature is provided by Mayer et al. (1995), who proposed that trust is “the willingness of a party to be vulnerable to the actions of another party based on the expectation that the other will perform a particular action important to the trustor, irrespective of the ability to monitor or control that other part”. In the context of assessment, this implies that an individual has made a choice to take the risk of being evaluated by another party of individuals. This other party may be people involved in an assessment system (e.g. summative assessments) or people that have direct contact with the individual (e.g. teacher-student or student-student).

The impact of (dis)trust in school assessments

High levels of trust tend to increase efficiency by reducing costs and increasing output (Pierre & Rothstein, 2016). In this instance, high levels of trust in assessment may increase positive student outcomes and reduce efforts invested by students, teachers or school administrators. But what does it mean to trust assessment? Researchers have suggested that this refers to having confidence that:

  • the assessment is developed and administered in a professional manner (Carless, 2009; Hoey & Nault, 2002)
  • appropriate actions are taken with respect to the data generated (Hoey & Nault, 2002; Leighton & Bustos Gómez, 2018)

These two aspects of trust stretch across all forms of assessments that are conducted in schools. In summative assessments (e.g. end of year examinations, portfolios), knowledge and skills assessed need to be representative of their learning and pegged at an appropriate level of difficulty. Data generated from the results aid in determining whether the student is sufficiently competent for advancement or evaluating the effectiveness of instructional programs. In formative assessments (e.g. probing questions, homework, peer assessments), teachers need to provide feedback in a manner so that students can benefit from the feedback. Data from formative assessments are usually solely evaluated by the teacher and provide the necessary information to adjust teaching and learning processes.

Low levels of trust in assessments are likely to result in negative outcomes. Specifically, a distrust in assessments may be reflected in lower student motivation and lower risk-taking behaviours (Hoey & Nault, 2002; Knight, 2002; Carless, 2009). Table 1 illustrates some examples of sources of distrust that may cause such outcomes.

Table 1

Sources of distrust in assessments

Motivational issues can arise from assessment tasks that are consistently set at a higher difficulty level than what was expected in the curriculum or assessment scores that are consistently biased (Finn, 2015). Whilst it may seem reasonable to set a few difficult questions in each assessment task to differentiate students’ ability levels, teachers may want to consider the students’ perceptions of the interpretations of the assessment scores. If there are a number of difficult questions, students may perceive that the scores are norm-referenced (i.e. to rank the students) instead of criterion-referenced (i.e. to assess achievement level). This may run counter to the aim of getting students to learn from their errors and work towards mastery of the subject. Lower motivation

Assessment scores that are consistently biased may occur in subjects where there are higher levels of subjectivity in the grading. Many of these subjects would doubtless use essays as a means to assess higher order thought processes, but marking essays are extremely susceptible to many forms on inconsistencies (Fleming, 1999), such as differing expectations between teachers or sub-conscious biasness within a teacher. The lack of trust in the above two instances is often surfaced through maladaptive behaviours as students may deem it futile to prepare for the assessment and focus their efforts elsewhere.

Lower risk-taking

Teachers and students may end up taking less “risk” when inappropriate actions or decisions are made with regards to the information gathered from assessments (Winstone & Carless, 2021). When designing assessment tasks or setting examination questions, teachers need to be certain that the data collected from the assessment would have no adverse impact on themselves. For example, if students’ grades were used as a gauge of teacher performance, teachers may fear appearing incompetent in the eyes of their colleagues or to the school management. Working under such fear-based environments may cause teachers to set “safe” questions instead of meaningful questions to assess learning. At the same time, teachers may end up using a surface learning approach in their lessons, that is getting students to memorize answers for the assessments, instead of focusing on understanding and application (Knight, 2002).

For formative assessments to be effective, students have to take the risk of appearing incompetent by divulging any misconceptions to teachers or their peers (Carless, 2009). When the subsequent actions of the teacher do not match the interpretations of the data obtained, this will likely result in students discounting any form of feedback. Students may end up ‘faking good’ (Carless, 2009), that is to say presenting themselves as knowing more than their actual ability. Teachers may want to consider that the trustworthiness of their actions is dependent on perceptions of competency and integrity (Davis & Dargusch, 2015). Students need to be confident that teachers or peers have a minimum level of disciplinary knowledge and have acted in their best interests.

Enhancing trust in school assessments

Two possible strategies to minimize the negative impact of distrust and that can be implemented by teachers are outlined here, namely creating transparency in the assessment process and facilitating collaboration between teachers and students. Nonetheless, educators should be aware that building trust is not a once-off process, but a continuous process.

First, transparency breeds trust (Carless, 2009). Communicating to students (and parents) the thoughts behind certain assessment processes not only develops trust, it also helps students in pinpointing their weaknesses and setting goals for improvement. For example, teachers could share with students how items in an examination are calibrated to assess different levels of cognitive learning, thus providing students with confidence that the examinations are set at a fair level of difficulty. Furthermore, teachers could communicate the marking process to students, such as the allocation of marks or interpretations of rubrics. This could identify the limitations in students’ work and may give a clearer picture of the performance levels required to excel.

Furthermore, significant changes to the assessment system or processes are additional arguments for transparency. Modifications to summative assessments can occur with the inclusion of addition elements such as performance assessments or portfolios. Likewise, modifications to formative assessments can occur with the employment of new teachers or new technological tools. Change in any system causes instability and tends to erode trust (Carless, 2009). A buffer to the erosion usually begins with openness and honesty on the changes.

Second, collaboration generates trust (Hoey & Nault, 2002). Collaborative activities tend to foster trust in two ways: it provides opportunities for people to interact and build relationships and it creates a sense of shared responsibility (Kochanek, 2005). Teachers can work with other teachers to design assessment tasks. Teachers can also collaborate with students to facilitate formative assessment and feedback activities. For example, Leighton and Bustos Gómez (2018) proposed establishing a pedagogical alliance between students and teachers, that uses explicit verbal communication strategies, to enhance formative assessments. Winstone and Carless (2021) discussed the rise of the “student voice” and suggested that students be assigned active roles in feedback practices.

Conclusion

In summary, trusting assessments is paramount for any school. Low levels of trust tend to be detrimental to student outcomes and steps may need to be taken to increase confidence in assessment. Hopefully, this piece will serve as a spark for discussion for future conversations.

References

Carless, D. (2009). Trust, distrust and their impact on assessment reform. Assessment & Evaluation in Higher Education, 34(1), 79-89.

Davis, S. E., & Dargusch, J. M. (2015). Feedback, iterative processing and academic trust-teacher education students' perceptions of assessment feedback. Australian Journal of Teacher Education (Online), 40(1), 177-191.

Finn, B. (2015). Measuring motivation in low‐stakes assessments. ETS Research Report Series, 2015(2), 1-17.

Fleming, N. D. (1999). Biases in marking students’ written work: quality. Assessment matters in higher education: choosing and using diverse approaches, 83-92.

Hoey, J., & Nault, E. (2002). Trust: The missing ingredient in assessment. International Journal of Engineering Education, 18(2), 117-127.

Knight, P. T. (2002). Summative assessment in higher education: practices in disarray. Studies in Higher Education, 27(3), 275-286.

Kochanek, J. R. (2005). Building trust for better schools: Research-based practices. Corwin Press.

Leighton, J. P., & Bustos Gómez, M. C. (2018). A pedagogical alliance for trust, wellbeing and the identification of errors for learning and formative assessment. Educational Psychology, 38(3), 381-406.

Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995). An integrative model of organizational trust. Academy of Management Review, 20(3), 709-734.

Pierre, J., & Rothstein, B. (2016). Reinventing Weber: The Role of Institutions in Creating Social Trust. The Ashgate Research Companion to New Public Management, 421–432.

Winstone, N. E., & Carless, D. (2021). Who is feedback for? The influence of accountability and quality assurance agendas on the enactment of feedback processes. Assessment in Education: Principles, Policy & Practice, 1-18.

 

 

 

Coherence in Science Assessment Literacy

 by Fung Eng Chu , Riverside Secondary School
     Tan Xing Yu, Riverside Secondary School
     Tan Thiam Soo, Riverside Secondary School
     Lee Min Huey, Riverside Secondary School


Assessment has been our main focus during our professional development (called light house sessions) and Science Department meetings. In 2020, the lighthouse sessions helped deepen our understanding of what assessment can do for learning. Our journey on assessment continues in 2021 in various ways, with a common department goal of making students more independent in learning through focusing on process-level feedback.

This is a pivotal change which requires a lot of effort, from reviewing the existing assessment task to revising feedback comments. Despite the hard work, the teachers see the value of such change. This is a quote given by a Science teacher:

“I see more value in trying to start working on our feedback with the purpose of enabling our learners to attain the process level. Through the sessions, I see that there is a link between a well-crafted question and how I can enhance the effectiveness of our feedback in helping our learners to attain, at least, the process level."

Due to the emerging demands for ICT skills and abilities to manage students with different learning needs, teachers have to attend courses such as e-pedagogy, differentiated instruction and blended learning. Often, teachers view these courses in isolation.  Hence, it is essential to continue the dialogue with teachers and reiterate the focus of assessment to support and serve the learning needs of students in all our teaching approaches. The following are examples of using assessment to support students towards process level outcomes in Science.

The implementation of a new Lower Secondary Science syllabus provides an opportunity for us to leverage the integrative activity created by Science CPDD to assess students differently using rubrics. Our Science teacher, Xing Yu, will elaborate more on using rubrics to encourage self and peer assessment in Secondary one Science this year.

On top of that, the emerging use of ICT tools/platforms such as Students Learning Space (SLS) allows teachers to reconsider the roles of technology in designing meaningful assessment tasks, which will be shared in detail later by our Physics teacher, Thiam Soon.

To give helpful process level feedback, teachers have to be skillful in designing learning tasks that can help to identify specific learning gaps from students’ answers. Min Huey will share her own experience in the last segment of this article.

Using rubrics in science assessment – Xing Yu

After completing several science topics, we wanted to allow students to apply their learning across different topics on an authentic task. We leveraged on the integrative activity designed by CPDD in activity book 1A. The students were required to write a proposal stating their plans, experimental procedures and evaluation of their plans in water purification.

We developed rubrics to assess students’ application of their learning on the given task. The main aim of our rubrics was to provide the students with guidance on what is expected and to encourage them to be more self-directed in striving for the best. We hope students will take the initiative to improve their plans by self-evaluating using the rubrics. Annex 1.1  shows parts of our first draft of the rubrics. Through our PD sharing and discussion, we realised that we may not achieve our objective with this set of rubrics. For example, big words like "scientifically sound" may not be understood by the students. To improve our rubrics, we refer to the example given by Tan, Salim & Manimala (2020) on how the teachers crafted their rubrics by including positive criterion specific examples. The teachers included descriptions in their rubrics to showcase what they meant by “apt and precise” vocabulary and “conveying messages in a compelling manner” in writings. Taking ideas from Tan (2020), we decided to unpack the term "scientifically sound" using an example from a scenario whereby students are required to separate a mixture containing soluble and insoluble solids. 

Annex1.2 shows how we unpacked the terms by giving examples of the steps required for the separation, classified into different levels of attainment. We also included comments on the strengths or weaknesses of the examples given. This approach not only gave the students an idea of what is “scientifically sound”, it also prompted us to think through what exactly  we are expecting for  each level of attainment. Two concerns with having a detailed rubric like this are that we need to spend more time creating the rubrics and the students may be overwhelmed by the amount of information presented. To make the work more manageable, we decided to unpack only one criterion, which is harder to comprehend. For the students, we broke down the rubric into two parts, giving only necessary information for the project at that moment. Part one consist of the criteria for planning and peer evaluation while part two consist of the criteria for conducting the investigation, concluding and evaluating their project.

We felt that the detailed rubrics had guided the students well in planning their investigation. The majority of the groups provided sound procedures although they have different foci for their investigation. The rubrics reminded students to give illustrations to complement their procedures. To score in creativity, students created diagrams to match the plans that they came out with instead of using readily available images. Annex1.3 gives an example of work produced by students.

Rubrics are useful tools for assessing tasks that allow students to produce a wide variety of work. To encourage students to be more independent in learning through rubrics, we must be mindful of providing age-appropriate content with examples when necessary. Doing so also helps us to be more precise about what we are expecting.

Technology-enabled Feedback - Thiam Soon

With technology so pervasive in our lives, we would naturally tend to explore how it could supplement the learning experience of our students. Technology can enhance learning by providing a different platform for teachers to assess the students' learning.

I focused on two main Key Applications of Technology (KAT) of e-pedagogy outlined in my science class: “Support Assessment for Learning” and “Facilitate Learning Together”. The learning topic was on the Kinetic Model of Matter in Physics.

In “Support Assessment for Learning”, the Student Learning Space (SLS) was used to get students to respond to the questions via the Interactive Thinking Tool (ITT). Students were given some time to submit their responses online, and then the teacher reviewed and commented on their responses verbally in class, thus providing feedback to the students.

In "Facilitate Learning Together", the students also used the ITT in the SLS, but this time instead of the teacher actively reviewing and providing feedback for learning, the students were tasked to evaluate their peer's works and give feedback on them. The teacher's role was to facilitate, guide and monitor the students in the peer review exercise. It was hoped that this would be a positive step forward in getting students to be more self-directed and take charge of their learning.

The diagram below shows how we focused on giving feedback to improve students’ answers instead of responding to the question using ITT in SLS.

For more details, click on the link here to access the full article.

Process-level feedback – Min Huey

In the teaching of Biology, many students struggle with answering lengthy and complicated application questions. Students' struggle was often masked under a myriad of other problems, such as the inability to unpack the information given in application questions and weak mastery of content knowledge. The use of process-level feedback will help the teacher to identify learning gaps clearly and provide targeted feedback. Hence, allowing students to reflect upon their work, improve the skills needed to attempt future application questions and attain subject mastery.

Process-level feedback gives students targeted feedback to improve their mastery of the processes involved in attempting a question to show conceptual understanding (Hattie & Timperley, 2007). This will help students attain subject mastery and transferrable skills beyond the initial task (Goh, 2021). To give effective process-level feedback, the teacher has to consider the learner's profile, and craft assessment tasks that allow targeted feedback to help students close the learning gap. The design of an assessment task can involve a variety of ways of collecting evidence of students’ learning, such as drawing and writing in prose. 

In the full article here, I will elaborate on how I have changed my correction process and redesigned the assessment task during corrections to give process-level feedback. After marking the assessment task, I noticed three learning gaps and addressed them by changing the correction process. The assessment task was redesigned and used for corrections. The new correction process allowed me to give process-level feedback that targeted the learning gaps (shown in the table below). 

In summary, complicated and lengthy Biology application questions can be unpacked to

●      make students’ thinking visible (being intentional with the questions that help to scaffold students’ thinking)

●      allow for targeted feedback (breaking down one long lengthy question into many small targeted questions)

●      enable students to express their understanding through drawings (to help students who struggle with expressing their answers in prose)

 

 


In conversation with Ms Sheree Kuek, Principal, Choa Chu Kang Primary School

 


Could you share with us a little about your background?

Prior to my appointment as Principal of CCKPS, I was HOD/Humanities, SSD and subsequently VP at Regent Secondary School. Following my LEP, I was posted as VP to Yishun Secondary for a year and eventually appointed as Principal of CCKPS in December 2017.

How did you get interested in assessment?

I attended an assessment seminar in 2011 and heard Prof Kelvin Tan share his thoughts on assessment for learning. It was indeed eye-opening and from then on, I started to re-discover assessment as a motivating force which could change the culture of learning.

Is there one memorable event in your assessment journey that you would like to share?

My first experience as a new Principal observing a Primary 2 class was most memorable. It was a ‘Show and Tell’ assessment session. As part of creative assessment, we had provided our eager-eyed little ones with a set of rubrics to peer assess their friends. There were 3 criteria:

(i)    My friend made eye contact with the audience.

(ii)   My friend spoke loudly and clearly.

(iii)  My friend had an interesting presentation.

The peers were instructed to award either a ‘big thumbs up’, a ‘smiling face’, or a ‘face with no smile’ to each friend. They seemed satisfied enough with their assessment of their peers…until the paper was returned to the peer. A few peers were pleased with their friend’s assessment. However, I overheard a few shy comments like ‘I want you to be happy so I only gave you a big thumbs up!’ At the corner, one pair got into an argument. Student A was displeased with Student B who had awarded him a ‘face with no smile’ for the third criteria. In an attempt to appease her friend, Student B quickly amended her assessment to a ‘smiling face’.  

In my follow-up conversation with these 8-year-olds, they were candid in sharing their dislike for this exercise. These were some of their thoughts:

‘My friend got angry with me because I did not give a smiling face. This was hard because I like my friend very much.’
‘It was very hard to use because I don’t know what is interesting and what is not interesting.’
‘I think my friend did not make eye contact but he insisted that he did.’
‘I did not want to change the face, but I think my friend hates me now.’

It was a sobering moment for me. I realised that these were emotional moments for the young learners. Any mode of assessment, even at its most creative, with the best of intentions, evokes deep emotional reactions from our children. How much of this does the adult truly understand?

I vowed to myself that I will look into critical issues which affect the child’s learning, and invest time to go into the children’s world, to understand learning through their eyes. That day, I learnt that the joy of learning can only take place if our feedback evokes a positive emotional response in the child.

What is one piece of advice you would like to give to teachers starting on their assessment journey?

Assessment must give hope to the child. Assessment feedback is not a tactical issue for any child - it is emotional, and, as teachers, we can make the difference. Let us be bold to do only what is purposeful and meaningful, and what encourages the child’s heart. May your work be fueled by a deep conviction that every child can learn. We, teachers, hold the key.

 

 

In Conversation with Dr Rachel Goh

 


What prompted/persuaded you to join NIE as a teaching fellow four years ago?

As a newly-minted doctoral graduate, the opportunity to work in a higher education context was a godsend. My original intent was to apply the learning from my doctoral research in facilitating teacher professional development in the context of lesson study. The opportunity to work with NIE faculty enabled me to build my curriculum and assessment expertise and participate in cutting-edge research on assessment feedback in schools, which far exceeded my expectations. 

What were the incidents or experiences that have impacted you the most?

The incidents that have impacted me the most revolved around my interactions with struggling students in the higher degree programme, many of whom were trying to cope with the academic demands as well as manage challenges at work and transitions at home. In sitting beside my students to work out the learning issues with them, I found myself developing greater empathy for learners and being more cognisant of the assessment theory-practice nexus at work. 

How has your philosophy and your pedagogy in assessment changed?

My pedagogy in assessment has become less teacher-directed and more student-driven over the course of time, shaped largely by a deepening belief in the importance of fostering student voice and developing self-regulation. This philosophy informed by my research experience fuelled changes I made in involving students in assessment by way of co-constructing rubrics, having students make feedback requests, peer- and self-assess.

What would be your proudest achievement?

My proudest achievement would be the publication of the book ‘Designing quality assessment feedback in schools’ which I had worked on with middle leaders from the MLS assessment feedback elective and teachers from schools. This book project would not have been possible if not for the encouragement from my mentors, A/P Kelvin Tan and Dr Tay Hui Yong, who also gave invaluable feedback on the manuscript.

What is one thing you would say is most vital for assessment to meet the needs of all learners?

For assessment to meet the needs of all learners, one thing that is vital is to reframe what is deemed as a measure of success. Valuing students’ personal best where we compare their current performance to their past performances places a primacy upon the learners’ individual progress and development. The shift in emphasis can counter the pressures of normative comparison and ensure that intended learning outcomes are achieved by each and every single learner under our care, including those struggling to learn.

What are your future plans for, and with, assessment?

I hope to promote teacher inquiry into assessment practices in schools to challenge ourselves to ensure that all learners benefit adequately from assessment. 

 

 


Entrusting student voice: A learning package

by Benjamin Quek, Ho Hil May, Leow Yen Ming, Martin Chan and Nurazian Bajuri

A learning package was created in the Leaders in Education Program by Benjamin Quek, Ho Hil May, Leow Yen Ming, Martin Chan, and Nurazian Bajuri. The package provides many ideas for student involvement in learning and assessment, and advocates for student voice to be entrusted in our pedagogies and paradigms. This online platform consolidates findings both locally and globally into applicable bite-size strategies for educators to practice in classrooms, as well as resources for embedding student voice in assessment feedback practices.

Link to webpage: https://sites.google.com/moe.edu.sg/entrusting-student-voice/home

 Quek, B., Ho, H.M., Leow, Y.M., Chan, M., & Bajuri, N. (2021). Entrusting Student Voice: A Learning Package. Sites.google.com. Retrieved from https://sites.google.com/moe.edu.sg/entrusting-student-voice/home.

 

 

AFL practice @ Primary One

by Suja and Xinlin

A mock podcast was created in the MTeach module by Suja and Xinlin. The podcast examines the AFL practices in Primary One and shares some resources that teachers can use for Show and Tell.

Link to podcast:

https://video.nie.edu.sg/media/AFL+PRACTICE_MTC901_Suja_Candy/0_msjq4cw2

 

Drawings and Scribbles on Assessment

 








Recommended Publications

 

Chappuis, S., Brookhart, S. M., & Chappuis, J. (2021). Ten assessment literacy goals for school leaders. SAGE.

This book provides practical content for school leaders. It covers ten key topics, including understanding the characteristics of a comprehensive and balanced assessment system, standards of quality, formative assessment practices, grading practices, communication and ethical use of assessment. The companion website includes a list of activities and definitions for the respective chapter. Overall, it is envisioned that the ten goals, when acted on, can contribute to assessment literacy at the individual and/or system level.

Relevance: Assessment literacy has been identified by MOE as one of the six areas of practice in SkillsFuture for Educators. This book is a useful resource for educators who wish to deepen their understanding on assessment literacy.

 

Winstone, N. E., & Carless, D. (2021). Who is feedback for? The influence of accountability and quality assurance agendas on the enactment of feedback processes. 

https://doi.org/10.1080/0969594X.2021.1926221

This paper highlights the importance of purpose in assessment feedback. The data demonstrated that educators often experienced professional dissonance where perceived quality assurance requirements conflicted with their own beliefs about the centrality of student learning in feedback processes. Such dissonance arose from the pressure to secure student satisfaction, and avoid complaints. Quality enhancement of feedback processes could profitably focus less on teacher inputs and more on evidence of student response to feedback.

Relevance: Most teachers conduct formative assessments in their classrooms. This paper describes how one can enact formative assessment to improve student learning rather than to satisfy department indicators or student satisfaction.

 

Jönsson, A., Balan, A., & Hartell, E. (2021). Analytic or holistic? A study about how to increase the agreement in teachers’ grading. 

https://doi.org/10.1080/0969594X.2021.1884041

This paper describes a study conducted in Sweden to increase agreement in teachers’ grading by comparing analytic and holistic grading. Findings suggest that analytic grading is preferable to holistic grading in terms of agreement among teachers. However, teachers in the holistic conditions provided more references to criteria in their justifications, whereas teachers in the analytic conditions to a much larger extent made references to grade levels without specifying criteria. The author emphasised on the inclusion of moderation where teachers could review each other’s grading.

Relevance: Educators need to standardise grading so that assessment is reliable, especially so for assessments that require rubrics. This paper describes differences between holistic and analytical rubrics that could occur during the assessment process.

 

Yan, Z., Li, Z., Panadero, E., Yang, M., Yang, L., & Lao, H. (2021). A systematic review on factors influencing teachers’ intentions and implementations regarding formative assessment. 

https://doi.org/10.1080/0969594X.2021.1884042

This article reviewed 52 studies to identify factors that influence teachers’ intentions and implementations regarding formative assessment. The factors were categorised into personal (e.g. self-efficacy, education and training) and contextual factors (e.g. external policies).

Relevance: Formative assessment is prevalent in local schools. When educators and policy makers implement formative assessment, they would need to be aware of any factors that may aid or hinder its implementation. This article synthesizes these factors for evaluation.

 

Rasooli, A., Razmjoee, M., Cumming, J., Dickson, E., & Webster, A. (2021). Conceptualising a Fairness Framework for Assessment Adjusted Practices for Students with Disability: An Empirical Study.

https://doi.org/10.1080/0969594X.2021.1932736

This paper describes a study that leverages on the multiple perspectives of secondary school students with disability, their teachers, and parents to build a multi-dimensional framework of fairness for assessment adjusted practices. The framework included interactions across elements of assessment practices, socio-emotional environment, overall conceptions of fairness, and contextual barriers and facilitators. The interactions across these elements influence the learning opportunities and academic outcomes for students with disability.

Relevance: With an increasing emphasis on inclusive education, teachers may be struggling with adapting assessment practices to students with special needs. This study provides some resources on which teachers can adjust their assessment practices to be fair for all students.

 

Gorgodze, S., & Chakhaia, L. (2021). The uses and misuses of centralised high stakes examinations-Assessment Policy and Practice in Georgia. 

https://doi.org/10.1080/0969594X.2021.1900775

Trust in centralised high-stakes exams in Georgia has grown since 2005. This article describes how these centralised high-stakes assessments have become an integral part of the education system, cites available evidence on their impact, accounts for recent changes, and argues that overreliance on centralised high-stakes exams is due to complex educational, political and social processes that make it difficult to transform the system.

Relevance: High stakes national examinations are ingrained within the Singapore education system. There are constant reviews to improve and/or de-emphasise the reliance of these exams locally. This paper analyses the impact and challenges of these examinations in Georgia. Educators and policy makers may want to examine the changes in Georgia to learn from their journey.

 

 

 

Courses and Seminar

Assessment For All Learners Conversation

Date: 18 March 2022 (Friday)
Time: 3-4pm

Interested to give your views about 'Assessment Fit for Learners'? Have questions for our contributors? Join our upcoming seminar via Zoom! You can indicate your interest here. Details will be sent out to registered participants nearer the date.

Certificate in Educational Assessment

This certificate programme is a collaborative effort between NIE and MOE. It seeks to provide participants with a strong grounding in both the theories and methods of assessment in order that they can conceptualise and review assessment practices. Please click here for more information.