Showing posts with label Publications. Show all posts
Showing posts with label Publications. Show all posts

Recommended Publications

Please refer to below for some new assessment publications that we would like to bring to your attention:

Boud, D. & Dawson, P. (2021) What feedback literate teachers do: an empirically-derived competency framework, Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2021.1910928

If feedback is to be conducted effectively, then there needs to be clarity about what is involved and what is necessary for teachers to be able to undertake it well. While much attention has recently been devoted to student feedback literacy, less has been given to what is required of teaching staff in their various roles in feedback processes. This paper seeks to elucidate teacher feedback literacy through an analysis of the accounts of those who do feedback well. An inductive analysis was undertaken of conversations about feedback with 62 university teachers from five Australian universities using a dataset of transcripts of interviews and focus groups from two earlier research studies. Through an iterative process a teacher feedback literacy competency framework was developed which represents the competencies required of university teachers able to design and enact effective feedback processes. The paper discusses the different competencies required of those with different levels of responsibility, from overall course design to commenting on students’ work. It concludes by considering implications for the professional development of university teachers in the area of feedback.

Chan, K.T., Tan, K. How teachers experience assessment tension and its effect on formative assessment practices. Educ Res Policy Prac (2022). https://doi.org/10.1007/s10671-022-09316-1

Formative assessment (FA) has been a popular discourse in education, but its potential benefit is fundamentally dependent on teachers’ willingness to make changes to their classroom practices. These changes bring about much assessment tension (AT). This paper argues that how well teachers experience and manage AT determines the efficacy of their FA practices. Past studies have warned that AT experienced by teachers is complex and problematic. Therefore, it would be useful to investigate the variation of AT experienced by teachers, and how well they are dealing with these tensions. This phenomenographic research examines the use of FA in the context of different ways that AT is experienced. Findings on teachers’ conceptions of AT are presented, and each is then discussed for insights into teachers’ meanings and practices of assessment. In particular, instances of how AT hindered or helped FA are identified to highlight more productive ways of understanding and using assessment to support students’ learning. Implications of the research findings for the Singapore Teaching Practice (STP) will be discussed.

Tan, K.H.K. (2022). Assessment Reforms in Singapore. In Lee, Y.J. (Ed.), Education in Singapore: People making and Nation building (pp. 243-260). Singapore : Springer.

The education system in Singapore has been transformed since its independence from colonial British rule in 1965. Reforms have occurred in four distinct phases: the survival phase; the efficiency phase; the ability-driven phase, and currently its values driven and student centredness phase. Each phase of education has been supported and driven by corresponding assessment reform. In the past few years, there has been a distinct effort to shift assessment purposes and discourse away from high stakes testing for placement and stratification, towards using assessment to signal and support learning within and beyond schools. Three assessment reforms are examined in this chapter – the reduction in emphasis on examinations in primary schools in 2008, the shift away from norm referenced assessment in the high stakes national examination for primary students (announced in 2016), and the changes to assessment and streaming in secondary schools announced in 2018. These reforms demonstrate the tight alignment between policy making and school implementation, and offers insights into the complexities in grappling with tensions between maintaining rigour and control in high stakes summative assessment against transparency of assessment standards for use in formative assessment in schools.

Tay, H.Y., Lam, K.W.L. Students’ engagement across a typology of teacher feedback practices. Educ Res Policy Prac (2022). https://doi.org/10.1007/s10671-022-09315-2

The provision of feedback is widely practised as part of formative assessment. However, studies that examine the impact of feedback are usually from the teachers’ perspective, focusing on why and how they provide feedback. Fewer studies examine feedback from the students’ perspective, especially in the way they experience, make sense of and take up their teachers’ feedback. This paper provides empirical evidence of student engagement with different patterns of teacher feedback in their written essays. Data were gathered from 45 students (from 5 different schools) through group interviews and analysis of student artefacts from three rounds of writing tasks. The findings on affective, behavioural and cognitive engagement surfaced the conditions that will contribute to students’ will and skill to act on their teachers’ feedback. The implications on both teacher and student assessment literacy are discussed. The discussion will provide professional development providers and policy makers with new perspectives of and approaches to strengthening formative assessment practices in ways that are more cognizant of students’ experience of feedback.

Panadero, E., & Lipnevich, A.. (2021). A review of feedback typologies and models: Towards an integrative model of feedback elements. Educational Research Review. 35. 100416. 10.1016/j.edurev.2021.100416. 

A number of models has been proposed to describe various types of feedback along with mechanisms through which feedback may improve student performance and learning. We selected fourteen most prominent models, which we discussed in two complementary reviews. In the first part (Lipnevich & Panadero, 2021) we described the models, feedback definitions, and the empirical evidence supporting them, whereas in the present publication, we analyzed and compared the fourteen models with the goal to classify and integrate shared elements into a new comprehensive model. As a result of our synthesis, we offered an expanded typology of feedback and a classification of models into five thematic areas: descriptive, internal processing, interactional, pedagogical, and students characteristics. We concluded with an Integrative Model of Feedback Elements that includes five components: Message, Implementation, Student, Context, and Agents (MISCA). We described each element and relations among them, offering future directions for theory and practice.

Carless, D., & Winstone, N. (2020) Teacher feedback literacy and its interplay with student feedback literacy, Teaching in Higher Education, DOI: 10.1080/13562517.2020.1782372 

Feedback processes are difficult to manage, and the accumulated frustrations of teachers and students inhibit the learning potential of feedback. In this conceptual paper, challenges to the development of effective feedback processes are reviewed and a new framework for teacher feedback literacy is proposed. The framework comprises three dimensions: a design dimension focuses on designing feedback processes for student uptake and enabling student evaluative judgment; a relational dimension represents the interpersonal side of feedback exchanges; and a pragmatic dimension addresses how teachers manage the compromises inherent in disciplinary and institutional feedback practices. Implications discuss the need for partnership approaches to feedback predicated on shared responsibilities between teachers and students, and the interplay between teacher and student feedback literacy. Key recommendations for practice are suggested within the design, relational and pragmatic dimensions. Avenues for further research are proposed, including how teacher and student feedback literacy might be developed in tandem.

Sadler, I., Reimann, N., & Sambell, K. (2022) Feedforward practices: a systematic review of the literature, Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2073434

The notion of ‘feedforward’ has emerged as popular with practitioners, and there has been an upsurge in publications which include this term. This interpretivist and conceptual systematic review sought to consider the different forms of educational practices that are framed in relation to feedforward. The initial search of four electronic databases found 1076 articles published between 2007 and 2019, which were reduced to 68 once duplicates had been removed and exclusion/inclusion criteria applied during screening and eligibility procedures. An iterative meta-ethnographic approach to analysis resulted in the identification of five main practices, framed as feedforward. These were: alignment and timing (41%); use (25%); comments (18%); self-review (9%); and teaching (7%). The vast majority involved a process where student improvement was a key goal, but the design of this process differed between practices. A large proportion supported improvement from one task to the next, almost exclusively within the ‘future horizon’ of the module/study unit, while only a small proportion of articles focuses on improving the amount, nature or quality of the information delivered to learners. Evidence of student sense-making and uptake was rarely sought, and few practices offered genuine opportunities for student agency, self-regulation and the development of evaluative judgment.

Recommended Publications

 

Chappuis, S., Brookhart, S. M., & Chappuis, J. (2021). Ten assessment literacy goals for school leaders. SAGE.

This book provides practical content for school leaders. It covers ten key topics, including understanding the characteristics of a comprehensive and balanced assessment system, standards of quality, formative assessment practices, grading practices, communication and ethical use of assessment. The companion website includes a list of activities and definitions for the respective chapter. Overall, it is envisioned that the ten goals, when acted on, can contribute to assessment literacy at the individual and/or system level.

Relevance: Assessment literacy has been identified by MOE as one of the six areas of practice in SkillsFuture for Educators. This book is a useful resource for educators who wish to deepen their understanding on assessment literacy.

 

Winstone, N. E., & Carless, D. (2021). Who is feedback for? The influence of accountability and quality assurance agendas on the enactment of feedback processes

https://doi.org/10.1080/0969594X.2021.1926221

This paper highlights the importance of purpose in assessment feedback. The data demonstrated that educators often experienced professional dissonance where perceived quality assurance requirements conflicted with their own beliefs about the centrality of student learning in feedback processes. Such dissonance arose from the pressure to secure student satisfaction, and avoid complaints. Quality enhancement of feedback processes could profitably focus less on teacher inputs and more on evidence of student response to feedback.

Relevance: Most teachers conduct formative assessments in their classrooms. This paper describes how one can enact formative assessment to improve student learning rather than to satisfy department indicators or student satisfaction.

 

Jönsson, A., Balan, A., & Hartell, E. (2021). Analytic or holistic? A study about how to increase the agreement in teachers’ grading. 

https://doi.org/10.1080/0969594X.2021.1884041

This paper describes a study conducted in Sweden to increase agreement in teachers’ grading by comparing analytic and holistic grading. Findings suggest that analytic grading is preferable to holistic grading in terms of agreement among teachers. However, teachers in the holistic conditions provided more references to criteria in their justifications, whereas teachers in the analytic conditions to a much larger extent made references to grade levels without specifying criteria. The author emphasised on the inclusion of moderation where teachers could review each other’s grading.

Relevance: Educators need to standardise grading so that assessment is reliable, especially so for assessments that require rubrics. This paper describes differences between holistic and analytical rubrics that could occur during the assessment process.

 

Yan, Z., Li, Z., Panadero, E., Yang, M., Yang, L., & Lao, H. (2021). A systematic review on factors influencing teachers’ intentions and implementations regarding formative assessment

https://doi.org/10.1080/0969594X.2021.1884042

This article reviewed 52 studies to identify factors that influence teachers’ intentions and implementations regarding formative assessment. The factors were categorised into personal (e.g. self-efficacy, education and training) and contextual factors (e.g. external policies).

Relevance: Formative assessment is prevalent in local schools. When educators and policy makers implement formative assessment, they would need to be aware of any factors that may aid or hinder its implementation. This article synthesizes these factors for evaluation.

 

Rasooli, A., Razmjoee, M., Cumming, J., Dickson, E., & Webster, A. (2021). Conceptualising a Fairness Framework for Assessment Adjusted Practices for Students with Disability: An Empirical Study.

https://doi.org/10.1080/0969594X.2021.1932736

This paper describes a study that leverages on the multiple perspectives of secondary school students with disability, their teachers, and parents to build a multi-dimensional framework of fairness for assessment adjusted practices. The framework included interactions across elements of assessment practices, socio-emotional environment, overall conceptions of fairness, and contextual barriers and facilitators. The interactions across these elements influence the learning opportunities and academic outcomes for students with disability.

Relevance: With an increasing emphasis on inclusive education, teachers may be struggling with adapting assessment practices to students with special needs. This study provides some resources on which teachers can adjust their assessment practices to be fair for all students.

 

Gorgodze, S., & Chakhaia, L. (2021). The uses and misuses of centralised high stakes examinations-Assessment Policy and Practice in Georgia

https://doi.org/10.1080/0969594X.2021.1900775

Trust in centralised high-stakes exams in Georgia has grown since 2005. This article describes how these centralised high-stakes assessments have become an integral part of the education system, cites available evidence on their impact, accounts for recent changes, and argues that overreliance on centralised high-stakes exams is due to complex educational, political and social processes that make it difficult to transform the system.

Relevance: High stakes national examinations are ingrained within the Singapore education system. There are constant reviews to improve and/or de-emphasise the reliance of these exams locally. This paper analyses the impact and challenges of these examinations in Georgia. Educators and policy makers may want to examine the changes in Georgia to learn from their journey.

 

 

 

Recommended Publications

 


Designing Quality Assessment Feedback Practices in Schools

Dr Rachel Goh

ISBN 9789813130265

This book examines the principles of quality assessment feedback design and the related practice of engaging students in feedback. It seeks to answer the following questions: What constitutes effective assessment feedback? What should assessment feedback do for students’ learning outcomes and learner growth? How can assessment feedback practices support students’ learning in the present and beyond?

Click here to find out more. 

DeLuca, C., Donaldson, G. Hayward, L., Tan, K., & Wyatt-Smith, C. (2021). Imperatives for a Better Assessment Future During and Post COVID. International Educational Assessment Network. https://www.iean.network/Reports-Publications/

This paper examines the role of assessment as a key driver of change and provides research-informed advice for policy makers and education leaders working towards the creation of a better education future post COVID. A range of disruptions to education are identified, and five imperatives are posited for ensuring the fitness of education for economic survival, ethical citizenship, and personal wellbeing in an increasingly unpredictable and challenging future.

Imperative 1. Align what is identified in the curriculum as important for young people with what is assessed or examined: Assess and therefore drive learning that students will need to succeed in the future.

Imperative 2. Keep accountability systems designed to evaluate the efficacy of policy and practice focused on system level learning and improvement rather than judgement, comparison and categorization.

Imperative 3. Identify, monitor and respond to the impact of assessment on wellbeing and plan for positive impact.

Imperative 4. Use technology to support learning not as a substitute for teacher decision-making and dialogue with learners.

Imperative 5. Execute a comprehensive and inclusive plan to improve understanding of 21st century assessment within and across communities.

Tang T. Heng & Lynn Song (2021): At the intersection of educational change and borrowing: teachers implementing learner-centred education in Singapore, Compare: A Journal of Comparative and International Education. https://doi.org/10.1080/03057925.2021.1910014

The lived realities of agents involved in educational borrowing or transfer are often omitted as research and discussions reside predominantly at a macro level. Through the lens of a comparative educational change framework synthesising concepts in educational change and comparative education, this study examines the lived experiences of teachers in Singapore implementing differentiated instruction, a form of learner-centred education, borrowed from the U.S. Interviewing and observing teachers, we found that they experienced postmodern and political tensions around sociocultural expectations of teaching, learning, and learners. Simultaneously, they struggled with technological considerations like structural conditions in schools and insecurities around their competencies. These findings spell implications for how we support teachers involved in educational borrowing professionally, intellectually, and emotionally. Educational borrowing on the ground can benefit from the consideration of technological, sociocultural, political, and postmodern perspectives of educational change.

Wong, H. M., Kwek, D., & Tan, K. (2020) Changing assessments and the examination culture in Singapore: A review and analysis of Singapore’s assessment policies, Asia Pacific Journal of Education, 40(4), 433-457. https://doi.org/10.1080/02188791.2020.1838886

Assessment in education occurs for different purposes – formative, summative, diagnostic, and each with different focus on educational process, education outcomes, and developmental reasons. Researchers in Singapore have documented the existence of tensions between the entrenched high-stakes examinations and attempts to introduce new modes of assessments such as Assessment for Learning practices, partly because policy attempts to change assessments invariably clash with the examination culture in Singapore. This article reviews and critically analyses assessment policies and their attendant precedents and consequences in order to better understand why these tensions around assessment exists. Drawing from institutional theory and the model of gradual institutional change, the review covers an extended period of over 150 years of assessment policies in order to show how the policy layering and conversion processes are attempting to drive both assessment changes and systemic tensions. The article will discuss how parents as a significant policy actor not only constrain policy intentions but create new institutional mechanisms that perpetuate these tensions.

Yan, Z., Li, Z., Panadero, E., Yang, M., Yang, L., & Lao, H. (2021). A systematic review on factors influencing teachers’ intentions and implementations regarding formative assessment. Assessment in Education: Principles, Policy & Practice, 1-33. https://doi.org/10.1080/0969594X.2021.1884042

 

Teachers are playing crucial roles in the implementation of formative assessment, which has been widely recognised as a valuable strategy in enhancing students’ learning outcomes. However, systematic analysis on factors that might facilitate or hinder teachers’ intentions and implementations regarding formative assessment is scarce. This review covers 52 eligible studies and identifies factors, which have been categorised into personal and contextual factors, that influence teachers’ intentions and implementations regarding formative assessment. The results of this review may benefit researchers, school leaders, and policy makers when they aspire to facilitate the implementation of formative assessment.