What a tangled web we weave: strategies for school improvement

by Harald Wilkoszewski
Analyst, Innovation and Measuring Progress Division, Directorate for Education and Skills

The best education possible for our children – this is what all education systems strive for. But what can policy makers do when schools become weak, sometimes too weak, to fulfil their purpose? Especially in highly decentralised systems, where schools enjoy high levels of autonomy, policy interventions to help improve the learning situations for students can be particularly difficult to implement.

A new case study on The Netherlands for the OECD project “Governing Complex Education Systems (GCES)” shows that a timely, risk-based assessment of schools can help to significantly lower the number of weak schools. The case study also illustrates that governing is in the details, as the reform had some undesired effects. But let’s look at the good news first.

In 2009, 120 Dutch schools were underperforming. In 2011 this number decreased to less than 100, a significant drop of over 16%. The Dutch school inspectorate, traditionally responsible for school quality, achieved this by flagging schools that showed low indicators on a number of outputs as “weak” or “very weak”. These labels mean that unless these schools change radically, they run the risk of failing – being closed down.

Schools are not, however, left alone with this message: The inspectorate puts in place a range of supporting measures such as tailor-made recommendations or an intensive exchange with schools boards.

While the numbers speak for the success of this reform, the new GCES case study “Coping with very weak primary schools” also shows that schools react quite differently to being labelled “weak” or “very weak”. Most school communities take it as a wake-up call and are encouraged to improve, but some become discouraged and do not manage to turn the wheel around.

Whereas schools that react positively then end up in a virtuous cycle of improvement, schools that react negatively are stuck in a vicious circle: alerted parents take their children out of the labelled school, other parents follow the example, and the number of students decreases dramatically. This forces the school to merge several school grades into one classroom, putting even more stress on the teachers. In this difficult situation, performance improvements are hard to achieve and school closure becomes a likely scenario.

In order to avoid such undesired effects, the case study recommends that decision makers adapt their mindsets, from a linear perspective of cause and consequence, to a more dynamic view. This will help them take a second look at their existing repertoire and analyse how their current set of policy interventions works in a complex system.

Ultimately, this adaptive view may prove beneficial in other education policy contexts as well because it can:

• Lead to new insights into how and why some interventions seem to work surprisingly well;
• Show why some methods work less well and identify previously unnoticed, positive effects;
• Show that some interventions do not work at all and that the capital that goes into them may be better invested in other areas of the system;
• Put some interventions on the radar that come from other areas, other policy domains that may be beneficial to very weak schools;
• Be an important element in developing smarter interventions in multi-level systems.

Links:
OECD'S Centre for Educational Research and Innovation (CERI)
Governing Complex Education Systems (GCES)
Photo credit: Young girl excited that she has reached the top of the giant/ Shutterstock

Learning to Teach: Teaching to Learn

by Kristen Weatherby
Senior Analyst, Teaching and Learning International Survey (TALIS)

If you are a teacher, chances are the scene in this photo looks very familiar to you. You’ve probably spent quite a few hours in a room similar to this as part of a professional development conference, course or seminar. You’ve listened to the speakers, possibly done some group work with other teachers in the room and then returned to your school. Perhaps you’ve come away inspired and have been able to apply some of what you’ve learned in your teaching. Or maybe you have found it difficult to transfer the content from the course back to the unique context of your school and classroom.

One thing we have learned from surveying teachers around the world as part of our Teaching and Learning International Survey (TALIS) is that teachers everywhere want more professional development. On average across countries, 55% of teachers are telling us this. In some countries, continued professional development is an integral part of teachers’ yearly objective-setting and evaluation process. Yet in others the opportunities for teachers to take advantage of professional development may be dwindling – particularly in these difficult economic times. In 2008, teachers told us that the main barriers preventing them from participating in more professional development activities were a conflict with their work schedule (47%) and a lack of available and suitable programmes available (42%). In today’s difficult economic times, schools facing budget cuts might also be less willing to let teachers leave for development opportunities, as these entail considerable cost, not only in fees, travel expenses, and any teacher stipend that might be provided, but also in finding a substitute teacher to cover the classes. What can be done to help give teachers the support they need?

The latest Teaching in Focus brief, “Fostering Learning Communities among Teachers”, discusses how teachers can create and participate in co-operative professional development activities. These are different from the traditional conferences, workshops or seminars that might be held in a hotel ballroom. They includes activities that can often be achieved within the teacher’s own school, such as participating in a teacher network, mentoring, coaching and observing other teachers. On average, only about a third of teachers who reported receiving professional development described it as co-operative professional development.

TALIS asked teachers to report whether they participated in certain activities at school that could indicate the presence of professional learning communities in their schools. A professional learning community can be defined as a school-wide community “aim[ed] at continuous improvement of teaching practices by involving staff in in-depth, systematic, collaborative activities of professional development at the school level.” (Hord, 1997) TALIS found that in many countries, basic forms of co-operation among teachers are common, but collaborating on the core of their professional activities – as professional learning communities require – is much less common.

A professional learning community within school can offer support for teachers where and when they need it.  However, according to TALIS data, such communities are few and far between. Giving teachers access to more professional development opportunities within their own schools might benefit individual teachers while providing the first step toward a professional learning community for the school as a whole.

Links:
To learn more about this topic, check out this month’s Teaching in Focus brief. Look for further Teaching in Focus briefs on topics relevant to the experience of teachers in the coming months.
Follow TALIS and Kristen Weatherby @Kristen_Talis
Photo credit: Interior of a Congress Palace, conference hall / Shutterstock

A class act: giving teachers feedback

by Kristen Weatherby
Senior Analyst, Teaching and Learning International Survey (TALIS)

When I think back on my first experiences as a student teacher of English language and literature to 13- and 14-year-olds, I don’t really remember the successes; I am not sure there were many during my teaching practice. Rather, I am reminded of the more colourful episodes of classroom management and student behaviour that seemed to occur all too frequently. For example, there was the time I looked up from reading to the class to see one student staring back with a green mustache and eyebrows. Another time one student jumped up from his desk and threw another student’s books out the window before I could blink. And then there were the countless times that I had to take away combs, brushes and makeup from both girls and boys in an effort to turn my classroom from a beauty salon into a place of learning. Needless to say, in these moments I didn’t feel like a very effective teacher.

Little did I know it at the time, but I was not alone in feeling a bit like a failure due to a less-than-ideal classroom climate. The newest Teaching in Focus brief, “How can teacher feedback be used to improve the classroom disciplinary climate?” discusses how providing teachers more feedback to improve their classroom’s disciplinary climate can have a positive effect on their sense of mastery of the situation, what is known as self-efficacy. The OECD’s  Teaching and Learning International Survey (TALIS) measures classroom disciplinary climate by the amount of time it takes to ready students for a lesson, the number of student interruptions, and the amount of noise in the classroom, among other factors. TALIS data shows that, on average, 13% of a typical class’s teaching and learning time is lost to keeping order.

TALIS data also shows that most teachers are not receiving the kind of feedback that helps them to improve their classroom disciplinary practice. As a result,  teachers are left feeling much as I did as a new teacher – not very effective. In fact, this is supported by the TALIS data, which indicates a relationship between teacher self-efficacy and classroom disciplinary climate. Teachers’ self-efficacy can have a significant impact on what goes on in the classroom, as it indicates not only aspects of productivity but also how teachers act in class. And teachers who report poor classroom discipline also report lower levels of self-efficacy.

Policymakers, union leaders, and teachers will be meeting next week in Amsterdam for the third International Summit on the Teaching Profession. This year’s topic is teacher evaluation and professional standards. Constructive feedback – as part of formal or informal teacher appraisal – could help teachers to improve their classroom disciplinary climate. TALIS 2008 results suggest that individualised feedback that considers the teachers’ characteristics, competencies, and individual classrooms, would be most helpful in improving classroom disciplinary climate and teacher self-efficacy. It undoubtedly would have helped me to chalk up a few successes during those early days in front of the class.

Watch this space for more blogs related to the Teachers’ Summit. We’ll also be tweeting live from the Summit. Follow the summit on twitter: #ISTP2013

Links:

For more on the OECD Teaching and Learning International Survey:www.oecd.org/edu/talis
Teaching in Focus: How can teacher feedback be used to improve the classroom disciplinary climate?
Third annual International Summit on the Teaching Profession, 13-14 March 2013, Amsterdam, Netherlands
Teachers for the 21st Century: Using Evaluation to Improve Teaching
Follow TALIS and Kristen Weatherby @Kristen_Talis
Photo credit: Positive feedback/Shutterstock

2much 2handle? Schools, social networks, and cyber bullying

by Tracey Burns
Analyst and Project Leader,  Innovation and Measuring Progress Division, Directorate for Education and Skills

“I’m really worried but I don’t know how to react” my friend told me over coffee the other day. Her daughter, 11, had told her that she was being bullied online, but would not say by whom.

“What can I do? And how do I know if it’s serious or not?”

A just released OECD publication looks at how rapid technological development has changed the way we interact with each other and our communities. Despite the enormous potential of the Internet to reshape our world, there is a downside to infinite connectivity. Internet fraud, privacy concerns and identity theft are all part of the online world. For parents and children, worries about cyber bullying and protecting children from explicit content and online predators are crucial.

Cyber bullying occurs when a child, preteen or teen is threatened, harassed, or embarrassed by another young person using the Internet. A number of high–profile tragedies, for example teens who committed suicide as a result of cyber bullying, have brought this topic to the top of policy, education, and parental agendas. However the extent of cyber bullying is hard to estimate, varying from more than 10% of surveyed internet users aged 9 16 years in Australia, Estonia, Denmark, Sweden and the Russian Federation to between 2- 3%, in Italy, Portugal and Turkey. While cyber bullying is worrisome, bullying offline is still reported to be more common.

Interestingly, the bully and victim roles are often interchangeable and related: those who admitted bullying others were more likely to report being bullied themselves, both online and offline. Guides to protecting Internet users make it clear that the best preventive strategies involve awareness, constant vigilance, and keeping an open dialogue about children’s concerns and online lives. For education, this poses a series of tough questions. What responsibilities do educators have in monitoring student’s time online during school hours? How can different parental standards of safety be accommodated?

The advent of cyber bullying is just one example of technological changes sweeping OECD countries. Trends Shaping Education 2013 looks at 14 of these trends and their possible impact on education, including:

• Social networking: Founded in 2004, Facebook had over 1 billion active users by September 2012. Should schools see social network sites as an opportunity to extend the learning process/experience beyond the classroom?
• Increasing diversity of local content: Since the mid 2000s the diversity of languages on the Internet has increased dramatically. There are now over 250 languages online, with English, Chinese, Japanese, Portuguese, and Spanish comprising the top five. Does local diversity of Internet content lead to better or worse quality of information available for students?
• The evolution of the Internet: In January 2009, there were 15 000 downloadable applications, or “apps” available. By September 2012, this figure had grown to over 1.5 million. Is there a market for educational apps to improve learning in the classroom and extend it beyond?

The transformation of the Internet is felt throughout the entire world, including the poorest regions. Trends Shaping Education 2013 provides a powerful snapshot of these trends and links these data to the evolution of our classrooms and schools. How can educators develop their students’ critical capacity to use and contribute to the wealth of information available at the click of a button? What kind of quality control should we expect from e-learning? How can teachers make the best use of ICTs for teaching and learning?

These are just some of the questions we must ask ourselves when planning for the medium and long term of technology in our education systems. Our world is changing. The question is: are our schools evolving too?

Links:
Trends Shaping Education 2013

This is the second of a series of blogs issued for the release of Trends Shaping Education 2013. You can find the first one here:
The weight of nations: the shape of things to come?

Photo credit: Cyber bullying concept/ Shutterstock.com

The weight of nations: the shape of things to come?

by Tracey Burns
Analyst and Project Leader, Innovation and Measuring Progress Division, Directorate for Education and Skills

At lunchtime, Marco can be found in the bathroom stall of his secondary school. He is not ill. Rather, he is eating his lunch away from the eyes of his peers, sensitive to his weight problem and hoping to avoid being teased and targeted by bullies. Like many obese children, he struggles with poor self-esteem, anxiety, and depression.

Growing affluence has had positive influences on the health of OECD citizens. Less premature death and infant mortality, and longer and healthier lives have all been associated with our increased economic well being. But, does affluence lead to indulgence? A just released OECD publication shows that obesity among adults and children threatens to grow into a severe public health crisis.

Across all countries, the average   Body Mass Index  (BMI) increased between 1980 and 2008. This trend is universal, and it is swift. In 1980, just under half of countries had an average BMI classified as “overweight”. By 2008, this figure had grown to 87% of countries, with Mexico and the United States at the top of the list. Only China, India, Indonesia, Japan, and Korea still fall within the “normal” range, but their averages are also on the rise. Given the speed and uniformity of the trend, it is not an exaggeration to label it an epidemic for OECD (and increasingly BRIC) countries.

What does this mean for education? Schools can teach reading and writing, but combatting obesity requires learning about healthy behaviours and tools for managing one’s body, including non cognitive skills such as impulse control. Reducing junk food in school cafeterias is a start, but challenging negative assumptions and stereotypes that can shape teacher and student expectations is crucial. On a practical level, even simple details like the size of desks, chairs, and yes, washrooms, will need to be rethought.

Rising obesity is just one example of profound changes sweeping OECD countries, trends that are shaping the way we live and the future of education. Trends Shaping Education 2013 looks at 70 of these, including:

• Aging populations and the need for lifelong learning to develop and reinforce skills across the lifespan;
• An increasing divide between the rich and the middle class and the role of education in reducing (or reinforcing) inequity;
• The growing number of single-person households and the role of schools in building a sense of community and combating alienation in urban environments;
• A decline in voter turnout and the role of schools and universities in fostering civic literacy.

It is astonishing just how universal these trends are. In 100 pages this book provides a powerful snapshot of globalisation at work and links this data to the evolution of our classrooms and schools. It captures the transformation of our societies, and asks hard questions about how these trends will affect our education systems and what they mean for teaching and learning.

What role can education and schools play in improving civic participation and well-being in our modern societies? What does it mean for education that our societies are becoming more diverse? How might schools continue to foster a greater sense of community for their students and families in urban environments? These are just some of the questions we must ask ourselves when planning the future of our education systems. Policy makers, school leaders, teacher educators, and teachers can and should take an active role in this critical reflection, as well as parents and students. Behind every graph in Trends Shaping Education 2013 there is a Marco (or Maria, or Stan) hidden from sight in school, waiting for the weekend to come.

Links:
Trends Shaping Education 2013
Obesity and the Economics of Prevention: Fit not Fat
Education and Social progress

Photo credit: Obesity in Children / Shutterstock.com

A Window into the classroom

Dirk Van Damme
by Division Head, Innovation and Measuring Progress (IMEP) and Head of Centre for Educational Research and Innovation (CERI)

An excellent teacher is what makes students learn and succeed in school. Everything else – standards, curricula, assessments, resources, school leadership – come second. Yet, what do we actually know about what teachers are doing?

Classrooms seem to be the ‘black boxes’ of the education system. There is not an awful lot of research on classroom teaching practices, but TALIS 2008 provides some self-reported data on teaching practices and professional activities including participation in collaborative learning with colleagues. The main TALIS report, published in 2009, compared the relative preference for three different teaching practices – structuring, student oriented and enhanced activities – across the 23 different countries that participated in the survey. The report showed differences between countries regarding the extent to which teachers are favouring directive and teacher-directed practices over more activating and learner-centred ones. These TALIS results were received as rather disappointing signals, suggesting that the teaching profession was relatively resistant to change in many countries.

In collaboration with the TALIS programme and as part of its Innovative Teaching for Effective Learning project the OECD’s Centre for Educational Research and Innovation (CERI) has just released a research report which delves deeper in the TALIS data on teaching practices in classrooms and schools. Based on some advanced analytical tools (multilevel latent profile analysis), this new book called Teaching Practices and Pedagogical Innovations: Evidence from TALIS  identifies underlying profiles in teachers’ classroom practices. A large set of variables about teachers, such as gender, training, subjects taught, but also their pedagogical beliefs, the degree of professional development, the amount of feedback and appraisal received, etc., were brought together and in each country different profiles of teachers were distinguished.

The scientific and policy implications of this research are huge. Many learning researchers and education policy makers strongly – and rightly so – believe in the benefits of more student-oriented, self-regulating approaches to teaching and learning. This suggests that a particular form of teaching is outdated and should be replaced by a more innovative one. Consequently, this report now suggests that we should not look at the quality of what happens in classrooms in an ‘either-or’ way. While it is true that the best teachers differ from their colleagues in their relative use of activating, student-oriented ways of teaching, they also use more structuring, teacher-driven forms of classroom practice. Teaching quality is a matter of diversity of practices, not of one set of practices against the other. Excellent teachers are those teachers who master a large repertoire of teaching practices, which they can deploy according to learners’ needs and varying classroom conditions. Those teachers are also the ones who actively advance their own professional competence by professional development and who feel more satisfied and effective about their own work.

A final important finding is that there is also a clear difference between these teacher profiles in the degree of co-operation with other colleagues and engagement in collaborative learning communities in and outside schools. Excellent teachers view teaching as a collective responsibility within the profession, not as an individualised thing happening behind closed doors. They open the doors of their classrooms, inviting colleagues to engage in what they are doing but also disclosing what happens in classrooms to the outside world. It is that kind of teachers we need to work with our kids.

Links:
Centre for Educational Research and Innovation (CERI) Activities
OECD Teaching and Learning International Survey (TALIS)
Teaching in Focus Briefs

Photo credit: © By happy via

What can be done to support new teachers?

by Kristen Weatherby
Senior Analyst, Teaching and Learning International Survey (TALIS)

While many students in the Northern Hemisphere are starting a new school year, this is also the first day of school for thousands of new teachers around the world. Walking into a new classroom – “your own” classroom – for the first time can be exciting and daunting. The pressures on a new teacher are many: administrative tasks, classroom management issues, dealing with potentially intimidating parents, challenges of developing lessons and marking homework and more. Most importantly, though, new teachers need to take what they learned in the weeks or months of teacher preparation, as well as their knowledge of the subject area, and put that to practice in shaping and motivating the learning of the 25, 50 or 150 students in their classes.

It’s no wonder that on average nearly 10% of teachers leave the profession within the first 1-3 years of teaching. But as our new Teaching in Focus brief shows, there are many practices that schools and countries can put in place that might help new teachers stay teaching.

Many media reports attribute the high attrition rate of new teachers to the fact that they are placed in difficult classrooms in challenging or underresourced or otherwise hard-to-staff schools. Data from the Teaching and Learning International Survey (TALIS) refutes that claim. On average, new teachers surveyed in TALIS (those with two years of teaching experience or less) reported classrooms and school situations similar to those of their more experience colleagues, with nearly no differences in language or socio-economic status of their students, for example. So if these challenges don’t exist, what is making new teachers leave?

At the root of the issue seems to be a new teacher’s level of confidence in his or her own teaching ability. TALIS asks teachers to report on their own feelings of self-efficacy. Not surprisingly, new teachers report significantly lower levels of self-efficacy than their more experienced colleagues. The TALIS report The Experience of New Teachers discusses research on how self-efficacy can relate to a teacher’s instructional practices as well as student achievement. It can thus be rather important for a teacher to feel good about his or her on abilities as a teacher.

As the TALIS data shows, and the Teaching in Focus brief enumerates, there are programmes and policies that schools and governments can put in place to help new teachers. Activities like mentoring and induction programmes, when combined with feedback on a new teacher’s practice, can help provide support and additional professional development to new teachers.

To learn more about this topic, check out this month’s Teaching in Focus brief. Look for further Teaching in Focus briefs @ www.oecd.org/edu/talis on topics relevant to the experience of teachers in the coming months.

Follow TALIS and Kristen Weatherby @Kristen_Talis
Photo credit: Back to School sign / Shutterstock