Tag Archives: research

Summary of SOLO Posts

As one of the searches that seems to bring people to my site is for SOLO taxonomy, here is a post which provides links to each of the posts I have written about SOLO. I am not saying that SOLO is a magic bullet or universal panacea, however, my research suggests that it may have a positive impact.

My advice, for what it’s worth, is: read about it, try it for yourself if you want to and make up your own mind whether it is useful for you and your students.

MA Research Project

All of these posts are based on my final MA dissertation, as a result they tend to be more theoretical.

Teaching with SOLO

These posts are about my own experiences using SOLO in lessons.

If you have any questions, feel free to comment and I’ll do my best to answer.

SOLO Research: Conclusions

What have I learnt from my research into the SOLO taxonomy?

Researching and Note Taking

At a personal level, this research has been very useful. I have found out that I really enjoy research and reading academic articles and texts. In particular, writing the literature review was an interesting, challenging and enjoyable part – far more than I had expected it to be. It was like a giant jigsaw which needed to be put together before it would make sense.

notesI tried out a variety of note taking methods for the review, the most effective one turned out to be writing key quotations onto post its which I then sorted into linked areas on large pieces of paper with lines and comments added to show the relationship. This helped organise each part of the review into paragraphs and made the links clearer to see. It was while I was doing this that I realised that this was also a SOLO task – I was moving my knowledge of the literature from the multistructural to the relational level and beyond. Thinking about the process in this way was quite useful as it mitigated some of the frustration I felt at having to go off on tangents in order to understand the bigger picture – it was simply that I didn’t have the knowledge at the multistructural level.

Twitter, the Internet and The Khan Academy

As someone who completed their undergraduate degree in the early 1990s, studying at Masters level was a very different beast. Beyond the level of complexity that obviously exists in the step up, the key difference I noticed was the availability of resources. Now, don’t get me wrong, I love an academic library – the smell of the books, the chance finds in the stacks, the quiet you only get in the obscure corner of the Old English section on floor 10 – but, as a distance learner, the internet has been invaluable to me.

Twitter has been a fantastic source of ideas, suggestions for academic reports and texts as well as a source of data. Without this community of educators, I think my study would have been a sad shadow, and I would have been a very lonely researcher.

One of the challenges I faced was gaining an understanding of descriptive and comparative statistics. As far as I can remember (and it was a very long time ago, so I may be wrong), this was not covered in much detail in my GCSE Maths course. Although I have used maths on a day to day basis in work and as a teacher, this was something I needed to brush up on – that is where The Khan Academy came in. One weekend watching their statistics videos and trying out a few problems, and I had a good understanding of what I needed.

Is the SOLO Taxonomy Effective?

Based on my limited research, it does appear that the SOLO taxonomy can be a useful tool in a teacher’s arsenal. The use of rubrics to identify the knowledge (both declarative and functioning) and stages of learning were particularly useful for making this explicit both for me and the students. The emphasis on looping back through the multistructural-relational-extended abstract levels in order to develop a more detailed and sophisticated understanding helped scaffold the most able and encouraged them to view learning as open-ended.

Knowledge is vital – without relevant knowledge, students cannot progress through the SOLO levels. Direct instruction, whether it is through teacher talk, rubrics or any other direct method, help to provide the  knowledge needed by the student. The rubric can keep this instruction at the forefront while students complete independent tasks – the two do not have to be mutually exclusive.

A key benefit of the SOLO taxonomy is creating a common language for discussion of knowledge and feedback – used by the teacher and in self and peer assessment it can help to ensure the quality and focus of feedback.

Of the SOLO techniques I trialled with my classes, I felt that the use of rubrics, hexagons and SOLO stations were the most useful. The weaker students found the hexagons helpful to pull together their knowledge of a text and bridge the gap between knowing the text and being able to write a clear paragraph about it. SOLO Stations allowed for differentiation, student choice and teacher guidance while giving me the time to work individually with students. The HOT maps were rather hit or miss depending on which type was used – the Part/Whole Analysis was a useful structure for discussing and revising a text in detail.

Given the recent reports from Sir Michael Wilshaw, regarding the brightest students in schools failing to achieve the highest grades, it is certainly interesting that in this small scale study Level 5 students and males taught using SOLO methods did considerably better than their non-SOLO counterparts. Ev ex 2Although it is impossible to know whether SOLO was the key factor in this difference, it suggests that this may be a possibility and would warrant further investigation.Ev ex 4

 

Taken as a whole, based on my personal observations, surveys of teachers and students, a lesson observation and exam data analysis, it appears that the SOLO taxonomy may be effective. As with any teaching technique, it is not a panacea – however, it is certainly worth trying.

SOLO Research Project – Findings Part 1

Overview of the Project

As the project was to investigate an aspect of my teaching practice, I chose to use an action research approach. Alongside this, and the literature review, I also carried out a small scale survey of students involved and a slightly larger scale survey of teachers. The final part of the project was an analysis of exam results (I will go through the findings of the exam analysis in another post).

Throughout the action research I completed a series of blog posts outlining my experiments with three separate SOLO techniques: use of hexagons, use of HOT maps and the use of rubrics and SOLO stations. Within each entry I tried to outline the techniques used and comment on my perception of their effectiveness. Newbury (2001:3) describes the ‘research diary’ as:

A form through which the interaction of subjective and objective aspects of doing research can be openly acknowledged and brought into a productive relationship.

I felt that, as one of the criticisms of the action research model was that results were often restricted to the teacher carrying out the research, it would be helpful if I shared my experiences with other teachers via a blog. As Weston (2012) states in his blog post:

Researchers need to develop a culture where findings are not simply broadcast to schools, but where they engage with increasing numbers of schools to find out how to successfully adapt the approach in different contexts, how to overcome different challenges, and how to successfully combine the idea with other priorities in the classroom.

My observations focused mostly on Year 10 classes, although I also trialled SOLO based activities with Year 11 and Year 12. Classes were chosen using convenience sampling.

Any personal commentary, especially reflecting on one’s own teaching, is subject to bias, as Gavron (1996:159, cited in Biggam, 2011) notes:

It is difficult to see how this can be avoided completely, but awareness of the problem plus constant self-control can help.

 I have endeavoured to keep this in mind through my analysis, and chosen to use data from a range of different sources to mitigate any unconscious bias. In addition, although convenience sampling is not ideal, as the sample size is relatively small and the groups were not chosen at random, this is acceptable for action research.

My Observations

The blog posts on each of the techniques can be found here:
Hexagons – 1, 2, 3, 4
HOT Maps – 1, 2,

SOLO Stations – 1, 2, 3,4

Overall, I felt that the techniques had been useful in conjunction with existing teaching methods. The use of the rubric to specify key elements of the knowledge being taught was particularly helpful for structuring feedback with clear next steps. I will expand on this in my final post (Conclusions).

Student and Teacher Surveys

Unfortunately, the number of students who took part in the survey was small (partly as my time ended up being rather cut short due to my relocation). However, on the whole, the students found the SOLO lessons useful and felt that they had helped them develop their knowledge of the text and how to present their responses more clearly.

In March, I asked for volunteers to complete a short questionnaire about using the SOLO taxonomy in lessons as part of my MA. I was overwhelmed that so many readers took the time to complete the survey – 60 of you in total! Thank you so much for your help.

Evidence 1aThe majority of teachers who responded felt that SOLO techniques were effective and based this belief on a range of indicators, not simply personal observation.

Evidence 1The most popular techniques were, perhaps unsurprisingly, those which have had the most coverage in blogs and are the most straightforward to implement.

Evidence 2My final questions asked which subject the teachers taught and how long they had been teaching. Teachers from a wide range of subjects took part, from science to history, from PE to English – suggesting that SOLO techniques have the potential to be used effectively across the curriculum.

Evidence 3 The findings of this survey certainly suggest that teachers with 6 or more years teaching experience are using social networking and experimenting with new techniques. Now I am not saying that those who have been teaching longer are ‘better’ than those just entering the profession. This is more to do with – the difference between ‘experienced’ and ‘expert’ teachers. Effective, expert teachers are prepared to experiment, and adapt their teaching, not because Ofsted or SMT want it, but because they have decided that it would be beneficial to their students.

SOLO, Learning and Teaching

For educators, there is a need to identify how they can best help students to achieve their potential. School makes up a significant part of students’ young lives, so it is unsurprising that:

Schools shape and change beliefs, both as purveyors of knowledge and as epistemological training grounds for developing students. (Schraw, 2001:406)

The challenge is to balance the imparting of knowledge with providing students with opportunities to develop positive epistemological beliefs. New initiatives often focus on the former, specifically teaching methods, possibly because this is an easier area to demonstrate impact. As Hattie (2012) notes, most of what we do as teachers will have some effect on the students we teach.

OfSTED’s (2012/13b:32) definition of an ‘Outstanding’ school highlights the importance of students ‘making and exceeding expected progress’, whatever their starting point. To achieve this, schools need to know what causes variance between students, both between schools and between students in the same school. Hattie (2003) identifies several elements which are responsible for potential variance in achievement. The most significant factor identified was the student themselves, being responsible for 50% of variance. Student engagement, beliefs and motivation is at the heart of the matter.

Levin (2010:89) explains that:

Schools with higher levels of engagement are more successful with students from all kinds of backgrounds.

This supports Hattie’s (2003) findings that home is less significant an influence than perhaps we might expect.

The second most significant influence was the teacher (30%):

It is what teachers know, do and care about which is very powerful in this learning equation. (Hattie, 2003:2)

However, Schraw (2001:406 summarises a key difficulty with addressing the issue:

The existing research invites the conclusion that schools should make the effort to change beliefs in positive ways, although it is less clear how those changes should occur.

Hattie’s work (2003, 2012) may give us an indication of how these changes should be approached; if both students and teachers are responsible for 80% of the variance between student outcomes, it is here that the focus needs to be. Ideally, a focus on techniques and strategies which encourage teachers to teach in the most effective manner, while encouraging students to learn and develop positive epistemological beliefs.

Students’ Learning

To understand how students learn effectively, it is useful to be aware of a number of key areas. Firstly, how do epistemological beliefs affect learning? And secondly, which specific traits does an effective learner have?

 Hofer & Pintrich (1997:88) define personal epistemology as:

How individuals come to know, the theories and beliefs they hold about knowing, and the manner in which such epistemological premises are a part of and an influence on the cognitive processes of thinking and reasoning.

Resent research into students’ beliefs about learning (Pintrich, 2002; Cano & Cardelle-Elawar, 2004; Dweck, 2006; Barnard et al., 2008; Afflerbach et al., 2013) have highlighted the link between how students view learning and their academic performance. Cano & Cardelle-Elawar (2004:182) suggesting that:

The evidence that secondary school students hold immature beliefs…might go some way to explaining the poor academic achievement of many students.

As teachers, we often see this manifested as a willingness to give up when challenged, reluctance to work hard for results and the belief that they are either ‘good’ or ‘bad’ at a particular subject. I know that, in the past, I have been guilty of this, especially with Maths – in reality, I’m not actually bad at Maths, I just find it harder.

However, Louca et al. (2004:58) assert, in their study of teaching science to 3rd grade students, that students are not aware of these ‘beliefs of theories’, but instead ‘have a range of cognitive resources for understanding knowledge’. With many schools implementing ‘learning to learn’ schemes, students are now more likely to have an awareness of how they learn. At the heart of this awareness, there needs to be the belief that learning is complex and requires effort.

An effective student needs to develop a wide range of skills and attributes:

Learning at school requires students to pay attention, to observe, to memorize, to understand, to set goals and to assume responsibility for their own learning. These cognitive activities are not possible without the active involvement and engagement of the learner. (Vosniadou, 2001:8)

The emphasis, for effective learning and progress to take place, is on the need for students to be self-regulated (Barnard et al., 2008; Nückles et al., 2009; Afflerbach et al., 2013) and for students to have some control over their learning (Skinner et al., 1998, cited in Yeh, 2010; Vosniadou, 2001; Zull, 2002).

What Makes a Teacher Effective?

Researchers and policymakers have often tried to define what makes an effective teacher; however arriving at a definition can be fraught with difficulties. Shulman (1987:6) notes that these definitions often ‘became items on tests or on classroom-observation scales’ which ultimately end up as a restrictive check-list. Levin (2010:90) points out that, proposals for improving teaching ‘have been made many times before’ and that merely listing suggestions is not enough – we need concrete examples of how this might be achieved.

Although our knowledge of how the brain works has developed over the past century, the topic can be a contentious one. Information processing, ‘the mental operations that come between a stimulus and response’ (Malim & Birch, 2005:25), is at the centre of discussion between cognitive psychologists, especially when related to student learning (Vygotsky, 1978 cited in Vosniadou, 2001; Kolb, 1984; Baddeley, 1999; Bischoff & Anderson, 2001; Tsai & Huang, 2001). Kirschner et al. (2006:77) highlight the importance of an understanding of the brain’s processes:

Any instructional theory that ignores the limits of working memory when dealing with novel information, or ignores the disappearance of those limits when dealing with familiar information, is unlikely to be effective.

 As a result of the complexities, and lack of a definitive explanation of how the brain works, there have been disagreements between academics as to the best mode of instruction, in particular between project based learning and direct instruction (Bishoff & Anderson, 2001; Wallace & Louden, 2003; Gauthier & Dembélé, 2004; Zull, 2002; Wu & Tsai, 2005; Kirschner et al., 2006; Hmelo-Silver et al., 2007; Granger et al., 2012; Hodges, 2012). These discussions can become polarised, while the most effective teaching is likely to judiciously use elements from both modes.

However, there also appear to be several areas of agreement; Hattie (2012:16) states that:

The act of teaching requires deliberate interventions to ensure that there is cognitive change in the student; thus the key ingredients are being aware of the learning intentions, knowing when a student is successful in attaining those intentions, having sufficient understanding of the student’s prior understanding as he or she comes to the task and knowing enough about the content to provide meaningful and challenging experiences so that there is some sort of progressive development.

This suggests that an in depth knowledge of the students is one of the hallmarks of an effective teacher. In addition, we can add: high expectations (Levin, 2010; OfSTED, 2012), formative assessment (Black & Wiliam, 2006), differentiation (Hattie, 2003; Yeh, 2010; Hook & Mills, 2012; OfSTED, 2012) and feedback (Hattie, 2003, 2012; Black & Wiliam, 2006; OfSTED, 2012). The SOLO taxonomy can offer teachers a structure for implementing these skills in conjunction with the teacher’s existing strategies.

References:

Afflerbach, P., Cho, B-Y., Kim, J-Y., Crassas, M., & Doyle, B. (2013) ‘Reading: What else matters besides strategies and skills?’ The Reading Teacher, 66 (6), pp. 440–448. Available at: http://doi.wiley.com/10.1002/TRTR.1146 [Accessed March 2, 2013].

Baddeley, A. D. (1999) Essentials of Human Memory. Hove: Psychology Press

Barnard, L., Lan, W., Crooks, S., & Paton, V. (2008) ‘The relationship between epistemological beliefs and self-regulated learning skills in the online course environment’. MERLOT Journal of Online Learning and Teaching 4 (3) pp. 261-266

Bischoff, P.J. & Anderson, O.R. (2001) ‘Development of knowledge frameworks and higher order cognitive operations among secondary school students who studied a unit on ecology’. Journal of Biological Education 35 (2), pp. 81-88.

Black, P. & Wiliam, D., 2009 ‘Developing the theory of formative assessment’ J. Gardiner, ed. Educational Assessment Evaluation and Accountability, 1 (1), pp. 5–31. Available at: http://eprints.ioe.ac.uk/1119/. [accessed 23 August 2012]

Cano, F. & Cardelle-Elawar, M. (2004) ‘An integrated analysis of secondary school student’s conceptions and beliefs about learning’. European Journal of Psychology of Education 19 (2) pp. 167-187.

Dweck, C. (2006) Mindset: The New Psychology of Success. New York: Random House.

Gauthier, C. & Dembélé, M. (2004) ‘Quality of teaching and quality of education: a review of research findings. UNESCO. Education for All Global Monitoring Report. 2005/ED/EFA/MRT/PI/18

Granger, E. M., Bevis, T. H., Saka, Y., Southerland, S. A., Sampson, V., & Tate, R. L. (2012) ‘The efficacy of student-centered instruction in supporting science learning’. Science (New York, N.Y.), 338 (6103), pp. 105–8. Available at: http://www.ncbi.nlm.nih.gov/pubmed/23042893 [Accessed March 11, 2013].

Hattie, J. (2003) Teachers make a difference: what is the research evidence? Melbourne: Australian Council for Educational Research

Hattie, J. (2012) Visible Learning for Teachers: Maximizing Impact on Learning. Abingdon: Routledge

Hmelo-Silver, C. E., Duncan, R.G. & Chinn, C. A. (2007) ‘Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark (2006)’. Educational Psychologist  42 (2) pp. 99–107. Available at: http://www.tandfonline.com/doi/abs/10.1080/00461520701263368.

Hodges, G. C., (2012) ‘Research and the teaching of English: Spaces where reading histories meet’. English Teaching: Practice and Critique 11 (1), pp. 7–25.

Hofer, B., & Pintrich, P. (1997) ‘The development of epistemological theories: Beliefs about knowledge and knowing and their relation to learning’. Review of Educational Research 67 (1) pp. 88-140.

Hook, P. & Mills, J. (2012) SOLO Taxonomy: A Guide for Schools Book 2: Planning for differentiation. Laughton, UK: Essential Resources Educational Publishers

Kirschner, P.A., Sweller, J. & Clark, R.E. (2006) ‘Work : An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching’. Learning  41 (2), pp. 75–86. Available at: http://www.informaworld.com/openurl?genre=article&doi=10.1207/s15326985ep4102_1&magic=crossref.

Kolb, D. A. (1984) Experiential Learning: experience as the source of learning and development. New Jersey: Prentice-Hall

Levin, B. (2010) ‘What did you do at school today?’ Kappan. 91 (5) pp. 89-90. http://www.education.auckland.ac.nz/webdav/site/education/shared/about/centres/uacel/docs/InCanadaWDYDIST1002lev.pdf [accessed 8 April 2012]

 Louca, L., Elby, A., Hammer, D., & Kagey, T. (2004) ‘Epistemological resources: Applying a new epistemological framework to science instruction’. Educational Psychologist 39 (1) pp. 57-68.

Malim, T., & Birch, A. (2005) Introductory Psychology. Baisingstoke: Palgrave Macmillan

OfSTED (2012/13a) The framework for school inspection. HMI 120100. London: OfSTED publications.  http://www.ofsted.gov.uk/resources/framework-for-school-inspection [accessed 15 April 2013]

OfSTED (2012/13b) School Inspection Handbook. HMI 120101. London: OfSTED publications.  http://www.ofsted.gov.uk/resources/school-inspection-handbook  [accessed 15 April 2013]

Pintrich, P. (2002) Future challenges and directions for theory and research on personal epistemology. In B. Hofer and P. Pintrich (Eds.), Personal epistemology: The psychology of beliefs about knowledge and knowing (pp.389-414). Mahwah, New Jersey: Lawrence Erlbaum Associates.

Schraw, G. (2001) ‘Current themes and future directions in epistemological research: A commentary.’ Educational Psychology Review. 13 (4) pp. 451-464.

Shulman, L.S., (1987) ‘Knowledge and Teaching: Foundations of the New Reform’. Harvard Educational Review, 57 (1), pp. 1–21.

Tsai, C-C. and Huang, C-M. (2001) ‘Development of cognitive structures and information processing strategies of elementary school students learning about biological reproduction’. Journal of Biological Education 36 (1) pp. 21-26.

Vosniadou, S. (2001) How Children Learn. UNESCO. Educational Practices Series 7. http://www.ibe.unesco.org/fileadmin/user_upload/archive/publications/EducationalPracticesSeriesPdf/prac07e.pdf [accessed 12 December 2012]

Wallace, J. & Louden, W. (2003) ‘What we don’t understand about teaching for understanding: questions from science education’, Journal of Curriculum Studies, 35, 5 pp. 545-566

Wu, Y-T. and Tsai, C-C. (2005) ‘Effect of Constructivist Oriented Instruction on Elementary School Students’ Cognitive Structures’. Journal of Biological Education 39 (3), pp. 113-119.

Yeh, S. (2010) ‘Understanding and addressing the achievement gap through individualized instruction and formative assessment.’ Assessment in Education: Principles, Policy & Practice 17 (2) pp. 169-182

Zull, J. (2002). The Art of Changing the Brain: Enriching the Practice of Teaching by Exploring the Biology of Learning. USA: Stylus Publishing.

What is the SOLO Taxonomy?

Learning taxonomies and frameworks are researchers’ and theorists’ attempts to categorise and explain learning (Bloom, 1956; Anderson, et al., 2000; Moseley, et al., 2005). These frameworks help teachers gain an insight into how students think and learn, however, due to the complexities of the human brain, they can only be used as a guideline. As our knowledge of the human mind develops, so will the frameworks used to explain the structure of thinking and learning.

In education, Bloom’s (1956) taxonomy, in its original form and as updated by Anderson et al. (2000), is probably the most familiar, examination questions often follow the hierarchy. However, it is not without its problems. Sugrue (2002:1) points out that the original taxonomy ‘was developed before we understood the cognitive processes involved in learning and performance’, and criticises the ‘consistency’ with which it can be applied. Teachers can avoid these problems through an awareness of alternative taxonomies, for example the SOLO taxonomy (Hattie & Brown, 2004).

SOLO (the Structure of the Observed Learning Outcomes) taxonomy was first introduced by Biggs & Collis in their 1982 study. The SOLO taxonomy maps the complexity of a student’s work by linking it to one of five phases:  little or no understanding (Prestructural), through a simple and then more developed grasp of the topic (Unistructural and Multistructural), to the ability to link the ideas and elements of a task together (Relational) and finally (Extended Abstract) to understand the topic for themselves, possibly going beyond the initial scope of the task (Biggs & Collis, 1982; Hattie & Brown, 2004). In their later research into multimodal learning, Biggs & Collis noted that there was an ‘increase in the structural complexity of their [the students’] responses’ (1991:64).

It may be useful to view the SOLO taxonomy as an integrated strategy, to be used in lesson design, in task guidance and formative and summative assessment (Smith & Colby, 2007; Black & Wiliam, 2009; Hattie, 2009; Smith, 2011). The structure of the taxonomy encourages viewing learning as an on-going process, moving from simple recall of facts towards a deeper understanding; that learning is a series of interconnected webs that can be built upon and extended. Nückles et al., (2009:261) elaborates:

Cognitive strategies such as organization and elaboration are at the heart of meaningful learning because they enable the learner to organize learning into a coherent structure and integrate new information with existing knowledge, thereby enabling deep understanding and long-term retention.

This would help to develop Smith’s (2011:92) ‘self-regulating, self-evaluating learners who were well motivated by learning.’

 A range of SOLO based techniques exist to assist teachers and students. Use of constructive alignment (Biggs & Tang, 2009) encourages teachers to be more explicit when creating learning objectives, focusing on what the student should be able to do and at which level. This is essential for a student to make progress and allows for the creation of rubrics, for use in class (Black & Wiliam, 2009; Nückles et al., 2009; Huang, 2012), to make the process explicit to the student. Use of HOT (Higher Order Thinking) maps (Hook & Mills, 2011) can be used in English to scaffold in depth discussion, encouraging students to:

Develop interpretations, use research and critical thinking effectively to develop their own answers, and write essays that engage with the critical conversation of the field (Linkon, 2005:247, cited in Allen, 2011).

It may also be helpful in providing a range of techniques for differentiated learning (Anderson, 2007; Hook & Mills, 2012).

 The SOLO taxonomy has a number of proponents. Hook & Mills (2011:5) refer to it as ‘a model of learning outcomes that helps schools develop a common understanding’. Moseley et al. (2005:306) advocates its use as a ‘framework for developing the quality of assessment’ citing that it is ‘easily communicable to students’. Hattie (2012:54), in his wide ranging investigation into effective teaching and ‘visible learning’, outlines three levels of understanding: surface, deep and conceptual. He indicates that:

The most powerful model for understanding these three levels and integrating them into learning intentions and success criteria is the SOLO model.

 However, the taxonomy is not without detractors; Chick (1998:20) believes that ‘there is potential to misjudge the level of functioning’ and Chan et al. (2002:512) criticises its ‘conceptual ambiguity’ stating that the ‘categorization’ is ‘unstable’. In these two studies, the SOLO taxonomy was used primarily for assessing completed work, so use throughout the teaching process may mitigate these issues.

 An additional criticism, in particular when the taxonomy is compared with that of Bloom (1956), is the SOLO taxonomy’s structure. Biggs & Collis (1991) refers to the structure as a hierarchy, as does Moseley et al. (2005); naturally, there are concerns when complex processes, such as human thought, are categorized in this manner. However, Campbell et al. (1992) explained the structure of the SOLO taxonomy as consisting as a series of cycles (especially between the Unistructural, Multistructural and Relational levels), which would allow for a development of breadth of knowledge as well as depth.

Allen, I. J., (2011) ‘Reprivileging reading: The negotiation of uncertainty’. Pedagogy: Critical Approaches to Teaching Literature, Language, Composition, and Culture, 12 (1) pp. 97–120. Available at: http://pedagogy.dukejournals.org/cgi/doi/10.1215/15314200-1416540 [Accessed March 26, 2013].

Anderson, K. M., (2007) ‘Differentiating instruction to include all students’. Preventing School Failure, 51 (3) pp. 49–54.

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2000) A Taxonomy for Learning, Teaching, and Assessing: A revision of Bloom’s Taxonomy of educational objectives. New York: Pearson, Allyn & Bacon.

Biggs, J. & Tang, C. (2009) ‘Applying constructive alignment to outcomes-based teaching and learning.’ Training Material. “Quality Teaching for Learning in Higher Education” Workshop for Master Trainers.  Ministry of Higher Education. Kuala Lumpur. 2010. http://drjj.uitm.edu.my/DRJJ/MQAGGPAS-Apr2011/What-is-CA-biggs-tang.pdf [accessed 19 August 2012]

Biggs, J. B. and Collis, K. F. (1982) Evaluating the Quality of Learning: the SOLO taxonomy. New York, Academic Press

Biggs, J. B., & Collis, K .F. (1991) ‘Multimodal learning and the quality of intelligent behaviour’. In: H. Rowe (Ed.) Intelligence: Reconceptualization and measurement.  Hillsdale, NJ.:  Lawrence Erlbaum. pp. 57-75.

Black, P. & Wiliam, D., 2009 ‘Developing the theory of formative assessment’ J. Gardiner, ed. Educational Assessment Evaluation and Accountability, 1 (1), pp. 5–31. Available at: http://eprints.ioe.ac.uk/1119/. [accessed 23 August 2012]

Bloom, B. S. (1956) Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.

Campbell, K. J., Watson, J. M., & Collis, K. F. (1992) ‘Volume measurement and intellectual development’. Journal of Structural Learning. 11  pp. 279-298.

Chan, C.C., Tsui, M.S. & Chan, M.Y.C., 2002 ‘Applying the Structure of the Observed Learning Outcomes ( SOLO ) taxonomy on student’s learning outcomes : an empirical study’. Assessment and Evaluation in Higher Education 27 (6) pp. 511-527

Chick, H. (1998) ‘Cognition in the Formal Modes: Research mathematics and the SOLO taxonomy’. Mathematics Education Research Journal. 10 (2) pp. 4-26

Hattie, J. (2003) Teachers make a difference: what is the research evidence? Melbourne: Australian Council for Educational Research

Hattie, J. (2009) Visible Learning. New York: Routledge

Hattie, J. (2012) Visible Learning for Teachers: Maximizing Impact on Learning. Abingdon: Routledge

Hattie, J. & Brown, G. (2004) ‘Cognitive processes in asTTle: The SOLO taxonomy.’ University of Auckland/Ministry of Education. asTTle Technical Report 43. http://e-asttle.tki.org.nz/content/download/1499/6030/version/1/file/43.+The+SOLO+taxonomy+2004.pdf [accessed 6 March 2013]

Hook, P. & Mills, J. (2011) SOLO Taxonomy: A Guide for Schools Book 1: A common language of learning. Laughton, UK: Essential Resources Educational Publishers

Huang, S.-C. (2012) ‘Like a bell responding to a striker: Instruction contingent on assessment’. English Teaching: Practice and Critique 11 (4), pp. 99–119.

Moseley, D., Baumfield, V., Elliott, J., Gregson, M., Higgins, S., Miller, J., & Newton, D. (2005) Frameworks for Thinking: A handbook for teaching and learning. Cambridge: Cambridge University Press

Nückles, M., Hübner, S. & Renkl, A. (2009) ‘Enhancing self-regulated learning by writing learning protocols’. Learning and Instruction, 19(3), pp.259–271. Available at: http://linkinghub.elsevier.com/retrieve/pii/S0959475208000558 [Accessed March 26, 2013].

Smith, A. (2011) High Performers: The Secrets of Successful Schools. Camarthen: Crown House Publishing

Smith, T.W. & Colby, S.A. (2007) ‘Teaching for Deep Learning.’ The Clearing House.  80 (5) pp. 205–211.

Sugrue, B. (2002) ‘Problems with Bloom’s Taxonomy.’ http://eppicinc.files.wordpress.com/2011/08/sugrue_bloom_critique_perfxprs.pdf [accessed 2 May 2013]

Why Research SOLO Taxonomy?

This is the first in a series of blog posts based on my MA research into the use of the SOLO (Structure of Observed Learning Outcomes) taxonomy in English. I hope that  what I write proves useful and not just for English teachers.

A reasonably obvious starting point is: why did I choose to research the SOLO taxonomy?

A quick glance at the TES or Twitter will reveal that teachers are under pressure. The need to achieve year on year improvements in results, as well as a dearth of time available, means that it is not surprising that many teachers are looking for a ‘magic bullet’– something that is effective and involves little additional work. The danger is that schools and teachers are not appropriately critical when selecting and promoting techniques in the rush to achieve the desired results.

Over the past few years a range of different ideas (e.g. Brain Gym, VAK, de Bono’s Thinking Hats) have been promoted in schools, often supported by ‘a thriving commercial industry’ (Coffield et al., 2004:118). While some of these offer useful techniques which can easily be incorporated into the teachers’ everyday lesson, others can become overly burdensome without empirical evidence that the technique actually works (Harrison et al., 2003; Krätzig & Arbuthnott, 2006). Key here is the fact that, while scientific research may indicate a result as suggestive, all too often the results are distorted or overstated (Swaffield, 2009).

How many of us have sat through a CPD session run by an expensive expert, or an enthusiastic member of SLT, and questioned whether it is actually worthwhile? How many have spoken up to challenge ideas that we know are not proven, or (often more likely) sat squirming and wishing that we had the nerve to speak up? In budget conscious and results-driven schools, staff buying into ineffective techniques and strategies (physically and metaphorically) can drain money from where it is most needed.

It is, however, important that teachers are proactive in trialling and using techniques which they believe may be of benefit. Levin (2010:90) explains:

If data from students could be linked to changes known to be effective – for example, improved assessment practices or greater student choice in assignments – we might start to see some lasting and worthwhile changes in the way students experience our high schools.

It was with this in mind that I became cautiously interested when discussions  on Twitter mentioned something called the SOLO (Structure of Observed Learning Outcomes) Taxonomy. Initially, it was mentioned by a small number of UK based teachers who provided more detailed examples on their blogs (Tait Coles, David Didau, Lisa Ashes).

While willing to try new teaching ideas, the key question for me is: what evidence is there that this works? A brief search of academic journals (via the wonderful Google Scholar) identified a number of articles, mostly focusing on the use of the SOLO taxonomy in geography, science or at university level (Munowenyu, 2007; Biggs & Tang, 2009; Brabrand & Dahl, 2009; Prakash et al., 2010).

I was also aware that the use of the SOLO taxonomy was widespread in New Zealand (Hattie & Brown, 2004), being linked to assessment and curriculum models, and through a number of New Zealand Tweachers’ contributions to Twitter discussions. However, it became clear that there was very little research on its use in the UK education system, and little available on its use in teaching English literature beyond blog posts and anecdotes. I therefore decided to try a relatively simple technique – the use of hexagons to link ideas. The results from this initial foray were genuinely surprising, however, could easily have been a fortuitous coincidence. Therefore, I decided to base my study on the effectiveness of the SOLO taxonomy in GCSE English Literature. I hoped to be able to demonstrate whether or not the SOLO taxonomy was effective in improving student results and clarify whether this technique was worth adopting at departmental level and beyond.

References:

Biggs, J. & Tang, C. (2009) ‘Applying constructive alignment to outcomes-based teaching and learning.’ Training Material. “Quality Teaching for Learning in Higher Education” Workshop for Master Trainers.  Ministry of Higher Education. Kuala Lumpur. 2010. http://drjj.uitm.edu.my/DRJJ/MQAGGPAS-Apr2011/What-is-CA-biggs-tang.pdf [accessed 19 August 2012]

Brabrand, C. & Dahl, B., (2009) ‘Using the SOLO taxonomy to analyze competence progression of university science curricula.’ Higher Education, 58 (4) pp. 531–549.

Coffield, F., Moseley, D., Hall, E., & Ecclestone, K. (2004) ‘Learning  styles and pedagogy in post-16 learning: A systematic and critical review.’ Learning and Skills Research Centre. Report No. 041543.

Harrison, G., Andrews, J., & Saklofske, D. (2003) ‘Current perspectives on cognitive learning styles.’ Education Canada. 43 (2) pp. 44-47

Hattie, J. & Brown, G. (2004) ‘Cognitive processes in asTTle: The SOLO taxonomy.’ University of Auckland/Ministry of Education. asTTle Technical Report 43. http://e-asttle.tki.org.nz/content/download/1499/6030/version/1/file/43.+The+SOLO+taxonomy+2004.pdf [accessed 6 March 2013]

Krätzig, G. & Arbuthnott, K. (2006) ‘Perceptual learning style and learning proficiency: a test of the hypothesis.’  Journal of Educational Psychology. 98 (1) pp. 238-246.

Levin, B. (2010) ‘What did you do at school today?’ Kappan. 91 (5) pp. 89-90. http://www.education.auckland.ac.nz/webdav/site/education/shared/about/centres/uacel/docs/InCanadaWDYDIST1002lev.pdf [accessed 8 April 2012]

Munowenyu, E. (2007) ‘Assessing the Quality of Essays Using the SOLO Taxonomy: Effects of Field and Classroom-based Experiences by “A” Level Geography Students.’ International Research in Geographical and Environmental Education. 16 (1) pp. 21–43.

Prakash, E. S., Narayan, K. A., & Sethuraman, K. R. (2010) ‘Student perceptions regarding the usefulness of explicit discussion of “Structure of the Observed Learning Outcome” taxonomy.’ Advances in physiology education. 34 (3) pp.145–9. http://www.ncbi.nlm.nih.gov/pubmed/20826769 [accessed 6 March 2013]

Swaffield, S. (2009) ‘The misrepresentation of Assessment for Learning – and the woeful waste of a wonderful opportunity.’ Work in progress paper. AAIA National Conference. Bournemouth. 16-18 September. http://www.educ.cam.ac.uk/centres/lfl/current/papers/swaffield_aaia09.pdf [accessed 30 March 2013]

MA Research into the SOLO Taxonomy – please help

Those of you who follow my Twitter account (@data_fiend) may know that I am conducting some research into the effectiveness of the SOLO taxonomy (Structure of Observed Learning Outcomes)  as part of my MA.

As part of my research I would like to find out the views of teachers. If you have taught using the SOLO taxonomy, even if it is a single lesson, I would be very grateful if you would complete the relevant survey below. it should only take a few minutes at most:

English teachers, please click here to take survey.

Teachers of other subjects, please click here to take survey.

All responses will be anonymous. The collated data will be used as part of my MA in Education and reported on this blog. The use of data will comply with BERA guidelines.

Thank you.

Why Data Use By Teachers is Key

I am a data geek, I make no apologies for the fact that I love a good spreadsheet and tinkering with charts. However, it seems that this is not the case for the majority of teachers. Yes data can be time consuming, it can be confusing and, in some schools, it is jealously guarded by members of SLT who pass out morsels to the waiting staff.

School Use of Data

The use of data in schools can be a contentious issue. Data is generally collected for two main purposes – for internal tracking, monitoring and diagnostic purposes, and for external purposes. Over the past 20 years, data for external consumption has become a focus, not the sole focus, but certainly it has moved into the realm of non-teaching professionals; a shift that makes many teachers uncomfortable. Kelly, et al (2010:4) found that: “staff think it is collected for external accountability purposes, but that it should be collected for internal improvement purposes.”

Parental Choice

One of the key arguments towards schools presenting their data is that it allows parents to make informed decisions about their choice of school. This view has its problems, firstly, ‘choice’ only truly exists in some areas, largely cities where there are a selection of schools with available places. Secondly, as shown by Allen and Burgess (2012), information about how a school has performed in the past is not an accurate indicator of how the school will perform in six years time, and therefore there is still a high amount of guesswork.

DfE School Performance Tables

The increased level of detail and data in the DfE school performance tables means that, more than ever, staff and managers need to be aware of the data we have in school and how it will be presented in public. This increased focus does not necessarily mean that we need to do things differently as English teachers, but being aware of the additional focus on English and Maths, for pupils of all attainment levels is key.

Although I have issues with league tables and reporting data that might not be fully understood by the consumer, I feel that, in an imperfect world, this measure helps to focus our resources not solely on those who are on the C/D borderline, and if necessary, justifies the inclusion of pupils who would not normally be targeted – not that such justification should be needed, but in these high stake days of A*-C including English and Maths the focus has been skewed – one of Goldstein and Leckie’s (2008:69) “perverse measures”. The continued tracking of these groups means we can check that all pupils are being offered support and that we are doing the best for all groups.

Data, Data Everywhere

One of the difficulties faced by teachers is the fact that the information needed for the department and the individual comes from a variety of different sources, in particular: school systems like SIMs, SISRA, FFT, school, department and individual spreadsheets. It is not surprising that for many this is ovewhealming. This disparate range of sources, and the fact that department spreadsheets often need to be created, is not uncommon in schools. Perhaps this is one of the reasons that data use in schools is not as effective as it might be, as Heads of Subject rarely have sufficient time to source and collate the information, and it takes a well trained administrator, with sufficient time, to be able to keep on top of it. As van Barneveld (2008:2) states: “large –scale assessment data were neither current enough nor aligned adequately with daily instruction”.

It is this gap between the data produced and staff need that makes many teachers reluctant to use or rely upon the available data. “Use of pupil attainment and progress data is widespread across the profession, but least so among classroom teachers” (Kelly, et al. 2010:3).

Why data is important to you

It is easy, as a subject leader, to see the importance of data, in particular lag data, when fulfilling the information needed for SLT meetings and SEFs, it is harder to see it if you are a classroom teacher. But, I want to convince you that knowing how to use data effectively is vital for all teachers.

Firstly, let’s talk pragmatically, what’s in it for you? Staff must feel confident in using data, as the new DfE Standards for Teachers, from September 2012, states that teachers must:

2 – Promote good progress and outcomes by pupils…be accountable for pupils’ attainment, progress and outcomes.

6 – Make accurate and productive use of assessment…use relevant data to monitor progress, set targets, and plan subsequent lessons.

So, based on this, it is the job of all teachers to use and understand data. It will also be very helpful to keep track of the various groups of students you teach. Being able to go into meetings knowing, for example, who your low attainers are, what progress they are making and what you are doing to ensure their progression, will make you feel more confident. What I am not saying is that you need to memorise all of this, that is where having a clear data storage system – be it a mark book or an electronic system – is key.

But, let’s be honest here, yes the standards are important to us as teachers, it forms part of our assessment and ultimately guides the PM process, but, being hit with the big stick of Ofsted is rarely what motivates teachers, and this is not the main reason we should use data. The real reason data is so important to us as teachers is as a tool to diagnose what students need to progress. This is so important, how can a student know where to go with their learning if we can’t give them some specific guidance. There are tool there to help – although APP isn’t statutory and can be a little unwieldy, it does provide a framework for assessing the students current position and guiding them towards improvement. Knowing specifically what your students need to do to improve means that meaningful feedback can be given.

Hattie (2012:16) states that:

The act of teaching requires deliberate interventions to ensure that there is cognitive change in the student; thus the key ingredients are being aware of the learning intentions, knowing when a student is successful in attaining those intentions, having sufficient understanding of the student’s prior understanding as he or she comes to the task and knowing enough about the content to provide meaningful and challenging experiences so that there is some sort of progressive development.

At the core of Hattie’s statement lies the importance for teachers to effectively use a range of data. Teachers need to have a full understanding of the available data in order to plan, teach and assess effectively. Good teachers know their students.

Overall, what has become clear through my research is that it is essential to remember that:

data in itself is insufficient; that it is the interpretation and subsequent use of data that can impact positively on teaching and learning, rather than the data itself (Kirkup, et al. 2005:102).

References

Allen, R. & Burgess, S. (2012) ‘Why The New School League Tables Are Much Better…But Could Be Better Still’ CMPO Viewpoint. http://cmpo.wordpress.com/2012/01/25/why-the-new-school-league-tables-are-much-better-but-could-be-better-still/ [accessed 30/01/12]

Goldstein, H. & Leckie, G. (2008) ‘School League Tables: What Can They Really Tell Us?’ Significance. June 2008 pp. 67-69

Hattie, J. (2012) Visible Learning for Teachers: Maximizing Impact on Learning. Abingdon: Routledge

Kelly, A., Downey, C., Rietdijk, W. (2010) ‘Data dictatorship and data democracy: understanding professional attitudes to the use of pupil performance data in English secondary schools’, CFBT. http://www.cfbt.com/evidenceforeducation/pdf/5417_DataDictatorship_web.pdf [accessed 27/01/2012]

Kirkup, C., Sizmur, J., Sturman, L., Lewis, K. (2005) ‘Schools’ Use of Data in Teaching and Learning’ NFER, http://www.nfer.ac.uk/nfer/publications/SUD01/SUD01_home.cfm?publicationID=161&title=Schools%27%20use%20of%20data%20in%20teaching%20and%20learning [accessed 27/01/2012]

Smith, A. (2011) High Performers: The Secrets of Successful Schools. Camarthen: Crown House Publishing

Van Barneveld, C. (2008) ‘Using Data to Improve Student Achievement’ What Works? Research into Practice. Research Monograph 15. http://www.edu.gov.on.ca/eng/literacynumeracy/inspire/research/whatWorks.html [accessed 27/01/2012]

Intervention Tension

This is the intervention season, the time when teachers, especially of core, headline subjects, (and those with large proportions of coursework) wander around the school looking harried. Where after school sessions are the norm and middle managers seem glued to their laptops and spreadsheets checking up on the progress of little Jonny. It’s what we do at this time of year.

But should it be?

In an ideal world, surely we shouldn’t need to be all this dashing around at the last minute?

While analysing a large cohort for intervention I started thinking about this, prompted by a twitter discussion with @11three and their blog post on school data. Didn’t we have this wrong? Why were we doing this? I know that we want the best outcomes for our young people, but why were we doing it like this? It is not efficient and is reactionary rather than being proactive.

So, how can we be more proactive?

Firstly, we need to analyse who we target each year and why. It is easy to sit back and blame home life, poverty and so on but:

“recent research is consistently revealing academic factors – known as ‘early-warning data’, ‘risk factors’, or ‘on-track measures’ – that more accurately predict whether or not a student is likely to drop out than socioeconomic factors do.” (Pinkus, 2008)

Now although this is talking about the American system, groups of our youngsters have, to all intents and purposes,  dropped out – they merely turn up to school each day. Often we are not surprised by the groups needing intervention, so, if this is the case why are we not targeting them sooner? I’m sure that the list will change from school to school, but I would be willing to bet that those with low KS2 results, poor attendance and SEN make up a fair chunk of any intervention group. This echoes Pinkus’  findings:

“Early-warning signs…an attendance rate of under 80%…’unsatisfactory’ behavior…failing grade in math or English.”

So why wait until now? Why the knee-jerk reaction? The focus needs to be on the causes – but we expend so much energy with this last minute rigmarole that we don’t have the time to consider how it can be avoided, and, by the time the current year is over, we are just so relieved that there is a tendancy to want to  forget all about it until the next year.

We need to identify the pupils who are have the markers earlier in their school career for underachievement and do something about it early. Some strategies for intervention can, of course, be done in departments. But for it to be really effective, there needs to be action and motivation at a whole school level, from the top – and this needs to go beyond having meetings and monitoring staff. How precisely to do this? Well, that’s going to take some thought…