Category Archives: Research

SOLO Taxonomy – a Learner’s Perspective

Some of my most read blog posts have been on the SOLO taxonomy – as a teacher I found it an interesting and useful tool. My small scale research suggested that SOLO was something worth investigating further. This post aims to look at SOLO from a slightly different perspective – that of the learner.

Since September, I have been embarking on a very different educational experience – that of a PhD student. This has been a very different, and at times rather unsettling, experience. As a teacher (I don’t say ‘former teacher’ as I hope to teach again at some time in the future), part of me has been evaluating the process, thinking about the structure of my learning.

One of the most difficult parts of my PhD (so far) is the realisation that there is so much I don’t know. As a student at this level, you like to think that you have some expertise in your subject, that you know ‘stuff’. My topic is 19th Century literature – I have read and taught many of my chosen texts and am pretty confident discussing and writing about them – however, the more I read, the more unsure I become. But, this is normal, it is a key part of the learning process, and this is where I have found the SOLO taxonomy useful.

In my post ‘What is the SOLO taxonomy?’ I highlighted the following:

 An additional criticism, in particular when the taxonomy is compared with that of Bloom (1956), is the SOLO taxonomy’s structure. Biggs & Collis (1991) refers to the structure as a hierarchy, as does Moseley et al. (2005); naturally, there are concerns when complex processes, such as human thought, are categorized in this manner. However, Campbell et al. (1992) explained the structure of the SOLO taxonomy as consisting as a series of cycles (especially between the Unistructural, Multistructural and Relational levels), which would allow for a development of breadth of knowledge as well as depth.

The structure suggested by Campbell et al. is key for learners; learning is not finite, there isn’t a point at which you know ‘everything’. The key to the Extended Abstract level is that, as you look at the topic from different perspectives and consider ‘what if?’, you need to return to the Multistructural and Relational levels in order to make sense of new learning.

For example:

Screen Shot 2015-01-11 at 21.44.52

It is easy, especially in your first year of a PhD to feel that you are somewhat lost, that there are so many things that you don’t know. But that is the point, you need to develop your understanding in a wide range of areas, and spend a large proportion of your time with your head in a book, or journal article.

Rather than being despondent about the amount I have yet to learn, I have tried to think about it using SOLO. In this case I am the observer of my own learning. I need to evaluate my existing position and identify areas for further development.

As with learners at any level, there are some things I have a more detailed knowledge of than others. My knowledge of my chosen literary texts is strong (generally Extended Abstract), my knowledge of R programming is still in its early stages (Multistructural/Relational), my understanding of statistical measures slightly lower again (Multistructural).

This way of viewing my learning has had two main effects: firstly, it has encouraged me to be far more open in my attitude to what I can learn (a growth mindset). Five or ten years ago I would never have believed that I would be taking Computer Science and Statistics modules at university level – nor that I would be enjoying them. I used to say that I was not very good at maths, something of an English teacher cliché, although I didn’t really have any evidence that this was actually the case; now I know that I can learn what I need to.

Secondly, I am far more comfortable with the seemingly disjointed nature of PhD research. It is only disjointed at the moment, as my understanding and knowledge develops links will gradually become apparent – this is a core part of the process, accepting and acknowledging this makes it far less stressful.

I believe that SOLO can be used with students of all levels to self-assess, as well as to enable their teachers to assess and provide feedback. In particular, I feel that it can address two very different problems, how to extend and challenge the most able, and how to encourage and support the weakest. Encouraging pupils to be responsible for their own learning, to be active learners and have a growth mindset can only be a positive step.

 

SOLO Research: Conclusions

What have I learnt from my research into the SOLO taxonomy?

Researching and Note Taking

At a personal level, this research has been very useful. I have found out that I really enjoy research and reading academic articles and texts. In particular, writing the literature review was an interesting, challenging and enjoyable part – far more than I had expected it to be. It was like a giant jigsaw which needed to be put together before it would make sense.

notesI tried out a variety of note taking methods for the review, the most effective one turned out to be writing key quotations onto post its which I then sorted into linked areas on large pieces of paper with lines and comments added to show the relationship. This helped organise each part of the review into paragraphs and made the links clearer to see. It was while I was doing this that I realised that this was also a SOLO task – I was moving my knowledge of the literature from the multistructural to the relational level and beyond. Thinking about the process in this way was quite useful as it mitigated some of the frustration I felt at having to go off on tangents in order to understand the bigger picture – it was simply that I didn’t have the knowledge at the multistructural level.

Twitter, the Internet and The Khan Academy

As someone who completed their undergraduate degree in the early 1990s, studying at Masters level was a very different beast. Beyond the level of complexity that obviously exists in the step up, the key difference I noticed was the availability of resources. Now, don’t get me wrong, I love an academic library – the smell of the books, the chance finds in the stacks, the quiet you only get in the obscure corner of the Old English section on floor 10 – but, as a distance learner, the internet has been invaluable to me.

Twitter has been a fantastic source of ideas, suggestions for academic reports and texts as well as a source of data. Without this community of educators, I think my study would have been a sad shadow, and I would have been a very lonely researcher.

One of the challenges I faced was gaining an understanding of descriptive and comparative statistics. As far as I can remember (and it was a very long time ago, so I may be wrong), this was not covered in much detail in my GCSE Maths course. Although I have used maths on a day to day basis in work and as a teacher, this was something I needed to brush up on – that is where The Khan Academy came in. One weekend watching their statistics videos and trying out a few problems, and I had a good understanding of what I needed.

Is the SOLO Taxonomy Effective?

Based on my limited research, it does appear that the SOLO taxonomy can be a useful tool in a teacher’s arsenal. The use of rubrics to identify the knowledge (both declarative and functioning) and stages of learning were particularly useful for making this explicit both for me and the students. The emphasis on looping back through the multistructural-relational-extended abstract levels in order to develop a more detailed and sophisticated understanding helped scaffold the most able and encouraged them to view learning as open-ended.

Knowledge is vital – without relevant knowledge, students cannot progress through the SOLO levels. Direct instruction, whether it is through teacher talk, rubrics or any other direct method, help to provide the  knowledge needed by the student. The rubric can keep this instruction at the forefront while students complete independent tasks – the two do not have to be mutually exclusive.

A key benefit of the SOLO taxonomy is creating a common language for discussion of knowledge and feedback – used by the teacher and in self and peer assessment it can help to ensure the quality and focus of feedback.

Of the SOLO techniques I trialled with my classes, I felt that the use of rubrics, hexagons and SOLO stations were the most useful. The weaker students found the hexagons helpful to pull together their knowledge of a text and bridge the gap between knowing the text and being able to write a clear paragraph about it. SOLO Stations allowed for differentiation, student choice and teacher guidance while giving me the time to work individually with students. The HOT maps were rather hit or miss depending on which type was used – the Part/Whole Analysis was a useful structure for discussing and revising a text in detail.

Given the recent reports from Sir Michael Wilshaw, regarding the brightest students in schools failing to achieve the highest grades, it is certainly interesting that in this small scale study Level 5 students and males taught using SOLO methods did considerably better than their non-SOLO counterparts. Ev ex 2Although it is impossible to know whether SOLO was the key factor in this difference, it suggests that this may be a possibility and would warrant further investigation.Ev ex 4

 

Taken as a whole, based on my personal observations, surveys of teachers and students, a lesson observation and exam data analysis, it appears that the SOLO taxonomy may be effective. As with any teaching technique, it is not a panacea – however, it is certainly worth trying.

SOLO Research Project – Findings Part 2

Exam Data

In addition to the other data collection methods, I chose to analyse the modular examination results for a group of Year 10 students, one group (n=29) taught using SOLO methods, and a larger group (n=82) who were not.

To try to ensure that, as much as possible, the groups were comparable, I chose students who had started school with either a level 4 or 5 from their Key Stage 2 English tests. The students were all from one of the two parallel top sets. Students who did not have a Key Stage 2 level were excluded from the analysis.

All students in the groups selected took GCSE English Literature exam module A663 (Prose from Different Cultures) in the summer of Year 10 and studied the same text – Of Mice and Men. The results were analysed using descriptive statistics to gain an overview and identify areas where the data warranted a closer look. In areas which appeared to show a difference, a chi-square test was applied to test significance; a significance threshold level of p<0.5 was set to ensure that any significance was meaningful.

Although every attempt was made to make the analysis as unbiased as possible, for example choosing to focus on a module which was externally marked, it is important to remember that looking:

At results before and after a new intervention is rolled out…can be very misleading, as other factors may have changed at the same time. (Goldacre, 2013:9)

 

In addition, as the group selection was not randomized, or carried out over a longer period of time, the results may not be replicable, although I feel that they may provide some indications for areas which would be worth investigating further.

Analysis

The non-SOLO group shows normal distribution with a modal grade of a B. The SOLO group also shows a relatively normal distribution, which is less steep than the non-SOLO group. Ev ex 1 The tail at the higher end of the SOLO group does not drop off to the extreme of the non-SOLO group. The modal grade for the SOLO group is one grade higher, an A grade.

Comparing the results of the combined level 4 and 5 students between the SOLO and Non-SOLO groups, using a chi-square test, suggests that the probability of this distribution happening by chance is 4%; a significant result. These results suggest that, based on this limited study, SOLO may have a positive impact on exam achievement.

To identify whether this impact can be pinpointed, the data was explored in subsets according to level and gender.

Exploring the subset data, it is apparent that, in this sample, the SOLO group females did not achieve significantly different grades to the non-SOLO group. 

When comparing the difference between the level 4 students, the difference is significant. Ev ex 3

However, it is when comparing the achievement of students starting school on a level 5  and male groups that a very highly significant difference is evident.

Ev ex 2

Comparing the results of the students entering school with a level 5, using a chi-square test, suggests that the probability of this distribution happening by chance is 0%; a very highly significant result.Ev ex 4

As suggested by the graph there is a significant difference between the achievements of the two male groups. Looking at this distribution, using a chi-square test suggests that this distribution (p=0.0000) is very highly significant.

Although there are limitations to this particular aspect of the study, the results suggest that SOLO techniques may have a measurable impact on student exam results. Therefore, it would certainly be worth further, structured research.

SOLO Research Project – Findings Part 1

Overview of the Project

As the project was to investigate an aspect of my teaching practice, I chose to use an action research approach. Alongside this, and the literature review, I also carried out a small scale survey of students involved and a slightly larger scale survey of teachers. The final part of the project was an analysis of exam results (I will go through the findings of the exam analysis in another post).

Throughout the action research I completed a series of blog posts outlining my experiments with three separate SOLO techniques: use of hexagons, use of HOT maps and the use of rubrics and SOLO stations. Within each entry I tried to outline the techniques used and comment on my perception of their effectiveness. Newbury (2001:3) describes the ‘research diary’ as:

A form through which the interaction of subjective and objective aspects of doing research can be openly acknowledged and brought into a productive relationship.

I felt that, as one of the criticisms of the action research model was that results were often restricted to the teacher carrying out the research, it would be helpful if I shared my experiences with other teachers via a blog. As Weston (2012) states in his blog post:

Researchers need to develop a culture where findings are not simply broadcast to schools, but where they engage with increasing numbers of schools to find out how to successfully adapt the approach in different contexts, how to overcome different challenges, and how to successfully combine the idea with other priorities in the classroom.

My observations focused mostly on Year 10 classes, although I also trialled SOLO based activities with Year 11 and Year 12. Classes were chosen using convenience sampling.

Any personal commentary, especially reflecting on one’s own teaching, is subject to bias, as Gavron (1996:159, cited in Biggam, 2011) notes:

It is difficult to see how this can be avoided completely, but awareness of the problem plus constant self-control can help.

 I have endeavoured to keep this in mind through my analysis, and chosen to use data from a range of different sources to mitigate any unconscious bias. In addition, although convenience sampling is not ideal, as the sample size is relatively small and the groups were not chosen at random, this is acceptable for action research.

My Observations

The blog posts on each of the techniques can be found here:
Hexagons – 1, 2, 3, 4
HOT Maps – 1, 2,

SOLO Stations – 1, 2, 3,4

Overall, I felt that the techniques had been useful in conjunction with existing teaching methods. The use of the rubric to specify key elements of the knowledge being taught was particularly helpful for structuring feedback with clear next steps. I will expand on this in my final post (Conclusions).

Student and Teacher Surveys

Unfortunately, the number of students who took part in the survey was small (partly as my time ended up being rather cut short due to my relocation). However, on the whole, the students found the SOLO lessons useful and felt that they had helped them develop their knowledge of the text and how to present their responses more clearly.

In March, I asked for volunteers to complete a short questionnaire about using the SOLO taxonomy in lessons as part of my MA. I was overwhelmed that so many readers took the time to complete the survey – 60 of you in total! Thank you so much for your help.

Evidence 1aThe majority of teachers who responded felt that SOLO techniques were effective and based this belief on a range of indicators, not simply personal observation.

Evidence 1The most popular techniques were, perhaps unsurprisingly, those which have had the most coverage in blogs and are the most straightforward to implement.

Evidence 2My final questions asked which subject the teachers taught and how long they had been teaching. Teachers from a wide range of subjects took part, from science to history, from PE to English – suggesting that SOLO techniques have the potential to be used effectively across the curriculum.

Evidence 3 The findings of this survey certainly suggest that teachers with 6 or more years teaching experience are using social networking and experimenting with new techniques. Now I am not saying that those who have been teaching longer are ‘better’ than those just entering the profession. This is more to do with – the difference between ‘experienced’ and ‘expert’ teachers. Effective, expert teachers are prepared to experiment, and adapt their teaching, not because Ofsted or SMT want it, but because they have decided that it would be beneficial to their students.

SOLO, Learning and Teaching

For educators, there is a need to identify how they can best help students to achieve their potential. School makes up a significant part of students’ young lives, so it is unsurprising that:

Schools shape and change beliefs, both as purveyors of knowledge and as epistemological training grounds for developing students. (Schraw, 2001:406)

The challenge is to balance the imparting of knowledge with providing students with opportunities to develop positive epistemological beliefs. New initiatives often focus on the former, specifically teaching methods, possibly because this is an easier area to demonstrate impact. As Hattie (2012) notes, most of what we do as teachers will have some effect on the students we teach.

OfSTED’s (2012/13b:32) definition of an ‘Outstanding’ school highlights the importance of students ‘making and exceeding expected progress’, whatever their starting point. To achieve this, schools need to know what causes variance between students, both between schools and between students in the same school. Hattie (2003) identifies several elements which are responsible for potential variance in achievement. The most significant factor identified was the student themselves, being responsible for 50% of variance. Student engagement, beliefs and motivation is at the heart of the matter.

Levin (2010:89) explains that:

Schools with higher levels of engagement are more successful with students from all kinds of backgrounds.

This supports Hattie’s (2003) findings that home is less significant an influence than perhaps we might expect.

The second most significant influence was the teacher (30%):

It is what teachers know, do and care about which is very powerful in this learning equation. (Hattie, 2003:2)

However, Schraw (2001:406 summarises a key difficulty with addressing the issue:

The existing research invites the conclusion that schools should make the effort to change beliefs in positive ways, although it is less clear how those changes should occur.

Hattie’s work (2003, 2012) may give us an indication of how these changes should be approached; if both students and teachers are responsible for 80% of the variance between student outcomes, it is here that the focus needs to be. Ideally, a focus on techniques and strategies which encourage teachers to teach in the most effective manner, while encouraging students to learn and develop positive epistemological beliefs.

Students’ Learning

To understand how students learn effectively, it is useful to be aware of a number of key areas. Firstly, how do epistemological beliefs affect learning? And secondly, which specific traits does an effective learner have?

 Hofer & Pintrich (1997:88) define personal epistemology as:

How individuals come to know, the theories and beliefs they hold about knowing, and the manner in which such epistemological premises are a part of and an influence on the cognitive processes of thinking and reasoning.

Resent research into students’ beliefs about learning (Pintrich, 2002; Cano & Cardelle-Elawar, 2004; Dweck, 2006; Barnard et al., 2008; Afflerbach et al., 2013) have highlighted the link between how students view learning and their academic performance. Cano & Cardelle-Elawar (2004:182) suggesting that:

The evidence that secondary school students hold immature beliefs…might go some way to explaining the poor academic achievement of many students.

As teachers, we often see this manifested as a willingness to give up when challenged, reluctance to work hard for results and the belief that they are either ‘good’ or ‘bad’ at a particular subject. I know that, in the past, I have been guilty of this, especially with Maths – in reality, I’m not actually bad at Maths, I just find it harder.

However, Louca et al. (2004:58) assert, in their study of teaching science to 3rd grade students, that students are not aware of these ‘beliefs of theories’, but instead ‘have a range of cognitive resources for understanding knowledge’. With many schools implementing ‘learning to learn’ schemes, students are now more likely to have an awareness of how they learn. At the heart of this awareness, there needs to be the belief that learning is complex and requires effort.

An effective student needs to develop a wide range of skills and attributes:

Learning at school requires students to pay attention, to observe, to memorize, to understand, to set goals and to assume responsibility for their own learning. These cognitive activities are not possible without the active involvement and engagement of the learner. (Vosniadou, 2001:8)

The emphasis, for effective learning and progress to take place, is on the need for students to be self-regulated (Barnard et al., 2008; Nückles et al., 2009; Afflerbach et al., 2013) and for students to have some control over their learning (Skinner et al., 1998, cited in Yeh, 2010; Vosniadou, 2001; Zull, 2002).

What Makes a Teacher Effective?

Researchers and policymakers have often tried to define what makes an effective teacher; however arriving at a definition can be fraught with difficulties. Shulman (1987:6) notes that these definitions often ‘became items on tests or on classroom-observation scales’ which ultimately end up as a restrictive check-list. Levin (2010:90) points out that, proposals for improving teaching ‘have been made many times before’ and that merely listing suggestions is not enough – we need concrete examples of how this might be achieved.

Although our knowledge of how the brain works has developed over the past century, the topic can be a contentious one. Information processing, ‘the mental operations that come between a stimulus and response’ (Malim & Birch, 2005:25), is at the centre of discussion between cognitive psychologists, especially when related to student learning (Vygotsky, 1978 cited in Vosniadou, 2001; Kolb, 1984; Baddeley, 1999; Bischoff & Anderson, 2001; Tsai & Huang, 2001). Kirschner et al. (2006:77) highlight the importance of an understanding of the brain’s processes:

Any instructional theory that ignores the limits of working memory when dealing with novel information, or ignores the disappearance of those limits when dealing with familiar information, is unlikely to be effective.

 As a result of the complexities, and lack of a definitive explanation of how the brain works, there have been disagreements between academics as to the best mode of instruction, in particular between project based learning and direct instruction (Bishoff & Anderson, 2001; Wallace & Louden, 2003; Gauthier & Dembélé, 2004; Zull, 2002; Wu & Tsai, 2005; Kirschner et al., 2006; Hmelo-Silver et al., 2007; Granger et al., 2012; Hodges, 2012). These discussions can become polarised, while the most effective teaching is likely to judiciously use elements from both modes.

However, there also appear to be several areas of agreement; Hattie (2012:16) states that:

The act of teaching requires deliberate interventions to ensure that there is cognitive change in the student; thus the key ingredients are being aware of the learning intentions, knowing when a student is successful in attaining those intentions, having sufficient understanding of the student’s prior understanding as he or she comes to the task and knowing enough about the content to provide meaningful and challenging experiences so that there is some sort of progressive development.

This suggests that an in depth knowledge of the students is one of the hallmarks of an effective teacher. In addition, we can add: high expectations (Levin, 2010; OfSTED, 2012), formative assessment (Black & Wiliam, 2006), differentiation (Hattie, 2003; Yeh, 2010; Hook & Mills, 2012; OfSTED, 2012) and feedback (Hattie, 2003, 2012; Black & Wiliam, 2006; OfSTED, 2012). The SOLO taxonomy can offer teachers a structure for implementing these skills in conjunction with the teacher’s existing strategies.

References:

Afflerbach, P., Cho, B-Y., Kim, J-Y., Crassas, M., & Doyle, B. (2013) ‘Reading: What else matters besides strategies and skills?’ The Reading Teacher, 66 (6), pp. 440–448. Available at: http://doi.wiley.com/10.1002/TRTR.1146 [Accessed March 2, 2013].

Baddeley, A. D. (1999) Essentials of Human Memory. Hove: Psychology Press

Barnard, L., Lan, W., Crooks, S., & Paton, V. (2008) ‘The relationship between epistemological beliefs and self-regulated learning skills in the online course environment’. MERLOT Journal of Online Learning and Teaching 4 (3) pp. 261-266

Bischoff, P.J. & Anderson, O.R. (2001) ‘Development of knowledge frameworks and higher order cognitive operations among secondary school students who studied a unit on ecology’. Journal of Biological Education 35 (2), pp. 81-88.

Black, P. & Wiliam, D., 2009 ‘Developing the theory of formative assessment’ J. Gardiner, ed. Educational Assessment Evaluation and Accountability, 1 (1), pp. 5–31. Available at: http://eprints.ioe.ac.uk/1119/. [accessed 23 August 2012]

Cano, F. & Cardelle-Elawar, M. (2004) ‘An integrated analysis of secondary school student’s conceptions and beliefs about learning’. European Journal of Psychology of Education 19 (2) pp. 167-187.

Dweck, C. (2006) Mindset: The New Psychology of Success. New York: Random House.

Gauthier, C. & Dembélé, M. (2004) ‘Quality of teaching and quality of education: a review of research findings. UNESCO. Education for All Global Monitoring Report. 2005/ED/EFA/MRT/PI/18

Granger, E. M., Bevis, T. H., Saka, Y., Southerland, S. A., Sampson, V., & Tate, R. L. (2012) ‘The efficacy of student-centered instruction in supporting science learning’. Science (New York, N.Y.), 338 (6103), pp. 105–8. Available at: http://www.ncbi.nlm.nih.gov/pubmed/23042893 [Accessed March 11, 2013].

Hattie, J. (2003) Teachers make a difference: what is the research evidence? Melbourne: Australian Council for Educational Research

Hattie, J. (2012) Visible Learning for Teachers: Maximizing Impact on Learning. Abingdon: Routledge

Hmelo-Silver, C. E., Duncan, R.G. & Chinn, C. A. (2007) ‘Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark (2006)’. Educational Psychologist  42 (2) pp. 99–107. Available at: http://www.tandfonline.com/doi/abs/10.1080/00461520701263368.

Hodges, G. C., (2012) ‘Research and the teaching of English: Spaces where reading histories meet’. English Teaching: Practice and Critique 11 (1), pp. 7–25.

Hofer, B., & Pintrich, P. (1997) ‘The development of epistemological theories: Beliefs about knowledge and knowing and their relation to learning’. Review of Educational Research 67 (1) pp. 88-140.

Hook, P. & Mills, J. (2012) SOLO Taxonomy: A Guide for Schools Book 2: Planning for differentiation. Laughton, UK: Essential Resources Educational Publishers

Kirschner, P.A., Sweller, J. & Clark, R.E. (2006) ‘Work : An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching’. Learning  41 (2), pp. 75–86. Available at: http://www.informaworld.com/openurl?genre=article&doi=10.1207/s15326985ep4102_1&magic=crossref.

Kolb, D. A. (1984) Experiential Learning: experience as the source of learning and development. New Jersey: Prentice-Hall

Levin, B. (2010) ‘What did you do at school today?’ Kappan. 91 (5) pp. 89-90. http://www.education.auckland.ac.nz/webdav/site/education/shared/about/centres/uacel/docs/InCanadaWDYDIST1002lev.pdf [accessed 8 April 2012]

 Louca, L., Elby, A., Hammer, D., & Kagey, T. (2004) ‘Epistemological resources: Applying a new epistemological framework to science instruction’. Educational Psychologist 39 (1) pp. 57-68.

Malim, T., & Birch, A. (2005) Introductory Psychology. Baisingstoke: Palgrave Macmillan

OfSTED (2012/13a) The framework for school inspection. HMI 120100. London: OfSTED publications.  http://www.ofsted.gov.uk/resources/framework-for-school-inspection [accessed 15 April 2013]

OfSTED (2012/13b) School Inspection Handbook. HMI 120101. London: OfSTED publications.  http://www.ofsted.gov.uk/resources/school-inspection-handbook  [accessed 15 April 2013]

Pintrich, P. (2002) Future challenges and directions for theory and research on personal epistemology. In B. Hofer and P. Pintrich (Eds.), Personal epistemology: The psychology of beliefs about knowledge and knowing (pp.389-414). Mahwah, New Jersey: Lawrence Erlbaum Associates.

Schraw, G. (2001) ‘Current themes and future directions in epistemological research: A commentary.’ Educational Psychology Review. 13 (4) pp. 451-464.

Shulman, L.S., (1987) ‘Knowledge and Teaching: Foundations of the New Reform’. Harvard Educational Review, 57 (1), pp. 1–21.

Tsai, C-C. and Huang, C-M. (2001) ‘Development of cognitive structures and information processing strategies of elementary school students learning about biological reproduction’. Journal of Biological Education 36 (1) pp. 21-26.

Vosniadou, S. (2001) How Children Learn. UNESCO. Educational Practices Series 7. http://www.ibe.unesco.org/fileadmin/user_upload/archive/publications/EducationalPracticesSeriesPdf/prac07e.pdf [accessed 12 December 2012]

Wallace, J. & Louden, W. (2003) ‘What we don’t understand about teaching for understanding: questions from science education’, Journal of Curriculum Studies, 35, 5 pp. 545-566

Wu, Y-T. and Tsai, C-C. (2005) ‘Effect of Constructivist Oriented Instruction on Elementary School Students’ Cognitive Structures’. Journal of Biological Education 39 (3), pp. 113-119.

Yeh, S. (2010) ‘Understanding and addressing the achievement gap through individualized instruction and formative assessment.’ Assessment in Education: Principles, Policy & Practice 17 (2) pp. 169-182

Zull, J. (2002). The Art of Changing the Brain: Enriching the Practice of Teaching by Exploring the Biology of Learning. USA: Stylus Publishing.

What is the SOLO Taxonomy?

Learning taxonomies and frameworks are researchers’ and theorists’ attempts to categorise and explain learning (Bloom, 1956; Anderson, et al., 2000; Moseley, et al., 2005). These frameworks help teachers gain an insight into how students think and learn, however, due to the complexities of the human brain, they can only be used as a guideline. As our knowledge of the human mind develops, so will the frameworks used to explain the structure of thinking and learning.

In education, Bloom’s (1956) taxonomy, in its original form and as updated by Anderson et al. (2000), is probably the most familiar, examination questions often follow the hierarchy. However, it is not without its problems. Sugrue (2002:1) points out that the original taxonomy ‘was developed before we understood the cognitive processes involved in learning and performance’, and criticises the ‘consistency’ with which it can be applied. Teachers can avoid these problems through an awareness of alternative taxonomies, for example the SOLO taxonomy (Hattie & Brown, 2004).

SOLO (the Structure of the Observed Learning Outcomes) taxonomy was first introduced by Biggs & Collis in their 1982 study. The SOLO taxonomy maps the complexity of a student’s work by linking it to one of five phases:  little or no understanding (Prestructural), through a simple and then more developed grasp of the topic (Unistructural and Multistructural), to the ability to link the ideas and elements of a task together (Relational) and finally (Extended Abstract) to understand the topic for themselves, possibly going beyond the initial scope of the task (Biggs & Collis, 1982; Hattie & Brown, 2004). In their later research into multimodal learning, Biggs & Collis noted that there was an ‘increase in the structural complexity of their [the students’] responses’ (1991:64).

It may be useful to view the SOLO taxonomy as an integrated strategy, to be used in lesson design, in task guidance and formative and summative assessment (Smith & Colby, 2007; Black & Wiliam, 2009; Hattie, 2009; Smith, 2011). The structure of the taxonomy encourages viewing learning as an on-going process, moving from simple recall of facts towards a deeper understanding; that learning is a series of interconnected webs that can be built upon and extended. Nückles et al., (2009:261) elaborates:

Cognitive strategies such as organization and elaboration are at the heart of meaningful learning because they enable the learner to organize learning into a coherent structure and integrate new information with existing knowledge, thereby enabling deep understanding and long-term retention.

This would help to develop Smith’s (2011:92) ‘self-regulating, self-evaluating learners who were well motivated by learning.’

 A range of SOLO based techniques exist to assist teachers and students. Use of constructive alignment (Biggs & Tang, 2009) encourages teachers to be more explicit when creating learning objectives, focusing on what the student should be able to do and at which level. This is essential for a student to make progress and allows for the creation of rubrics, for use in class (Black & Wiliam, 2009; Nückles et al., 2009; Huang, 2012), to make the process explicit to the student. Use of HOT (Higher Order Thinking) maps (Hook & Mills, 2011) can be used in English to scaffold in depth discussion, encouraging students to:

Develop interpretations, use research and critical thinking effectively to develop their own answers, and write essays that engage with the critical conversation of the field (Linkon, 2005:247, cited in Allen, 2011).

It may also be helpful in providing a range of techniques for differentiated learning (Anderson, 2007; Hook & Mills, 2012).

 The SOLO taxonomy has a number of proponents. Hook & Mills (2011:5) refer to it as ‘a model of learning outcomes that helps schools develop a common understanding’. Moseley et al. (2005:306) advocates its use as a ‘framework for developing the quality of assessment’ citing that it is ‘easily communicable to students’. Hattie (2012:54), in his wide ranging investigation into effective teaching and ‘visible learning’, outlines three levels of understanding: surface, deep and conceptual. He indicates that:

The most powerful model for understanding these three levels and integrating them into learning intentions and success criteria is the SOLO model.

 However, the taxonomy is not without detractors; Chick (1998:20) believes that ‘there is potential to misjudge the level of functioning’ and Chan et al. (2002:512) criticises its ‘conceptual ambiguity’ stating that the ‘categorization’ is ‘unstable’. In these two studies, the SOLO taxonomy was used primarily for assessing completed work, so use throughout the teaching process may mitigate these issues.

 An additional criticism, in particular when the taxonomy is compared with that of Bloom (1956), is the SOLO taxonomy’s structure. Biggs & Collis (1991) refers to the structure as a hierarchy, as does Moseley et al. (2005); naturally, there are concerns when complex processes, such as human thought, are categorized in this manner. However, Campbell et al. (1992) explained the structure of the SOLO taxonomy as consisting as a series of cycles (especially between the Unistructural, Multistructural and Relational levels), which would allow for a development of breadth of knowledge as well as depth.

Allen, I. J., (2011) ‘Reprivileging reading: The negotiation of uncertainty’. Pedagogy: Critical Approaches to Teaching Literature, Language, Composition, and Culture, 12 (1) pp. 97–120. Available at: http://pedagogy.dukejournals.org/cgi/doi/10.1215/15314200-1416540 [Accessed March 26, 2013].

Anderson, K. M., (2007) ‘Differentiating instruction to include all students’. Preventing School Failure, 51 (3) pp. 49–54.

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2000) A Taxonomy for Learning, Teaching, and Assessing: A revision of Bloom’s Taxonomy of educational objectives. New York: Pearson, Allyn & Bacon.

Biggs, J. & Tang, C. (2009) ‘Applying constructive alignment to outcomes-based teaching and learning.’ Training Material. “Quality Teaching for Learning in Higher Education” Workshop for Master Trainers.  Ministry of Higher Education. Kuala Lumpur. 2010. http://drjj.uitm.edu.my/DRJJ/MQAGGPAS-Apr2011/What-is-CA-biggs-tang.pdf [accessed 19 August 2012]

Biggs, J. B. and Collis, K. F. (1982) Evaluating the Quality of Learning: the SOLO taxonomy. New York, Academic Press

Biggs, J. B., & Collis, K .F. (1991) ‘Multimodal learning and the quality of intelligent behaviour’. In: H. Rowe (Ed.) Intelligence: Reconceptualization and measurement.  Hillsdale, NJ.:  Lawrence Erlbaum. pp. 57-75.

Black, P. & Wiliam, D., 2009 ‘Developing the theory of formative assessment’ J. Gardiner, ed. Educational Assessment Evaluation and Accountability, 1 (1), pp. 5–31. Available at: http://eprints.ioe.ac.uk/1119/. [accessed 23 August 2012]

Bloom, B. S. (1956) Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.

Campbell, K. J., Watson, J. M., & Collis, K. F. (1992) ‘Volume measurement and intellectual development’. Journal of Structural Learning. 11  pp. 279-298.

Chan, C.C., Tsui, M.S. & Chan, M.Y.C., 2002 ‘Applying the Structure of the Observed Learning Outcomes ( SOLO ) taxonomy on student’s learning outcomes : an empirical study’. Assessment and Evaluation in Higher Education 27 (6) pp. 511-527

Chick, H. (1998) ‘Cognition in the Formal Modes: Research mathematics and the SOLO taxonomy’. Mathematics Education Research Journal. 10 (2) pp. 4-26

Hattie, J. (2003) Teachers make a difference: what is the research evidence? Melbourne: Australian Council for Educational Research

Hattie, J. (2009) Visible Learning. New York: Routledge

Hattie, J. (2012) Visible Learning for Teachers: Maximizing Impact on Learning. Abingdon: Routledge

Hattie, J. & Brown, G. (2004) ‘Cognitive processes in asTTle: The SOLO taxonomy.’ University of Auckland/Ministry of Education. asTTle Technical Report 43. http://e-asttle.tki.org.nz/content/download/1499/6030/version/1/file/43.+The+SOLO+taxonomy+2004.pdf [accessed 6 March 2013]

Hook, P. & Mills, J. (2011) SOLO Taxonomy: A Guide for Schools Book 1: A common language of learning. Laughton, UK: Essential Resources Educational Publishers

Huang, S.-C. (2012) ‘Like a bell responding to a striker: Instruction contingent on assessment’. English Teaching: Practice and Critique 11 (4), pp. 99–119.

Moseley, D., Baumfield, V., Elliott, J., Gregson, M., Higgins, S., Miller, J., & Newton, D. (2005) Frameworks for Thinking: A handbook for teaching and learning. Cambridge: Cambridge University Press

Nückles, M., Hübner, S. & Renkl, A. (2009) ‘Enhancing self-regulated learning by writing learning protocols’. Learning and Instruction, 19(3), pp.259–271. Available at: http://linkinghub.elsevier.com/retrieve/pii/S0959475208000558 [Accessed March 26, 2013].

Smith, A. (2011) High Performers: The Secrets of Successful Schools. Camarthen: Crown House Publishing

Smith, T.W. & Colby, S.A. (2007) ‘Teaching for Deep Learning.’ The Clearing House.  80 (5) pp. 205–211.

Sugrue, B. (2002) ‘Problems with Bloom’s Taxonomy.’ http://eppicinc.files.wordpress.com/2011/08/sugrue_bloom_critique_perfxprs.pdf [accessed 2 May 2013]

Why Research SOLO Taxonomy?

This is the first in a series of blog posts based on my MA research into the use of the SOLO (Structure of Observed Learning Outcomes) taxonomy in English. I hope that  what I write proves useful and not just for English teachers.

A reasonably obvious starting point is: why did I choose to research the SOLO taxonomy?

A quick glance at the TES or Twitter will reveal that teachers are under pressure. The need to achieve year on year improvements in results, as well as a dearth of time available, means that it is not surprising that many teachers are looking for a ‘magic bullet’– something that is effective and involves little additional work. The danger is that schools and teachers are not appropriately critical when selecting and promoting techniques in the rush to achieve the desired results.

Over the past few years a range of different ideas (e.g. Brain Gym, VAK, de Bono’s Thinking Hats) have been promoted in schools, often supported by ‘a thriving commercial industry’ (Coffield et al., 2004:118). While some of these offer useful techniques which can easily be incorporated into the teachers’ everyday lesson, others can become overly burdensome without empirical evidence that the technique actually works (Harrison et al., 2003; Krätzig & Arbuthnott, 2006). Key here is the fact that, while scientific research may indicate a result as suggestive, all too often the results are distorted or overstated (Swaffield, 2009).

How many of us have sat through a CPD session run by an expensive expert, or an enthusiastic member of SLT, and questioned whether it is actually worthwhile? How many have spoken up to challenge ideas that we know are not proven, or (often more likely) sat squirming and wishing that we had the nerve to speak up? In budget conscious and results-driven schools, staff buying into ineffective techniques and strategies (physically and metaphorically) can drain money from where it is most needed.

It is, however, important that teachers are proactive in trialling and using techniques which they believe may be of benefit. Levin (2010:90) explains:

If data from students could be linked to changes known to be effective – for example, improved assessment practices or greater student choice in assignments – we might start to see some lasting and worthwhile changes in the way students experience our high schools.

It was with this in mind that I became cautiously interested when discussions  on Twitter mentioned something called the SOLO (Structure of Observed Learning Outcomes) Taxonomy. Initially, it was mentioned by a small number of UK based teachers who provided more detailed examples on their blogs (Tait Coles, David Didau, Lisa Ashes).

While willing to try new teaching ideas, the key question for me is: what evidence is there that this works? A brief search of academic journals (via the wonderful Google Scholar) identified a number of articles, mostly focusing on the use of the SOLO taxonomy in geography, science or at university level (Munowenyu, 2007; Biggs & Tang, 2009; Brabrand & Dahl, 2009; Prakash et al., 2010).

I was also aware that the use of the SOLO taxonomy was widespread in New Zealand (Hattie & Brown, 2004), being linked to assessment and curriculum models, and through a number of New Zealand Tweachers’ contributions to Twitter discussions. However, it became clear that there was very little research on its use in the UK education system, and little available on its use in teaching English literature beyond blog posts and anecdotes. I therefore decided to try a relatively simple technique – the use of hexagons to link ideas. The results from this initial foray were genuinely surprising, however, could easily have been a fortuitous coincidence. Therefore, I decided to base my study on the effectiveness of the SOLO taxonomy in GCSE English Literature. I hoped to be able to demonstrate whether or not the SOLO taxonomy was effective in improving student results and clarify whether this technique was worth adopting at departmental level and beyond.

References:

Biggs, J. & Tang, C. (2009) ‘Applying constructive alignment to outcomes-based teaching and learning.’ Training Material. “Quality Teaching for Learning in Higher Education” Workshop for Master Trainers.  Ministry of Higher Education. Kuala Lumpur. 2010. http://drjj.uitm.edu.my/DRJJ/MQAGGPAS-Apr2011/What-is-CA-biggs-tang.pdf [accessed 19 August 2012]

Brabrand, C. & Dahl, B., (2009) ‘Using the SOLO taxonomy to analyze competence progression of university science curricula.’ Higher Education, 58 (4) pp. 531–549.

Coffield, F., Moseley, D., Hall, E., & Ecclestone, K. (2004) ‘Learning  styles and pedagogy in post-16 learning: A systematic and critical review.’ Learning and Skills Research Centre. Report No. 041543.

Harrison, G., Andrews, J., & Saklofske, D. (2003) ‘Current perspectives on cognitive learning styles.’ Education Canada. 43 (2) pp. 44-47

Hattie, J. & Brown, G. (2004) ‘Cognitive processes in asTTle: The SOLO taxonomy.’ University of Auckland/Ministry of Education. asTTle Technical Report 43. http://e-asttle.tki.org.nz/content/download/1499/6030/version/1/file/43.+The+SOLO+taxonomy+2004.pdf [accessed 6 March 2013]

Krätzig, G. & Arbuthnott, K. (2006) ‘Perceptual learning style and learning proficiency: a test of the hypothesis.’  Journal of Educational Psychology. 98 (1) pp. 238-246.

Levin, B. (2010) ‘What did you do at school today?’ Kappan. 91 (5) pp. 89-90. http://www.education.auckland.ac.nz/webdav/site/education/shared/about/centres/uacel/docs/InCanadaWDYDIST1002lev.pdf [accessed 8 April 2012]

Munowenyu, E. (2007) ‘Assessing the Quality of Essays Using the SOLO Taxonomy: Effects of Field and Classroom-based Experiences by “A” Level Geography Students.’ International Research in Geographical and Environmental Education. 16 (1) pp. 21–43.

Prakash, E. S., Narayan, K. A., & Sethuraman, K. R. (2010) ‘Student perceptions regarding the usefulness of explicit discussion of “Structure of the Observed Learning Outcome” taxonomy.’ Advances in physiology education. 34 (3) pp.145–9. http://www.ncbi.nlm.nih.gov/pubmed/20826769 [accessed 6 March 2013]

Swaffield, S. (2009) ‘The misrepresentation of Assessment for Learning – and the woeful waste of a wonderful opportunity.’ Work in progress paper. AAIA National Conference. Bournemouth. 16-18 September. http://www.educ.cam.ac.uk/centres/lfl/current/papers/swaffield_aaia09.pdf [accessed 30 March 2013]

MA Research into the SOLO Taxonomy – please help

Those of you who follow my Twitter account (@data_fiend) may know that I am conducting some research into the effectiveness of the SOLO taxonomy (Structure of Observed Learning Outcomes)  as part of my MA.

As part of my research I would like to find out the views of teachers. If you have taught using the SOLO taxonomy, even if it is a single lesson, I would be very grateful if you would complete the relevant survey below. it should only take a few minutes at most:

English teachers, please click here to take survey.

Teachers of other subjects, please click here to take survey.

All responses will be anonymous. The collated data will be used as part of my MA in Education and reported on this blog. The use of data will comply with BERA guidelines.

Thank you.

CPD and Randomized Controlled Trials

Evidence based ideas in education has been a hot topic over the past week or so – and not before time, in my opinion.

Whenever new ideas are brought forward, some teachers will always refer to the ‘tried and tested’ methods they prefer (some of which are actually just tried rather than ‘tested’). Equally, there is the counter issue where some teachers, or school leaders, come up with some new idea and proceed to insist that everyone else jumps onto their bandwagon. Both situations are less than ideal and, believe it or not, Michael Wilshaw appears to agree:

We, and in that word “we” I include OFSTED, should be wary of trying to prescribe a particular style of teaching, whether it be a three part lesson; an insistence that there should be a balance between teacher led activities and independent learning, or that the lesson should start with aims and objectives with a plenary at the end and so on and so forth. We should be wary of too much prescription. In my experience a formulaic approach pushed out by a school or rigidly prescribed in an inspection evaluation schedule traps too many teachers into a stultifying and stifling mould which doesn’t demand that they use their imagination, initiative and common sense.

Michael Wilshaw’s speech – via @oldandrew teachingbattleground.wordpress.com

It should be the teacher’s decision which methods they use in their classroom, based on their professional judgement and available evidence. The availability of this evidence is, in itself, an issue – one which I will look at in a little more detail below.

However, sadly, this freedom to teach, according to our own professional judgement, does not seem to be the reality of OfSTED or of many schools. Schools seem to be obsessed with OfSTED these days. What data does OfSTED want to see/expect you to know? What sort of lesson do they want to see? Which teaching methods? Sometimes this obsession seems to be almost to the exclusion of whether this actually helps the students who are in front of us for the 180-odd days that OfSTED are NOT in school. The Telegraph’s article about ‘mock’  inspections highlights my point. Surely the focus should be on improving teaching and learning, rather than identifying which hoops a possible inspector may want us to jump through? In any case, as highlighted in this blog post, how does OfSTED help schools improve the actual teaching and learning?

We, as teachers, need to return the focus in our schools to our core purpose, to teach our subjects to the best of our ability and prepare young people for life beyond school. One area we could start with is CPD.

We could use CPD time to enable teachers in school, or across a local area, to collaborate on research projects, work on randomized trials and present the findings  for other teachers.  Ben Goldacre‘s (@bengoldacre) recent report suggests that:

By collecting better evidence about what works best, and establishing a culture where this evidence is used as a matter of routine, we can improve outcomes for children, and increase professional independence.

But no! CPD tends to pander to the latest perceived OfSTED desire, or fads supported by colourful brochures and expensive external speakers. It is strange that, in a profession full of postgraduates, our in-school CPD so rarely takes that into account. Instead, we are given watered down ideas, gimmicks without solid evidence, or worse: we are expected to relive a lesson through card sorts and role play. Stay in teaching any length of time and it is likely that you will sit through similar presentations without new input – not exactly differentiating for your audience.

When I started teaching, about 12 years ago, we had a departmental day at the start of the term, no agenda from above, no mention of OfSTED, no death by PowerPoint – we were trusted, as professionals, to know what needed to be done. One of the sad things is that, as accountability and OfSTED come to the fore they are accompanied by, what could be called, a ‘dumbing down’ of the profession. We can’t be trusted to work on our own on projects, almost as if we were a naughty bunch of year 10s who will nick off to the toilets for a fag as soon as the teacher’s back is turned.

The opportunity to make informed decisions about what works best, using good quality evidence, represents a truer form of professional independence than any senior figure barking out their opinions.  A coherent set of systems for evidence based practice listens to people on the front line, to find out where the uncertainties are, and decide which ideas are worth testing.

Ben Goldacre

To raise the profile of the profession externally, and encourage a sense of this professionalism within schools, we need to be more aware of evidence and research – if school leaders want teachers to use a particular strategy, give us evidence as to its effectiveness, suggestions for further reading, or a chance to be part of a randomized trial perhaps.
For a profession that exists under almost constant change, education can be very resistant to change and the idea of randomized trials can cause tension, as Goldacre says:
most people start to become nervous: surely it’s wrong, for example, to decide what kind of education a child gets, simply at random?
This may certainly explain some of the negative reactions that Ben’s  Guardian article received. But if we are honest, this happens all the time: the make up of a class, timetabling that creates split classes, a new syllabus, the new idea you choose to use, a teacher on long term sick leave, a PGCE student on a placement. We are not talking about throwing out everything we do to replace it with something else. Instead, the idea is to “decide which ideas are worth testing” and start there.
I have found Twitter an excellent starting point for this type of discussion, the sharing of ideas and sources of information with teachers across the globe is fantastic. I would hope that some of this turns into concrete academic research.

Teaching and education are emotive subjects – we all remember the teacher who inspired us, just as we remember the one who did not. In our rush to do the best we can for the young people in front of us, we need to take a little time to reflect, and question, whether what we are doing really allows us all to reach our potential.