21 October 2012

Homework: What does the Hattie research actually say?

Filed in Leadership Issues, Teaching and Learning

This is an excellent book.  It is an attempt to distil the key messages from the vast array of studies that have been undertaken across the world into all the different factors that lead to educational achievement.  As you would hope and expect, the book…

Homework: What does the Hattie research actually say?

The Highly Influential Work by John Hattie

This is an excellent book.  It is an attempt to distil the key messages from the vast array of studies that have been undertaken across the world into all the different factors that lead to educational achievement.  As you would hope and expect, the book contains details of the statistical methodology underpinning a meta-analysis and the whole notion of ‘effect size’ that drives the thinking in the book.  There is a discussion about what is measurable and how effect size can be interpreted in different ways. The key outcomes are interesting, suggesting a number of key factors that are likely to make the greatest impact in classrooms and more widely in the lives of learners.

My main interest here is to explore what Hattie says about homework.  This stems from a difficulty I have when I hear or read, fairly often, that ‘research shows that homework makes no difference’. It is cited as a hard fact in articles such as this one by Tim Lott in the Guardian: Why do we torment kids with homework?   Even though Tim is talking about his 6 year old, and cites research that refers to ‘younger kids’, too often the sweeping generalisation is applied to all homework for all students.  It bugs me and I think it is wrong.

Research cited for younger children

I have written about my views on homework under the heading ‘Homework Matters: Great Teachers set Great Homework’ . I’ve said that all my instincts as a teacher (and a parent) tell me that homework is a vital element in the learning process; reinforcing the interaction between teacher and student; between home and school and paving the way to students being independent autonomous learners.  Am I biased? Yes.  Is this based on hunches and personal experience? Of course.  Is it backed up by research……?  Well that is the question.

So, what does Hattie say about homework?

Helpfully he uses Homework studies as an example of the overall process of meta-analyses, so there is plenty of material. In a key example, he describes a study of five meta-analyses that capture 161 separate studies involving over 100,000 students as having an effect size d= 0.29.  What does this mean?  This is the best typical effect size across all the studies, suggesting:

  • improving the rate of learning by 15% – or advancing children’s learning by about a year
  • 65% of effects were positive
  • 35% of effects were negative
  • average achievement exceeded 62% of the levels of students not given homework.

However, there are other approaches such as  the ‘common language effect’ (CLE) that compares effects from different  distributions. For homework a d= 0.29 effect translates into a 21% chance that homework will make a positive difference.  Or, from two classes, 21 times out of a 100, using homework will be more effective.   Hattie then says that terms such as ‘small, medium and large’ need to be used with caution in respect of effect size.  He is ambitious and won’t accept comparison with 0.0 as a sign of a good strategy.   He cites Cohen as suggesting with reason that 0.2 is small, 0.4 is medium and 0.6 is large and later argues himself that  we need a hinge-point where d > 0.4 is needed for an effect to be above average and d > 0.6 to be considered excellent.

OK.  So what is this all saying. Homework, taken as an aggregated whole, shows an effect size of d= 0.29 that is between small and medium?  Oh.. but wait… here comes an important detail.  Turn the page:  The studies show that the effect size at Primary Age is d = 0.15 and for Secondary students it is d = 0.64!  Well, now we are starting to make some sense.  On this basis, homework for secondary students has an ‘excellent’ effect.  I am left thinking that, with a difference so marked, surely it is pure nonsense to aggregate these measures in the first place?

Hattie goes on to report that other factors make a difference to the results:  eg when what is measured is very precise (eg improving addition or phonics), a bigger effect is seen compared to when the outcome is more ephemeral. So, we need to be clear:  what is measured has an impact on the scale of the effect.  This means that we have to throw in all kinds of caveats about the validity of the process.  There will be some forms of homework more likely to show an effect than others;  it is not really sensible to lump all work that might be done in between lessons into the catch-all ‘homework’ and then to talk about an absolute measure of impact.  Hattie is at pains to point out that there will be great variations across the different studies that simply average out to the effect size on his barometers.  Again, in truth, each study really needs to be looked at in detail.  What kind of homework? What measure of attainment?  What type of students?  And so on…. so many variables that aggregating them together is more or less made meaningless?  Well, I’d say so.

Nevertheless, d= 0.64!  That matches my predisposed bias so I should be happy.  q.e.d.  Case closed.  I’m right and all the nay-sayers are wrong. Maybe, but the detail, as always, is worth looking at.  Hattie suggests that the reason for the difference between the  d=0.15 at primary level at d=0.64 at secondary is that younger students can’t under take unsupported study as well, they can’t filter out irrelevant information or avoid environmental distractions – and if they struggle, the overall effect can be negative.

At secondary level he suggests there is no evidence that prescribing homework develops time management skills and that the highest effects in secondary are associated with rote learning, practice or rehearsal of subject matter; more task-orientated homework has higher effects that deep learning and problem solving.  Overall, the more complex, open-ended and unstructured tasks are, the lower the effect sizes.  Short, frequent homework closely monitored by teachers has more impact that their converse forms and effects are higher for higher ability students than lower ability students, higher for older rather than younger students.  Finally, the evidence is that teacher involvement in homework is key to its success.

So, what Hattie actually says about homework is complex.  There is no meaningful sense in which it could be stated that “the research says X about homework” in a simple soundbite.  There are some lessons to learn:

The more specific and precise the task is, the more likely it is to make an impact for all learners.  Homework that is more open, more complex is more appropriate for able and older students.
Teacher monitoring and involvement is key – so putting students in a position where their learning is too complex, extended or unstructured to be done unsupervised is not healthy.  This is more likely for young children, hence the very low effect size for primary age students.

All of this makes sense to me and none of it challenges my predisposition to be a massive advocate for homework.  The key is to think about the micro- level issues, not to lose all of that in a ridiculous averaging process.  Even at primary level, students are not all the same.  Older, more able students in Year 5/6 may well benefit from homework where kids in Year 2 may not.  Let’s not lose the trees for the wood!  Also, what Hattie shows is that educational inputs, processes and outcomes are all highly subjective human interactions.  Expecting these things to be reduced sensibly into scientifically absolute measured truths is absurd.  Ultimately, education is about values and attitudes and we need to see all research in that context.

 

PS. If you are reading this from Sweden, Tack för läsning. Låt mig veta era tankar om denna fråga.

Tags:
74 Comments
  • Alex Quigley
    Posted at 17:07h, 21 October Reply

    Hattie et al. have undoubtedly produced work of outstanding value. Too easily; however, his evidence is simplified & distorted. The use of technology in his research is an apt example. The effect size would intimate that technology has no positive impact upon learning. But the research doesn’t include iPads for example, which I believe are wholly different to more traditional technology. Indeed, how we use iPads is predominantly for feedback & collaborative learning – two positive effect sizes – feedback being the daddy! People have dismissed using new technology with Hattie’s ‘evidence’ – but that is an incomplete story. ‘Some’ technology I believe has a negligible impact on learning – often due to insufficient pedagogy, whereas some work brilliantly well, motivating students, enriching feedback etc.

    Hattie’s evidence is a great starting point for all educators when evaluating impact or devising improvements, but people need to know the data and recognise how their different contextual factors impact the data. Otherwise we have the ‘Tim Lott effect’ i.e. people grandstanding their opinions as incontrovertible facts!

  • Nina
    Posted at 17:21h, 21 October Reply

    Thank you for a this good posting! I used to teach in Finland where homework was never graded. During my teacher education the reason for homework was made very clear: it is an opportunity for the student to revisit what s/he learned at school, and thus make an additional memory of it (and in the best scenario also move it to the long term memory, i.e. provide “automatic” transfer). Secret of successful homework: keep it short & simple.

  • David Didau (@LearningSpy)
    Posted at 18:22h, 21 October Reply

    Tom – Hope you won’t be offended, but I can’t really agree with this one. An effect size of 0.29 is well below the hinge point of 0.4 – Hattie explains that we have a responsibility to focus on effect sizes above 0.4 and there are SO MANY things which will make more of a different. Good feedback has an effect of over 1.0 – THIS is what we (and students) should be spending their time doing if we really want to make a difference. All an effect size of 0.29 shows is that it’s not actively doing any harm. However, when we take this (http://learningspy.co.uk/2011/09/12/should-we-stop-doing-good-things/) spending undue time on homework really could be preventing students making better progress. Maybe the solution is set action of feedback AS homework?

    Does this make sense?

    • headguruteacher
      Posted at 18:56h, 21 October Reply

      Hi David. I think my point is that Hattie’s work should be divided up – Secondary homework as an effect size of 0.64. The 0.29 is a very crude average that loses meaning. Even within Hattie’s framework 0.64 is a strong effect worth looking at. In practice, I’m thinking of all the stuff my students do for homework… I don’t know how we’d run lessons without it. Tom

  • Homework: What does the Hattie research actually say? | … Not the Principal's Office!!!
    Posted at 22:43h, 21 October Reply

    […] Homework: What does the Hattie research actually say?. […]

  • Chris Chivers
    Posted at 07:55h, 22 October Reply

    Hi Tom, The article is thorough and well presented. Homework has a bad name because there is so much “busy work” being given that does not impact on learning. Homework that is integral to ongoing learning, with clear feedback, either direct and individualised, or group based within discussion, might give the higher figures from Hattie. Working within a commonly articulated purpose focuses learners on the task, they can see the point.
    Chris Chivers

  • Ellie Russell
    Posted at 12:52h, 23 October Reply

    Really enjoyed this post, partly because it supports what I think! In our department we’re puttting more of our effort into giving feedback in lesson time and making sure students having time to improve, rather than setting big homework tasks for teachers to write long comments on (that are rarely read!). So far this year we’ve focussed on learning key words, single exam questions, simple ‘find out’ tasks about science in the news. These short tasks can be marked in class and feedback given. Students missing HW can be dealt with simply and those who complete their HW each week are clearly benefitting from the reinforcement. I no longer risk setting a piece of HW that is essential for understanding the following lesson. More trouble than it’s worth!

  • Liz
    Posted at 09:43h, 29 October Reply

    Reblogged this on languagesupportuk and commented:
    Just interesting reading

  • Rob Anthony
    Posted at 13:11h, 03 November Reply

    You also have to consider what is defined as homework. In some studies it is taken to be work done at home. This is not the same as homework as we understand it.
    If a student does their own revision, it probably has a positive effect. We need to separate this from homework set by a teacher and completed or not by students. I don’t believe that Hattie makes this distinction.
    I spent a summer reading lots of research about it and came to the conclusion that it is unhelpful at primary but that the jury is still out for secondary.
    I also suspect that it is the feedback effect that creates positive effects for homework and not the setting of homework itself.

  • John Hattie
    Posted at 10:16h, 06 November Reply

    Head Guru Teacher
    Thanks for the courtesy of reading my work, and not tripping over headlines of those who not bother. I knew when writing the section on homework that it could be misinterpreted (as has class size, streaming, finances, etc.) and tried my best to make the picture clear. Yes, homework is one influence where there is a critical moderator – there is a major difference between its effects in primary and secondary.

    I like your summary but can I add one more critical comment …

    Visible Learning is a literature review, therefore it says what HAS happened not what COULD happen. The message about the low effect in primary school means that there is a high probability that many homework practices may not be working. The key is that this highlights the importance for schools to now evaluate the effectiveness of its primary homework practice. And if it turns out to be like most other practices (low effect), there there is an invitation (indeed an imperative) to try an alternative set of practices re. homework – and evaluate their impact on learning, involvement in learning, and increasing the students (and parents) understanding about the language of learning.

    I do NOT recommend abandoning homework, and I do provide some direction for effective homework policies (as you note), but most of all the invitation is to “Know thy impact”.

    • headguruteacher
      Posted at 10:36h, 06 November Reply

      John
      Thanks so much for your comment. I must say I am thrilled that you have added to the discussion in person. I agree with what you have said entirely. Your work is making a serious impact because people are hungry for research evidence – however, the detail in your book is rarely reported; too easy to go for the average simplification. I am very happy to hear that you do not recommend abandoning homework! It is all about effectiveness – and, yes, impact. Great!

      Anyway, thanks very much indeed. Tom Sherrington

      • behrfacts
        Posted at 15:35h, 02 February Reply

        Since John has engaged directly with this, as usual, excellent blog post by Tom, perhaps he could answer the broader question of how his data is being used within education policy and reform? I am having a mini-debate about it with former education colleagues especially on how to measure the actual benefits of informal/non-formal learning – this is because the Wellcome Trust recently produced a series of extensively-researched reports on informal learning within science and having read them I am still not clear what the proof of benefit actually is! I am inclined towards the Sutton Trust/EEF toolkit being developed at Durham which gives a ‘precise’ table of effect size and relative cost of the intervention – out of school activities don’t do that well on this basis. Of course some might say (if you are a parent who is asked to help your child with it, even more so) that homework is a type of out of school activity/informal learning …

      • Per Kornhall
        Posted at 16:05h, 09 January Reply

        You wanted a comment from Sweden… I wholly support the approach you have in this article and am glad for Johns comment. In Sweden, simple bylines from Visible learning has all to many times been presented as truths in education (not at least from the employers) such as “class size do not matter” etc. I have advocated Johns research quite heavily in Sweden since I think we in this country to long have not been interested in evidence when it comes to teaching.

        But in doing so I always stressed that it should be used as a base for discussions, and that behind every sampled effect is a plethora of information that can enrich a pedagogical discussion among teachers. I have done this very much in the same way as you have done above. It is also important and crucial for real school development that every teacher evaluates the methods he or she uses and if the desired learning is achieved as John points out.

        Used in the way you describe above, Visible learning is a tremendously valuable collection of information on education. It is at this moment translated into Swedish, which will make it more accessible to the common teacher, and I hope it will be used in schools and in teacher education to broaden and inspire pedagogical discussions and not as a book of finite answers.

        • headguruteacher
          Posted at 16:27h, 09 January Reply

          Dear Per, Thanks a lot for the response. It is interesting that we are all dealing with same questions. I love John Hattie’s book but it is frustrating to see it reduced to a list of good and bad strategies as if the effect sizes are absolute measures. Used intelligently, the ideas are very useful – even just the fact that teachers are talking more about evaluating impact and effect as a consequence is a step forward.

  • Homework « @impactEduk
    Posted at 09:51h, 10 November Reply

    […] There is a well considered blog and debate here @headteacherguru.  This blog highlights differences between impact in Primary and Secondary contexts and includes […]

  • On homework « Verbal Tea
    Posted at 15:59h, 04 December Reply

    […] research finds that the evidence on giving children homework is complex. In general, it seems that older, brighter children get more out of homework than […]

  • Leading 21st C learning : getting my bearings for the journey ahead… « headguruteacher
    Posted at 12:41h, 09 December Reply

    […] an in-school or online environment where the inter-lesson work can be done successfully.  (See my post about what Hattie says on homework – which he commented on […]

  • Leading 21st C learning: getting my bearings for the journey ahead… « Wilmslow High School's 'Lookout for Learning'
    Posted at 21:54h, 11 December Reply

    […] an in-school or online environment where the inter-lesson work can be done successfully.  (See my post about what Hattie says on homework – which he commented on […]

  • Great Lessons 5: Journeys « headguruteacher
    Posted at 00:47h, 08 February Reply

    […] I’ve written that ‘Great Teachers set Great Homework‘ (see also here for the Hattie research, effective size etc)… I’m a big fan.  The best form of homework is the kind that should really be called […]

  • Chris Chivers
    Posted at 07:57h, 04 March Reply

    I think in another post, you have made the point that the quality of homework is likely to be an arbiter in progress. It would be worth a survey of activities given for homework to ascertain their worth in promoting learning, or whether they are given just because there’s a need to set homework.

    Activity at home, linked to the learning in class, cf flipped classrooms, would appear to have a stronger base than a photocopied worksheet.

    It’s another example of #marginalgains. Look at the dynamics.

  • What’s the Difference? Putting on my Thinking Hattie | i-Biology | Reflections
    Posted at 08:20h, 08 March Reply

    […] In another example, the ranking for homework (d=0.29) appears low, but when the effects in elementary and secondary are separated, it tells a different story. Follow the link below to find out more, by Tom Sherrington. Spoiler alert: “great teachers give great homework.” […]

  • The Data Delusion: On average, it’s a bit more complicated. | headguruteacher
    Posted at 15:32h, 17 March Reply

    […] I have shared in this post – what Hattie says about homework is complex. And yet, even intelligent people will tell me that 0.29 is a low effect size, therefore homework […]

  • Primary school homework – who is it meant to benefit? | Educating Brentwood
    Posted at 12:35h, 18 March Reply

    […] The schools that I taught in did not set formal homework at this level. In fact, the first school that I taught in actively discouraged the setting of any homework at all. Despite this, pupils in its classes went on to do extremely well at secondary school and further education. The lack of homework did not harm them in any way. Indeed I am not the only one who feels this way. Professor John Hattie, a leading expert on student achievement, found little evidence to support the link between academic success and homework at a young age. This has been the subject of a recent blog by King Edward’s Grammar School head teacher Tom Sherrington who touches on the apparent difference in effect between secondary and primary school homework. (http://headguruteacher.com/2012/10/21/homework-what-does-the-hattie-research-actually-say/) […]

  • Homework Matters: Great teachers set great homework | headguruteacher
    Posted at 10:57h, 28 April Reply

    […] into lessons and provides exciting opportunities for student-led learning and creativity. (See the post about Hattie’s research, which he comments on […]

  • A Year in the Life of Headguruteacher | headguruteacher
    Posted at 08:05h, 10 May Reply

    […] Throughout the autumn, the blogs by @johntomsett and @huntingEnglish (Alex Quigley) became my chief source of leadership and pedagogical inspiration. Amazingly, they both work at the same school – it must be such a great school!  I met them both at separate conference events… and continue to work with them on different projects.   A blogging highlight around this time was when John Hattie himself commented on my blog about what Hattie says about homework…. […]

  • Four Successful Homework Strategies - EDUTRONIC | Christopher Waugh
    Posted at 15:14h, 01 June Reply

    […] is one of the most fraught areas of secondary teaching. We know it’s important, its impact is visible and its routines don’t offend common sense. Yet in the daily reality […]

  • How much should homework count? | i-Biology | Reflections
    Posted at 01:59h, 10 June Reply

    […] Also, here’s a interesting graphic based on reading Hattie’s Visible Learning. Overall, homework has an impact of d=0.29: pretty pointless. However, this is a mean impact; when the homework for elementary-aged students (d=0.15) is factored out, we are left with d=0.64 in secondary. This is an enhanced effect. Find out more about this with Tom Sherrington’s post: Great Teachers Give Great Homework. […]

  • The Great Homework Debate Part II – What is the effect size of homework on student learning? | paddington teaching and learning
    Posted at 10:13h, 12 June Reply

    […] (as summarised in a great post from the fantastic blog by headguruteacher Tom Sherrington, called Homework -what does the Hattie research actually say? ) and you discover this important […]

  • Winning Ugly: The Secrets of ‘Gritty’ Teaching and Learning | huntingenglish
    Posted at 07:36h, 14 July Reply

    […] post from Tom Sherrington about the homework debate, complete with a reply from John Hattie: ‘Homework: What does the Hattie research tell us?. My experience of homework is that the students who apply themselves to homework most consistently […]

  • Winning Ugly: The Secrets of ‘Gritty’ Teaching and Learning — HuntingEnglish
    Posted at 20:50h, 30 July Reply

    […] post from Tom Sherrington about the homework debate, complete with a reply from John Hattie: ‘Homework: What does the Hattie research tell us?. My experience of homework is that the students who apply themselves to homework most consistently […]

  • The Goldfish Bowl » Getting on top of homework
    Posted at 17:30h, 22 September Reply

    […] For me to make any sort of progress with my homework, it needs to be worth it. I have taken some time to read Hattie on homework again and it is interesting to read the nuances of his meta-analysis. Hattie talks about the greater benefits of homework the older students get, which makes the overall effect size somewhat skewed. For older students, the effect size is 0.64, making this above Hattie’s own hinge point of 0.4. Hattie adds that ‘more task-oriented homework had higher effects than did deep learning and problem solving homework.’ and ‘…the effects are highest, whatever the subject, when homework involves rote learning, practice, or rehearsal of the subject matter.’ I also find that this post by @headguruteacher makes a compelling case for homework. (He also has a detailed post on Hattie and homework here) […]

  • All the small things | mrbunkeredu
    Posted at 16:23h, 21 January Reply

    […] learning. Maybe you could read more about research into homework’s effectiveness here, rather than spending quite so much of your time on that lesson you’ve already been planning […]

  • A Blog Blog: The things that seem to matter | headguruteacher
    Posted at 23:13h, 27 January Reply

    […] 5. Homework: What does the Hattie research actually say? […]

  • Engagement, Teaching and Bias | Moments, Snippets, Spirals
    Posted at 16:43h, 01 February Reply

    […] Learning is a literature review, therefore it says what HAS happened not what COULD happen.” (see Tom Sherrington’s post on Hattie and homework). Moreover, in my conversation with Ron Ritchhart the idea of effect […]

  • Always Evidence-Based Practice. Or Not? | Moments, Snippets, Spirals
    Posted at 00:02h, 20 February Reply

    […] William (and some of these “simple artifacts”) as Tom Sherrington did in relation to homework . Martyn Hammersley also questions the precision of […]

  • Homework and Retention | cavmaths
    Posted at 08:32h, 10 July Reply

    […] Homework, what does Hattie actually say, Tom Sherrington: http://headguruteacher.com/2012/10/21/homework-what-does-the-hattie-research-actually-say/ […]

  • Show My Homework
    Posted at 15:13h, 16 July Reply

    Thanks for the analysis, it really helped when trying to understand what the research actually says.

    Show My Homework / @ShowMyHomework

  • Do your homework: Acting on evidence from educational research #rED14 | headguruteacher
    Posted at 22:01h, 05 September Reply

    […] John Hattie’s meta-analysis of research into homework.  I’ve written about the detail in this blog post.  Here 160+ studies are compiled to generate a relative effect size but, if you engage with the […]

  • Homework: What does the Hattie research actually say? | learning@larkmead
    Posted at 19:57h, 08 September Reply

    […] Homework: What does the Hattie research actually say?. […]

  • Home Learning | MathsZest
    Posted at 19:46h, 05 November Reply

    […] have read overviews of Hatties research, particularly from @guruheadteacher here.  It makes sense to me regarding the impact of homework on different age groups, and reinforced my […]

  • Homework: What does the Hattie research actually say? | headguruteacher | Learning Curve
    Posted at 10:39h, 11 December Reply

    […] Makes good points about the need for specificity and appropriateness.  This post is as entertaining as it is informative as it steps through an analysis of Hattie’s work on homework. http://headguruteacher.com/2012/10/21/homework-what-does-the-hattie-research-actually-say/ […]

  • Home | Manage homework with ZiLink
    Posted at 13:06h, 11 December Reply

    […] reading his article Homework Matters: Great teachers set great homework. Also, read his article Homework: What does the Hattie research actually say? where he distills that research and uses it to counteract those against the usefullness of […]

  • Winning Ugly: The Secrets of 'Gritty' Teaching and Learning - HuntingEnglishHuntingEnglish
    Posted at 20:41h, 01 January Reply

    […] post from Tom Sherrington about the homework debate, complete with a reply from John Hattie: ‘Homework: What does the Hattie research tell us?. My experience of homework is that the students who apply themselves to homework most consistently […]

  • Primary School Homework - Mini rant - Page 2
    Posted at 00:24h, 12 March Reply

    […] and intriguing. The best summary of what it means though I think is from Tom Sherrington. Homework: What does the Hattie research actually say? | headguruteacher Basically, it can make a difference, but it depends on what is set, how well structured it is and […]

  • Kathy
    Posted at 13:37h, 09 June Reply

    As a former primary age teacher and now a Literacy Coach, I can attest to the fact that for primary age students homework is beneficial to student achievement. I always checked the homework to assure that it was completed and to validate why I felt the practice at home was important. Homework gave parents of young learners the opportunity to assist in the reaffirmation of what was studied that particular day and students the opportunity to gain more automaticity in understanding the concepts/strategies of topics presented. Thus, better “home -school” connections, also

  • Why Homework? | Rummages&Ramblings
    Posted at 12:35h, 14 October Reply

    […] Sherrington writes a much better explanation of this than I can on his blog and makes a pretty good case for […]

  • Tom Triumpht
    Posted at 20:28h, 17 October Reply

    Everything seemed reasonable until you wrote this:

    “Older, more able students in Year 5/6 may well benefit from homework where kids in Year 2 may not. Let’s not lose the trees for the wood! Also, what Hattie shows is that educational inputs, processes and outcomes are all highly subjective human interactions. Expecting these things to be reduced sensibly into scientifically absolute measured truths is absurd. Ultimately, education is about values and attitudes and we need to see all research in that context.”

    You accept the findings that support your belief, and your analysis of Hattie and the breakdown made for a good argument. Then, you begin to posit your own theories–using the dreaded “may” to create a grey area for bad policy to drive through. Throughout the comments here, supporters of your position like to use the word “belief” for the same effect–Hattie does not support what you want, in the degree you want it, so you restate your view and move from the data. Come on.

    The data either proves something or you need to present other data sets. It’s fine to disagree, but do it with data.

    • Tom Sherrington
      Posted at 08:16h, 18 October Reply

      Have you read the Hattie comment? He says himself that his data only shows the average results of what has been done before; not what could happen in future. ‘May’ is important; there are no certainties; just broad patterns. The types of homework that produce bigger effects are described in the book; there’s no contradiction with the data in what I’ve said.

  • Hattie, Homework and an Insightful Analytical Blog Post (and Cautionary Tale) | Educational Statistics Fun!
    Posted at 16:19h, 31 October Reply

    […] than rehash, let me guide folks to an insightful analysis of Hatties’ conclusions in “Homework: What does the Hattie research actually say?” on Tom Sherrington’s headguruteacher blog.  Sherrington does a great job looking […]

  • Join The Revolution! | @TeacherToolkit
    Posted at 12:12h, 20 January Reply

    […] that the effect size at Primary Age is d = 0.15 and for Secondary students it is d = 0.64.” (@headguruteacher). An effect-size of 1.0 is typically associated with advancing learners’ achievement by one […]

  • Homework: A La Carte or Fixed Menu? #SaturdayThunk | @LeadingLearner
    Posted at 06:16h, 05 February Reply

    […] Tom Sherrington (2012) Homework: What Does the Hattie Research Actually Say? […]

  • Ruth Kennedy
    Posted at 20:17h, 10 February Reply

    I *love* this dissection, Tom! I wrote about the fact that ‘evidence’ is so much more irritatingly complex than we’d like it to be here: http://www.wearethepublicoffice.com/what-works-can-we-know/
    The best bit is the @dylanwiliam quotation from ResearchEd14: “The research on homework shows that most homework does no good. But then most of the homework that teachers set is crap. So what the research really shows is that crap homework does no good. Big shock there! But what the research also shows is that the homework that teachers set most frequently is the least effective. Preparation for future learning is the most effective form of homework; it’s just much more difficult to organise. So the fact that people have said that the homework research shows that homework doesn’t do any good, doesn’t mean that homework can’t be good.”

  • Takeaway Homework… – Learning & Teaching Magpie
    Posted at 09:56h, 09 March Reply

    […] See Tom Sherrington’s (@HeadGuruTeacher) discussion of some of the research on homework in his blog-post here. […]

  • Pickled Piper
    Posted at 05:30h, 19 June Reply

    “The biggest mistake Hattie makes is with the CLE statistic that he uses throughout the book. In ‘Visible Learning, Hattie only uses two statistics, the ‘Effect Size’ and the CLE (neither of which Mathematicians use).

    The CLE is meant to be a probability, yet Hattie has it at values between -49% and 219%. Now a probability can’t be negative or more than 100% as any Year 7 will tell you.”

    https://ollieorange2.wordpress.com/2014/08/25/people-who-think-probabilities-can-be-negative-shouldnt-write-books-on-statistics/

  • Research Evidence that has shaped what we do. #rEdYork | headguruteacher
    Posted at 08:58h, 10 July Reply

    […] at the evidence on homework from Hattie, we’re committed to setting homework but need to be mindful that only certain types of […]

  • Schrödinger’s homework: the problem with takeaway menus | Othmar's Trombone
    Posted at 18:50h, 12 July Reply

    […] Hattie has thrown some doubt over the effectiveness of homework as an intervention, wouldn’t it be better to, as Tom […]

  • project topics and materials
    Posted at 10:51h, 11 September Reply

    Nice post… Though, here homework is to target students who are a bit older. Pupils at elementary level or less than 4years may not be taken serious on assignment issue.

  • Homework: Is it worth it? Probably. | @mrocallaghan_edu
    Posted at 08:03h, 27 November Reply

    […] mentions a couple of bits of research in his post regarding the effectiveness of homework on learning and although some studies suggest a […]

  • 10 Must-Read Books for Better Teaching | teacherhead
    Posted at 18:16h, 24 February Reply

    […] of analogies with outdoor pursuits tasks like learning to abseil. If you look at the detail – for example the homework chapter as I did here – you also learn about the complexities of education research itself and the importance of […]

  • 10 Blogs for Great Teaching | teacherhead
    Posted at 09:39h, 06 April Reply

    […] Homework: What does the Hattie research actually say? […]

  • You’re doing it all wrong: context and complexity in Ed-research and debate. | teacherhead
    Posted at 08:18h, 21 May Reply

    […] as an example of the pitfalls of interpreting the results. I’ve written about this in full in this post.  It was interesting to see, in a ranking of the Visible Learning effect sizes, that Drugs appears […]

  • lunatikscience
    Posted at 06:36h, 12 July Reply

    I’m reading this from Sweden (although I am originally from the UK and trained to teach there). 7 years ago I did a piece of small action research as part of my masters degree looking at how I used homework. I was in the UK at the time. My findings, although much smaller scale, would support Hattie. Homework has an impact but you must design it properly was my basic conclusion. My problem is having to deal with the huge number of parent conversations and societal attitude towards homework in Sweden (which are generally negative), and school in general really, fuelled by the media and it’s anti-homework stance. My own feeling about the attitude is that academic learning should happen only in school. Even getting parents to do something so simple as read with their child can cause endless arguments. No it’s not all parents and it does depend a lot on your location. But that’s just my experience of the schools I have worked in.

  • Teacherhead | 10 Must-Read Books for Better Teaching
    Posted at 09:25h, 10 October Reply

    […] of analogies with outdoor pursuits tasks like learning to abseil. If you look at the detail – for example the homework chapter as I did here – you also learn about the complexities of education research itself and the importance of […]

  • When Homework Is (and Isn't) Genuinely Helpful |Education & Teacher Conferences
    Posted at 08:00h, 06 January Reply

    […] I posted a link to a pro-homework argument. Again today, I’ve stumbled across another–this one summarizing John Hattie’s Visible Learning on the […]

Post A Comment