Halfway through an epic marking marathon my journey is lightened by the occasional inadvertent gem. Here’s a couple from the current crop:
“They went to university collage hospital” - presumably they were in pieces about something or other
“Another unique property of stem cells is that they have the capacity of diving without differentiating for long periods of time” - Jacques Cousteau would have been impressed
“Marking, remarking and meaningful learning: an assessment and feedback seminar” was held at the University of Leicester on April 4th 2008. The event was organised by the Assessment and Feedback Working party of the University’s Student Experience Enhancement Committee and was attended by about 60 members of the academic community. The following are personal reflections and things that I took from the day.
Smartie-pants
The first presentation was given by Jon Scott, Director of Studies in Biological Sciences at the University. Jon’s cryptic title “How the baby got the Smartie” actually drew analogies between his research work on development of motor coordination skills and effective use of feedback. The ability of a baby to pick up a smartie from a flat surface is apparently a developmental landmark (presumably there are healthy options now available for choco-phobic parents). Research on brain activity whilst learning this task has shown that neurons are fired by failure to achieve the task, i.e. whilst the infant is self-feedbacking (is that a word?) . It knows what it is expecting (bright, interesting-looking object in mouth) and feedback modifies performance until it gets it. Once the task has been mastered, apparently, the relevant neurons go silent.
Jon then applied this observation to the way students use (or ought to use) assessment and feedback. He stressed that feedback is an active process for assessor and learner and that feedback can show both what is ok, and what is needed for next time - hence we need to encourage reflective behaviour in students - they need to review their work in the light of feedback received to work out how to do better next time.
Why did I get 37%?
Next up was Brenda Smith from the Higher Education Academy. Brenda’s theme was Assessment for Learning: why did I get 37%? AfL is a topic we’ve considered previously at the Journal of the Left-handed Biochemist. The title of Brenda’s session reflects a comment made by a student in a research project; their tutor was reported to have refused point-blank to enter into discussion on the matter.
Brenda began by reflecting on the growing evidence from QAA subject reviews, the National Student Survey, etc that all is not well in the world of Assessment and Feedback. The problems noted are familiar to anyone who has taken an active interest in this process: too much summative feedback, not enough formative; feedback coming too late to be useful; inconsistency in assessment practice both within and between institutions. Referring to data from the 2006 and 2007 National Student Surveys, Brenda highlighted that the lowest scores (51% for both questions, in both years) were in response to the statements “feedback on my work has been prompt” and “feedback on my work has helped me clarify things I did not understand”. These are serious issues if feedback is to give relevant guidance for improvement in a timely fashion.
Tackling a number of ‘myths’ about assessment and feedback, Brenda questioned whether high failure rates on some courses could be defended as “maintaining high standards” as some institutions might try to do so. The thorny issue of feedback on exam performance also came up - the more students pay for their courses, the more they feel they are owed it. I certainly have some sympathy with the need to offer students training and advice on taking exams, including the opportunity to receive both peer and tutor feedback - indeed we have run an exercise with precisely this aim over a number of years (see ‘You have 45 minutes, starting from now’: Helping Students Develop their Exam Essay Skills). I do, however, worry that this genuine need, and entitlement, would descend into the type of routine calls for remarking that are now rife with A level courses.
Turning to the need for consistency (but stressing that consistency was not the same as conformity), Brenda then showed some discrepancies between the different balance of coursework to examination ratios in a number of departments at a University “not dissimilar to Leicester”. One Department highlighted seemed to assess students in their second year entirely on the basis of exams. Given the lack of feedback students in general receive about exam performance, do these students therefore receive any feedback at all for the whole of that academic year? We were challenged both to know more accurately about assessment practice in other Schools and Depts within the institution, but also to actively seek out examples of best practice elsewhere (e.g. via joint awaydays).
Why do we assess? Brenda gave four reasons: certification (i.e. to show someone was fit to practice), quality assurance, learning and sustainability. She argued that we have perhaps overfocussed on the first two and not enough on the others. Regarding sustainability, for example, do we do enough to equip our students to be sustainable learners themselves, and also to be future givers of valuable feedback to others. Do we encourage students to read each other’s material and offer one positive and one negative comment; to develop a habit of critical assessment?
To make the best use of this opportunity, students will need some training to know what they are looking for. Begin simply, e.g. give them three pieces of work - one good, one average and one weak - can they tell which is which, and why? What feedback would they offer the authors of each piece of work? Moving on from that, what would they feel like if they received the feedback they had just written?
Finally, Brenda pointed us to the Student Enhanced Learning through Effective Feedback (SENLEF) pages on the Higher Education Academy website. She drew our attention particularly to the card-sorting activities and to the seven principles of good feedback practice.
How was it for you?
Next up was Aaron Porter, currently a Sabbatical Officer in the Students’ Union at Leicester, and recently elected to the national leadership of the National Union of Students. Aaron began by showing a series of voxpop interviews featuring about ten students answering a set of questions: What is feedback? What is good feedback? What do you do with the feedback given to you? Does your personal tutor help you with feedback? How has feedback you received helped you to learn? What would be useful feedback to you? The views expressed were interesting, but without offering and particular fresh insights. I was starting to get really cross when all of the students talked about how carefully they re-visit the work after they’ve received feedback and was much relieved when Aaron also expressed his skepticism about how representative this was.
In fact I was generally impressed by Aaron’s presentation and he raised a number of thought-provoking issues. He considered the timing of assessments, the balance of different types of assessment, the usefulness of feedback and the use of appropriate technologies for the 21st Century. His thoughts on timing were probably the most interesting. Communicate with colleagues more effectively to spread out the load - this allows students to actually spend more time on each piece of work, spreads the marking burden for STAFF and has relevance for the mental health of students. The first of these wasn’t new, the second I actually disagree with (I LIKE marking coming in at certain times as it leaves other time periods free of marking) but it was the third point that was the fresh insight. Of course, once aired it makes a lot of sense; multiple deadlines crammed into a short period of time, coupled with financial worries, the burden of parental expectation (especially if they are paying) can be highly detrimental to a student’s mental well-being. He also put in a general plea for earlier notification of exam timetables to facilitate better planning, which is something staff would wholeheartedly echo.
Commenting on the National Student Survey, and the apparently poor satisfaction scores, Aaron made the point that if there is an approx even split between coursework and exams then the fact that most students prefer one or the other means that no-one is ever going to be offering top marks for assessment satisfaction. Good point. He also stressed the need to make students aware that they are receiving feedback in a variety of formats, it is not only written comment and advice from their personal tutors.
Whilst recognising that there are logistical problems associated with feedback on exam scripts, he added his voice to concerns that the status quo is unsatisfactory from an educational perspective. Having said that, Aaron did also query the appropriateness of exam essays as an assessment format at all. Students, he suggested, are increasingly calling for ‘real world’ relevance of the tasks that are set for the. When will someone in employment ever be asked to write on a topic (as opposed to word process), in a linear start-to-finish manner, for a period of an hour, without reference to source materials or the internet? Is it time, he wondered, for students to be allowed to use computers in exams?
Personally, I’m not sure this is a runner - unless there was some kind of auto-archiving as they went along, I can just see lots of people crying into their keyboards after two and a half hours complaining that they’ve accidentally pressed delete and lost all of their work. I’m also not taken with Aaron’s final suggestion for online tracking of coursework so that students can know where in the marking/second-marking process their work has got to, in the same way that you might track the progress of an online delivery. It strikes me this will involve a huge administrative burden for very little net gain. It was funny to hear it so soon after Alan Sugar had mocked the 24-hour hotline for laundry monitoring on this week’s The Apprentice - they seem like two peas in a pod.
More for less?
The last presentation was by Phil Race. This is the second time I’ve been to a session led by Phil and hearing him again reminded me how many practical tips and tricks I’d taken and applied in my teaching after our previous encounter. He is also very generous with his resources via his website, www.phil-race.com. This time around his topic was How can we get better feedback to more students in less time?
One of the points that came across most strongly from Phil was the need to separate feedback from the return of marks; in the table discussion before the talk he went as far as to say that “it’s unethical to give students a mark at the same time as feedback”. Feedback is most useful when it is given within 24 hours of a submission deadline, since the material will be fresh in the minds of all the students. Clearly we can’t be expected to have marked or even read all of the work in that timescale, but there is plenty of generic feedback we can give - the sorts of things that we end up writing time and again on student scripts (which allows the individual feedback we subsequently give to be all the more targetted).
The predictable problem with this approach was raised - how do you cope with late submissions? Phil was clear on this issue too - why should the 97% of student who submitted on time miss out on prompt and timely feedback just because of the 3% who haven’t made the deadline? The problem is sidestepped if an alternative but equivalent Assessment B (albeit deliberately on a slightly less appealing topic) is set at the same time of the original Assessment A. If a student misses the deadline for Assignment A then they do B; that way they get fair treatment if the deadline was missed for a genuine reason.
If you give feedback before you give the mark it also allows for an additional carrot to ensure students engage fully with the comments and advice that we’ve offered - if, on the basis of the feedback given, they come up with a mark within 5% of the mark you awarded they can have whichever is the higher mark. After reading your comments, more than 90% of students will be within that range of your score - you can then target discussions with those who have significantly mis-read the merit of their work and examine where the false perception has arisen.
The other main point I took away from Phil’s contribution - and it was from the round-table discussion rather than the talk - was the merit of offering students a proforma for recording the feedback they have received and the use to which they have put it. The form can be stored in their portfolio of PDP evidence, it can be a tool for aiding genuine interaction with their feedback to make it feedforward, and it may allow them to identify repeat themes coming up from several different markers. Of course some may not choose to use the proforma, and others may simply ‘play the game’ without really entering into the spirit of the exercise, but for those who do make the most of the opportunity it may be a valuable addition to their learning experience.
To summarise:
Overall, this was a useful day - nothing ground-breaking, but some helpful reminders and some new food for thought. As is so often the case, the big frustration is one of ‘preaching to the converted’ - I suspect that the assembled staff are probably amongst those who are already the most conscientious about the feedback they give. It was also interesting to participate in Alan Cann’s experiment in liveblogging using Twitter (with hashtagging) - a valuable way to share and capture insights in 140 character chunks.
From time to time I find myself ruminating on exactly how and where I acquired a variety of study skills. I have no recollection, for example, of any formalised training in finding and selecting source materials and yet even as an undergraduate I seemed to be reasonably adept at choosing relevant information.
Back in those days, of course, finding the material was a bigger task than it is today. The contemporary student is spared the need to leaf through the Index Medicus and then scourer the shelves for the relevant tomes before staggering to the photocopier burdened by the combined weight of several impressively-bound volumes. A multitude of online search engines and databases, coupled with institutional access to a plethora of electronic journals provides the 21st Century undergraduate with more information than they could ever hope to process in time to meet the assignment deadline (to say nothing of the less formal internet sources at their fingertips).
The challenge today is much less focussed on the location of documents and much more heavily skewed towards the evaluation and selection of appropriate material; discriminating good sources from bad and the evaluating the relevance of the material to the specific task at hand. Having recently marked a set of essays where several submissions were characterised by failure to achieve these goals, I am reminded that the challenge of panning through tonnes of data in order to extract pertinent nuggets of gold is considerable, and the skills necessary to achieve this are unlikely to be acquired by osmosis.
It was against this backdrop that I was interested to read a paper The annotated bibliography and citation behaviour: enhancing student scholarship in an undergraduate biology course, written by Molly Flashpohler and colleagues, and published in the Winter 2007 edition of CBE - Life Sciences Education. The paper describes an active intervention to develop the ”Information Literacy” skills of students taking an immunology and parasitology module at a small college in Minnesota, USA.
In keeping with many institutions, our programme includes sessions on making the most of Web of Science, PubMed and other such search tools. In addition to this, I’ve done some work myself on plagiarism-prevention. What I don’t believe we’ve offered previously is any intervention of the type described by the Flaspohlers, in which students are encouraged to undertake a meta-critique of the reference materials they have assembled for a forthcoming assignment.
In the Minnesota model, the students are required to produce an annotated bibliography. This is more than a citation list; each resource they are intending to use must be critiqued in a brief (approx 150 word) paragraph. The students are advised that this annotation should demonstrate, as far as possible: the authority or background of the original author(s); their intended audience; the writing style of the author(s); how this article relates to their project; any bias or point of view apparent in the original work; and to highlight any tables, figures, etc which the student feels will be particularly relevant for their task. Further to this, the annotations are supposed to cross-reference to one another as the student compares and contrasts the specific work with others that they have chosen to cite.
It strikes me that a task of this kind is “do-able” - it could be added as a training step on the way to submission of essays or dissertations that are already part of our courses. The authors describe the improvements they have seen in the seven-year evolution of this intervention - including a shift towards better quality and more authoritative sources, and a concommitant fall in instances of plagiarism. Admittedly they have been working with a relatively small cohort (average 17 per annum), but I suspect that the knock-on merits of adding an exercise of this type would justify the effort of introducing something similar to my group, where n is nearer 100.
To re-quote John Porter, author of an earlier work in the same journal (albeit under its former name): “An awareness of the current literature is as important to scientific research as the careful design of adequate controls“. This being the case, Information Literacy is too significant to be left to osmosis.
In preparation for a recent meeting of our School of Biological Sciences Pedagogic Research group, I’ve been reading a number of articles in the Assessment for Learning genre. My attention was particularly drawn to accounts of ELLI - the Evaluating Lifelong Learning Inventory - project. ELLI has been developed by Ruth Deakin Crick and colleagues at the University of Bristol and is an instrument for the diagnosis and development of an individual’s learning power. As Deakin Crick and colleagues point out in their 2004 paper (Assessment in Education 11:247-272), existing assessments tend to be focused on measuring either intelligence or educational achievement, whereas the measurement of a person’s learning power, that is their capacity for lifelong learning, may actually be the most valuable quality to assess. “There is“, she notes in her 2007 paper (The Curriculum Journal 18:135-153), “an urgent need for our education system to foster flexible, creative, self-aware and dynamic learners who have the capacity to apply and adapt what is learned to their own lives, embedded in their local and global communities, and who can extend their learning and understanding into spheres of thought and action which demand intelligent behaviour in the real world” (p.137).
Having extensively piloted versions of the assessment instrument in a variety of Schools, the ELLI team have presently settled on a 72-item questionnaire that is used to probe students’ self-perception of their relative strengths and weaknesses in the seven core dimensions of learning power. These are: changing and learning; critical curiosity; meaning-making; dependence and fragility; creativity; relationships/interdependence; and strategic awareness. Positive and negative manifestations of these dimensions are summarised as part of the slideshow below, along with an overview of the findings of ELLI so far.
.
I must admit the ability to have a handle on the learning potential of our students is an attractive proposition; it might also be illuminating to take the test myself and see what it showed about my own strengths and weaknesses in this regard! There would definitely be value, even if it was just as a one-off diagnostic. Clearly, however, the most merit comes from being able to combine the diagnostic with a programme of activities that develop and enhance the learning power of the students, in a targeted and individualised way, combined with a reappraisal of their learning power at a later stage.
This is a big ask and one which, with the best will in the world, is going to be tricky to fulfil in the Higher Education sector. All sorts of problems stand in the way - the large cohort sizes; the fact that an individual student is receiving input and instruction from a broad range of colleagues rather than one staff member for a significant time; the impact of the secondary sector, where persistent summative assessment has led students to be entirely goal-driven and only engage if there are marks up for grabs.
The balance between skill development and acquisition of factual knowledge is a recurring tension in HE, but I’d love to be able to utilise an instrument such as ELLI in order to shift the balance more towards learner enhancement and less on information regurgitation.
The fact that you are reading this blog entry at all means that you are already engaging with Web 2.0, which has been defined on Wikipedia as “a perceived second-generation of Web-based services such as social networking sites, wikis, communication tools, and folksonomies that emphasize online collaboration and sharing among users”. In the third talk at the University of Leicester Learning and Teaching in the Sciences conference on 23rd May 2007, Alan Cann raised the potential impact of Web 2.0 technologies in science teaching.
Dr Cann began with the definition of Web 2.0 given in the previous paragraph, and illustrated how broadly we have come to accept interactive aspects of the web with reference to Amazon. Ostensibly an online shop, Amazon offers us the opportunity to review the goods on sale, even allowing us to give critical reports. Similarly, we are invited to rate the performance of sellers for whom Amazon has acted as middleman.
Alan highlighted the fact that, when asked to write an essay, the default strategy of today’s student is to turn to Google and Wikipedia. We may not like it, but this does not change the reality and, setting the pattern that was to run throughout his presentation, Dr Cann challenged us to think about ways that we can work with and develop the students’ study habits rather than fighting against them. So, for example, we should teach students how to use Google more effectively to obtain the best quality information, rather than simply chastising them for using such a shoddy tool and brow-beating them into using the ‘proper’ searches. This does not mean that we abandon training sessions on PubMed, Web of Science and the like, far from it. We start with Google and move on to the more professional tools as an extension of good practice.
Against that backdrop, what is the place of wikis, blogs, podcasts and the like in the teaching of science? Alan suggested that, used appropriately, these Web 2.0 technologies can be particularly helpful in engaging the ‘long-tail’ of less able and less motivated students who do not respond well to the traditional approaches. Clearly we need to adapt our writing style to be appropriate to the medium - the academic journal genre is not appropriate for blog entries which must be more bitesized and engaging.
What about podcasts and ‘viral’ video? Dr Cann shared some insights from his personal experience and research projects conducted over the previous couple of years. Alan has been developing blogs, podcasts and online video for the public understanding of science (specifically microbiology), for using in teaching statistics to first year undergraduates at the University of Leicester, and to share his virtual frogroom with fellow tropical frog enthusiasts. In doing so he has gathered both statistical data and qualitative comments from users concerning the relative merits of different approaches. His observations included:
(1) A general dislike for the ‘push’ model of subscription via RSS feed, people prefer to ‘pull’ material to their computer as and when it looks of interest to them.
(2) Students are happy to listen to ‘work’-related podcasts on their computer, but reserve use of their mp3 player for ‘entertainment’.
(3) More students watch online videos via YouTube, and the like, than listen to podcasts.
Dr Cann finished by reiterating the point that this is not a call to ‘dumbing down’ and that the intention was to offer Web 2.0 resources to students in addition to traditional approaches. The materials produced must remain academically robust, but should be offered in a format that is comfortable and familiar for 21st Century undergraduates.
Professor Melanie Cooper from Clemson University, South Carolina came to Leicester’s Learning and Teaching in the Sciences conference as part of a UK tour sponsored by the Physical Sciences Centre of the Higher Education Academy. In her talk, Using technology to investigate and improve student problem-solving strategies, Prof Cooper began by drawing an important distinction between problems and exercises. Often when people set ‘problems’ what they are in fact asking students to do are ‘exercises’, activities designed to train the participants to be able to tackle similar future tasks in a formulaic way. Problem-solving is about developing a range of skills that will equip students to “address novel situations and arrive at a suitable course of action” (Dudley Herron). It is not, therefore, about knowing how to crank an equation to get the right answer.
In understanding how students approach problem-solving, there would clearly be huge value in directly observing them throughout the duration of a task. Such ethnographic research methods, however, have a number of difficulties. Firstly, the time required for the observations themselves, and all the moreso the subsequent evaluation, is a vast commitment. Secondly, observations tend to be based, for reasons of practicality, on relatively small numbers of individuals.
In her education research, Prof Cooper has been able to access a very much larger cohort (several thousand students at Clemson take general chemistry each year) and has got around the need for direct observation of the students at work by exploiting the IMMEX software, developed principally by Ron Stevens at UCLA. Not to be confused with any similar-sounding floor-to-ceiling cinematic experiences, IMMEX stands for Interactive Multi-Media EXercises. An example of IMMEX use (in the context of genetics education) can be seen in the open access journal Cell Biology Education (see Stevens, Johnson and Soller, 2005).
IMMEX seems to involve some pretty fearsome computing, but I hope the following catches the essence of it. Students carry out an on-line activity working from a single start-point towards a specific correct answer. Along the way they can select from a number of briefing sheets, experimental results and other lab data relating to the problem in order to help them to the solution. Not all of the available information is equally valuable or necessary to complete the task. The software records the route taken by each student from start to finish (a so called ’search path map’), and uses artifical neural network (ANN) clustering to identify and categorise common strategies. The technology has to be ‘trained’ by exposure to a large number of examples, and then generates a ‘topological map’, for example a 6×6 grid of ‘nodes’ where similar approaches are clustered together. Rather than contemplating 36 different approaches, these nodes can then be rationalised into a smaller set of ’states’ representing similar models, in terms of strategies used and/or outcomes achieved. So, for example, a ‘novice’ strategy might be ineffective (i.e. the student is unable to solve the problem) and/or inefficient (i.e. they visit most or all of the pages before completing the task), whilst an ‘expert’ would take a more efficient and effective route encompassing only the necessary information sources.
The use of ANN allows for helpful categorisation of students’ performance in a particular task. This can be used to provide them with formative advice on how they might improve their approach. At this stage a second approach is used to predict and to evaluate the changes in strategies that students make when offered the opportunity to undertake one or more similar tasks. With sufficient data Hidden Markov Modelling (HMM) can make statistical predictions about the likelihood that students using strategy X will use the same approach again the next time, or whether they will swap to a different tack, and if so whether it will be strategy Y or strategy Z. The challenge then is whether interventions that we make can move the students on towards a better strategy.
Work by Prof Cooper and others has shown that individual students, be they ‘novice’, ‘competent’ or ‘expert’ at the outset, can improve their competence by repeating activities - but only up to a point. After five performances, or fewer, none of the participants working on their own exhibited any further improvement in either their ability or strategies employed. How, therefore, can educators help students to make further refinements in their problem-solving abilities?
Melanie’s evidence shows that an answer lies in group work. Working with others, particularly those of with different approaches (see below) involves metacognition, i.e. it forces the students into explicit reflection about what they are doing. Tackling a problem collaboratively exposes students to new ways of thinking and/or offers them clarity about why certain approaches are less useful. What’s more, there is evidence that the improvements made by involvement in group work are retained if the students are subsequently required to work on their own again.
What group arrangements work best? Groupings should be organised by the tutor, not left to the students to choose. The maximum group size should be four, and the majority of benefit can be achieved by students working in pairs. At Clemson, they use the GALT (Group Assessment of Logical Thinking) test as an initial means to identify the type of thinking employed by students - concrete (C), transitional (T) or formal (F), according to the Piagetian model. Following the GALT assessment, students in Prof Cooper’s research were assigned to pairs according to all possible combinations; FF, FT, FC, TT, TC and CC. It was clear from the research that there were distinct combinations that afforded greater improvement (to at least one of the pair). For example, ‘transitional’ students paired with ‘concrete’ improved the most. Overall female students improve more than males via experience of groupwork, but there was no significant difference based on whether pairings were single sex or mixed gender. Male students, incidentally, improved more as a result of using concept maps than as a result of participation in groups - but that’s probably a story for a different report.
Other talks at the Learning and Teaching in the Sciences conference, by Norman Reid and by Alan Cann, are discussed elsewhere on this site.
Each academic year since 2005, the Higher Education Academy in the UK has run an essay competition for current students to express their views on an aspect of teaching and learning. In 2007, the theme was “What advice would you give to students starting your course?“ The top entries submitted by Bioscience students have recently been made available on the HEA Centre for Bioscience website. The winning author Aneeqa Meedin, from the University of Sheffield, produced a thought-provoking ten commandments for biomedical science students.
The annual Learning and Teaching in the Sciences event at the University of Leicester was held on May 23rd 2007. Three invited speakers brought very different insights into the effective communication of science. This entry focuses specifically on the first of the presentations. Other talks, by Melanie Cooper (Clemson University, USA) and Alan Cann (University of Leicester) will follow in subsequent posts.
Norman Reid (Professor of Science Education, University of Glasgow) addressed the subject of the ways we can maximise the impact of our teaching by taking into account scientific studies into the factors that influence learning. I had heard Norman speak previously on the subject of pedagogic research methodology (he has written a very useful booklet on the subject on behalf of the Physical Sciences Centre, Higher Education Academy). I had high expectations, and I wasn’t disappointed.
Early on in his talk, Norman emphasised the importance of Working Memory Capacity (WMC), in other words how many ideas are we capable of holding in our short-term memory at any one time. In an exercise reminiscent of the 1980s gameshow The Krypton Factor, we were asked to convert a date into single digits, and put them in numerical order (without writing them down). So, for example, 7th April 96 would be 4-6-7-9. As the number of digits involved increased, the capability to solve the puzzle diminished. If, therefore, we are presenting students with more distinct pieces of information than they can cope with (in other words, if the information load of our teaching exceeds their working memory capacity, then this is going to have a detrimental impact on their learning. Rather than a linear decline in success as information load increases, there is a sudden collapse in performance. For most people, the WMC seems to be about 7 items. This number varies from person to person and, it seems, we can do little to change it. Norman mentioned grouping strategies and pattern recognition as ways in which we can carry more bits of information than our WMC, but this is making the best of what we’ve got, not stretching the underlying capacity. He didn’t specifically discuss mnemonics, but I guess these are an example of a grouping strategy.
The place of WMC in an information processing model was then fleshed out. In addition to Working Memory and Long-Term Memory, an important role is also played by a Perception Filter. I took the latter to be a subconscious self-recognition of the number of bits of information you can cope with. To draw an analogy (my own, apologies to Prof Reid if I’ve got this wrong!) - if you were the captain of a ship, you would know how much cargo you can carry on board. You would decline extra items, even if they were on offer. In similar vein, a perception filter allows you to ‘know your limits’ - there may be extra information on offer, but when you know you are in danger of overload you engage mechanisms that stop taking too much on board, lest the ’ship’ sinks. I guess, by extension of my image, there is benefit in being able to distinguish valuable cargo from junk, which is probably one reason why our previous experience and our long-term memory influence the effective working of our perception filter. Norman used the term field dependency for the ability to see what is important, to distinguish the ‘message’ from the ‘noise’.
Pushing my analogy to its conclusion, I suppose our role as educators would equate to the port authorities or harbour master. We need to be aware of the number of fresh bits of cargo we are offering to our students, and ration their delivery so that we reduce the risk than anyone tries to set sail with too much on board (suspicion I pushed that too far - Ed).
In the next phase of his talk, Prof Reid moved on to consider the idea of pre-learning. At its most simple, this might be starting a lesson or a lecture with a couple of minutes of reflection (”ok, who can remember what we discussed last time?”). This is all about making connections between different nuggets of information. Having a list of review questions up on the screen at the start of the lecture and asking students to work through them in pairs was a recommended model. This might be extended to a formal short activity or exercise taking place before a major lecture or laboratory practical to draw attention to what are going to be the main points, thus equipping the students more effectively to distinguish message v noise.
Once again, these ideas rang true for me. I know I’m not alone in seeing that one of the downsides of modularisation has been the compartmentation of knowledge. Students do not necessarily see the connections between the different teaching within a module and less so between units. It is one of the roles of the educator to make explicit the links to previous and future teaching, since they (hopefully!) have a better grasp of how the bits fit together.
Prof Reid emphasised that reducing the working memory load was emphatically not a call for ‘dumbing-down’. The challenge is not to throw out the hard topics, but rather give conscious consideration to the order in which material is covered, to connections between material more overt and to break down complex items into more comprehensible sizes.
As the session moved towards questions, much of the discussion focussed on the research methodologies employed to produce the scientific data undergirding these views. In particular, delegates and speaker alike expressed a frustration that the demands for ‘fairness’ meant that it was becoming very difficult to conduct proper comparisons between groups experiencing different teaching. True, crossover studies (where group A is taught using method X and group B is taught using method Y, and then the two groups are swapped over for a second phase of teaching using the other method) can partially fulfil this need, but there are plenty of occasions when this is not truly feasible. In consequence, many of the most informative studies have been performed outside of the UK. Food for thought.
The name of the blog has its origins in lectures I give on referencing for university assignments. Not surprisingly, undergraduates sometime struggle to recognise that papers published in certain journals are deemed more worth that articles appearing in ‘lesser’ publications. To avoid potential offence to any particular periodical I would stress that “An article appearing in Nature is generally considered more authoritative than one published in the Journal of the Left-handed Biochemist“. As of now, the latter is no longer fictional; the sentiment, however, is probably still true.
I’ve been running the Bioethicsbytes site for a while now and am very pleased with the way it has been received by colleagues involved in education. That site, however, has a very specific niche focus on multimedia resources for teaching about bioethics. Several times recently it has occurred to me that something I was mulling over would be of general interest, but doesn’t fit with the tight aims of Bioethicsbytes. Hence the birth of the Journal of the left-handed biochemist. Whether or not the posts do turn out to be of interest (or indeed whether there are going to be any posts) remains to be seen.
