The Learning Black Market

Last week I gave a talk about what I call the Learning Black Market at a Guardian seminar on the uses of Social Media for learning and teaching in higher education. It’s something that I have seen emerging from the data we are collecting for the Visitors and Residents project and from interviewing students for our study on the use of Open Educational Resources. In simple terms students personal use of the internet is generally very effective for their education but they are nervous that their practices are not valid and don’t reveal them to their tutors. The messages or lack of messages from educational institutions on these practices is generating a learning black market which masks the sheer scale of these new modes of engagement.

Scott Room at the Guardian

Printing press outside our Guardian seminar room

The Visitors and Residents project is capturing student’s motivations to engage with the web for learning in as broad a manner as possible. To guide our understanding of the interviews with students in the UK and the US we have added a vertical axis (see below) to the Visitor and Resident continuum. The Personal/Institutional axis allows us to plot student’s online learning activity and accepts that this activity is not bounded by resources and opportunities provided directly by the institution they are studying at. As the project progresses we hope to plot students trajectory through this digital landscape. It should also be possible to use this map as a tool to reflect on institutional approaches to digital literacy.

The learning black market exists largely in the Personal area of the map. Our data from the Transitional education-stage (Late stage secondary school + first year undergraduate) is indicating that learning activity in this area has two main elements:

Vistors and Residents map

1.    Emergency collaboration

Many of the students we have interviewed wait until the night before coursework is due then IM their friends in Facebook to confirm what they have been asked to do and to check they are taking the right approach. If they can’t find their friends in Facebook they text them to either ask for clarification or to encourage them to log-in to Facebook. There is an expectation that someone from their class will be in Facebook when they need them which is one of the reasons that coursework can be left to the last minute. I suspect that Facebook IM is used extensively for homework as it’s convenient and immediate. It’s also private and a very low risk way of collaborating with a fellow student. The extent to which coursework is actually completed via this method rather than just clarified is difficult to assess. There is a lack of understanding amongst students as to what constitutes plagiarism in this scenario and a consequential wariness around discussing this type of practice. The line between collaboration and plagiarism is not easy to define and I believe students would benefit from this area being openly discussed. This practice is also an interesting reminder that much of the activity in Social Media is not visible. Wall postings and twitter streams only represent a portion of the activity in these spaces meaning that platforms such as Facebook are effective at facilitating Visitor style approaches.

2.    G.W.R.

The majority of students activity is information seeking, this could be via another person but is usually a more direct engagement with ‘content’. What appears to be a common practice (we are still in the process of analysing our data) is this very simple process.

Google > Wikipedia > References

A search on Google to help complete an assignment commonly returns a Wikipedia article. As we know Wikipedia articles are pitched at an ideal level and length to get a handle on a new subject which is something our Transitional students have to do a lot. The problem is that most of the students in the Transitional education stage we have spoken to in the US and the UK have been told not to use Wikipedia and so keep this practice a secret. A simple way to do this without losing the value of the platform is to cite the references attached to the Wikipedia article rather than the article itself.  This appears to be a very successful strategy for coursework but can be done without any substantive learning taking place.

Learning Black MarketThere appear to be two main reasons that students have been told not to use Wikipedia. The usual, culturally acceptable, reason is that it’s not accurate because ‘anyone can edit it’. It’s difficult to support this claim and as Jimmy Wales said recently the decline in Wikipedia editing activity is partly because many entries are now so accurate that only key experts could add to them. There are examples of what I would call knowledge vandalism but these tend to be so farcical that they are easily identified. Even so the students are wary of Wikipedia despite rarely finding it lacking when they use it:

“…a lot of the times teachers say don’t use .com or don’t use Wikipedia, they like hate when we use Wikipedia.  But Wikipedia is always right, so I always use that. “

The second and more telling reason which is rarely expressed is because it’s too convenient. One of the US students asked a tutor outright why they didn’t like Wikipedia and got this response:

“The problem with Wikipedia is it’s too easy.  You can go to Wikipedia, you can get an answer, you don’t actually learn anything, you just get an answer. ”

The tutor then goes on to say that the process of learning is about collating and critiquing multiple sources not simply taking in a correct answer i.e. the path you take in forming a new understanding is as important as the resultant knowledge. The very valid ‘show your workings’ standpoint.

Student at laptopThis is fundamental to the debate around technology and learning and the real issue at stake. Describing the web or Wikipedia as ‘inaccurate’ or negating the use of sources that have been written by multiple ‘non-expert’ authors has little impact on the actual practice of students (or the success of those practices). The debate should be around how we evolve educational processes to take advantage of or to account for these new forms.  We cannot continue to teach the literacies that have been the mainstay of the educational system in their current form because the web smashes traditional paths to understanding.

There are good examples of the ways in which the web can be used to facilitate learning, new approaches which accept the situation has fundamentally changed and that learning is now less likely to be the result of successful information seeking. Many of these methods involve a more Resident approach to negotiating understanding and use classic scholarly notions of discourse to encourage learning over and above the now largely redundant retention of knowledge.  Unfortunately it appears that many practitioners are turning a blind eye to these issues and are stigmatising emerging learning practices by simply banning talk of platforms such as Wikipedia.

“They don’t fail you but you get ridiculed in front of everyone for sourcing Wikipedia.”

This is generating the learning black market in which is it all too easy to simulate understanding for coursework and formal assessments. Worse still, it is a market in which genuine learning can take place but is not being recognised because resources and practices are not seen as valid and therefore do not become visible to the formal education system. Students have told us that they learn from Wikipedia but also skim read the textbook to cover their backs in case they are asked a direct question…

Whatever the case it is clear that students need guidance on how to engage with the web for their learning and would greatly benefit from clearer messages around what it means to learn in the twenty-first century and how their practices may or may not intersect with the formal educational frameworks they find themselves in.

 

Images:
Scott Room – David White – CC attribution
Visitors and Residents map – CC attribution
Learning Black Market – Gilderic http://www.flickr.com/photos/lanier67/5253473681
Student at laptop – cindiann http://www.flickr.com/photos/trucolorsfly/438068232/

21 Responses to “The Learning Black Market”

  1. Jo Badge Says:

    After two weeks of being a PGCE student myself I can fully appreciate the sentiments here. Our tutors have told us not to use Wikipedia as a source. It is the first place we have all looked for information on any topic from educational theorists and psychologists to science projects. It gives a brilliant overview that signposts the main ideas involved and gives you jumping off spots for further research. We are expected to read from journals but google scholar was put in the same category as Wikipedia (not scholarly) as a search engine an dht bibliographic database searching training is weeks away.

  2. Frances Bell Says:

    I have never understood why some teachers try to ‘ban’ Wikipedia. Wikipedia isn’t isn’t homogenous. By its very nature, pages vary wildly in terms of quality and the crucial thing is how students use it effectively:
    1. as a valid source – for example in my update of a Year 1 lecture I am happy to use this page http://en.wikipedia.org/wiki/File_sharing as a back up resource for students to check unfamiliar terms and a bit of history
    2. as a jumping off point – the reference list might be a good starting point for further research
    3. as inadequate http://en.wikipedia.org/wiki/Actor-network_theory – a student reading this page should be able to see that they need to consult better sources

    However , I find myself wondering what sort of valid assessment could rely mainly on sources such as Wikipedia. You quoted a tutor saying “process of learning is about collating and critiquing multiple sources not simply taking in a correct answer i.e. the path you take in forming a new understanding is as important as the resultant knowledge. The very valid ‘show your workings’ standpoint.” That is just one aspect of ‘assessable’ activities, namely selecting, evaluating and synthesising (literature) sources and one that is done particularly badly on many new media publications IMHO. That is why it is so dangerous to separate that from of learning activity from context. When we ground our assessment activities in a specific context (e.g. by writing our own case studies not reusing those of others that are publicly available) we can safely welcome students use of Wikipedia (selectively of course) and other sources.
    Sorry for the rant;)
    My motto is ‘Ask questions that make them read, analyse and , most of all, THINK!’

  3. Anne Marie Cunningham Says:

    Wikipedia has made access to summaries of knowledge undoubtedly easier than ever before. And a textbook is a summary of knowledge too. If students are not being given tasks which require them to go beyond knowledge summaries, or if they don’t value this process then we do indeed have a problem in higher education.
    The process of comparing text to Wikipedia seems another good way to engage more deeply with learning. But if skim reading a textbook or Wikipedia is enough preparation for a tutorial that is a little surprising.
    Medicine has continually been criticised for being over-burdened with facts. Wikipedia is a great source of facts. But hopefully we are moving on to asking students to engage with more authentic learning tasks.

  4. Daniel Livingstone Says:

    Hi Dave,
    Definitely something worth investigating, but I think you’ve picked totally the wrong label. “Learning black market” is very catchy (part of the reason you picked it no doubt). Less catchy, but what you are talking about is the hidden and underground role of online networks in learning.
    One of the key words here is ‘market’ – essay writing services, subscription based sites full of tutorials, possibly even gradeguru.com (with its various in built reward systems) – all fit the term of the Learning Black Market than the free services and networking forms discussed here.

  5. Daniel Livingstone Says:

    ps In my 1st year computing systems class I not only allowed the use of wikipedia, but I made extensive use of wikipedia and wikimedia commons (and other CC sources) to develop my materials in the first place.
    It allowed me to highlight to students that there is variability in the quality of articles (there was article with some very spurious assertions that I had to edit), and by crediting all of my image and text sources I can provide a good model for how to cite sources…
    Plus it saved me a massive amount of time :-D

  6. Josie Fraser Says:

    Excellent post & really fascinating insight into the twilight world of illicit learning practices. However, not sure what you are talking about is, strictly speaking, a learning black market – since what the young people you’ve been talking to are studying isn’t currently illegal, and neither are the devices, practices and spaces they are using (although the under 13′s using Facebook in a similar way might slip into this category). Wikipedia defines a black market as “the trade of goods and services that are illegal in themselves and/or distributed through illegal channels”. I think what you are describing here is more accurately a grey (or parallel) market “the trade of a commodity through distribution channels which, while legal, are unofficial, unauthorized, or unintended by the original manufacturer”. Obviously the market metaphor raises the recurring question of the commodification of education, never necessarily a bad thing :)

  7. Pat Parslow Says:

    A couple of queries – you mention Facebook et al “are effective at facilitating Visitor style approaches”. Facebook (and the like) users are much more likely, as I understand it, to be towards the ‘resident’ end of your scale. The ability to get in touch with others because they are likely to be online merely emphasises the fact that this is a Resident mode of operation. Visitors, particularly visitors in a community of visitors, do not get the convenience of having others ‘at hand’ to answer in a short time-frame. Further, visitors in a community which includes residents are in danger of being seen as too ‘self-oriented’, treating the rest of the community as resources.

    “Whatever the case it is clear that students need guidance on how to engage with the web for their learning and would greatly benefit from clearer messages around what it means to learn in the twenty-first century and how their practices may or may not intersect with the formal educational frameworks they find themselves in.” Actually, I would say that is far from clear. What you are describing here shows that they have adequate learning methods to allow them to jump through the institutional hoops with the minimum of effort – almost exactly what will be required of the vast majority of them in the workplace. What *is* necessary is for the interaction with formal education frameworks to be clearly examined and evaluated – whether this is to explain how to adapt useful, working, behaviours to fit with it, or to bring it up to date with the 21st Century is a moot point.

    What the student probably need most is to be given activities where they can learn from the experience of getting work done early, in a timely and well organised way, and seeing that this leads them to better results (in terms of learning and the results of arbitrary marking schemes).

    Most of the results I’ve had from interviewing and surveying students over the last 5 years bear out the fact that there is a ‘black market’ though. And I have to agree that students do not tend to reveal their tips’n’tricks to people they perceive as ‘institutional’.

  8. David White (@daveowhite) Says:

    @Frances and Anne: Of course I agree that we should encourage students to think and to dig deeper. What worried me was the implication that the web was at fault for students lack of thought by making things too easy. In the case I mention I believe the tutor should redesign his approach not simply ban Wikipedia on the basis of convenience.

    @Daniel and Josie: I chose the name ‘Learning Black Market’ because of the way in which I think current approaches are pushing students learning practices ‘underground’ (as Jo’s experience would indicate). It’s the clandestine aspect of the phrase that I’m interested in. The ‘goods and services’ are not in themselves illegal but they are being treated that way by students. Both of you are part of a highly Resident learning market and are very well aware of the trade value certain forms of knowledge within learning networks. The idea of market doesn’t have to be tied to commerce in a monetary sense. Bartering is common in black market situations and I would suggest that it’s this form of commerce that best represents the Twitter and Blogging culture. A nicer way of putting it is to talk about the gift economy…

    As I mentioned, students in this early Transitional stage are very reluctant to discuss this kind of knowledge bartering, or it could be the case that they haven’t formed strong networks yet and tend to work one-to-one. I’m hoping that as the project develops and we interview students in later educational stages we will start to gain a clearer picture of the ‘market’ aspect of learning out on the web. I imagine that as students move through their higher education and beyond they grow their learning networks and as they gain confidence in the validity of their personal learning approaches they start to ‘trade’ in more visible, more Resident ways.

  9. Daniel Livingstone Says:

    @Dave
    I take your point, but given that there genuinely is a black market in learning (essay writing for hire, etc.) I do think your use of the term misleading. The blog post was not what I expected from the title :-)

  10. David White (@daveowhite) Says:

    @Pat Thanks, that’s a really useful way of framing the ‘problem’ and how we should respond. I especially like the point that formal education frameworks need to be reassessed i.e. it’s not the students fault Wikipedia is easy to use.

    The Visitor-Resident point is also very interesting and a tough one for me to unpick. The ‘Emergency Collaboration’ scenario does require students to be Resident but the actual collaboration is not highly visible online and therefore quite Visitor in character. I suppose the point is that you need to be reasonably Resident to be able to take advantage of your learning network even if you do this in a fairly private one-to-one manner. You will notice that I plotted this activity right in the middle of the continuum. :)

  11. Paul Richardson (@paulbrichardson) Says:

    This is a really thought-provoking post, which has struck a chord with me and, I suspect, many others.
    A few years ago, I used to run a workshop activity with educators in which each person was required to specify an area of expertise, and then to evaluate the quality of material in Wikipedia on their subject. With some groups, I have turned this activity it into a simple challenge: ‘Find Something Wrong’. Either way, I find this task makes people really uncomfortable, which is no bad thing if you can use it to your advantage and perhaps bring them to a happier place by the end. The reason it is uncomfortable is of course that it is pretty hard, which I think the learning tech community knows quite well, but others appear to be in denial about still. As Dave says, the view that ‘it must be inaccurate, because anybody can edit it..’ is still widespread. This view needs to be challenged and re-challenged at every turn.
    For me, one of Frances’s comment is very helpful in this context: ‘The path you take in forming a new understanding is as important as the resultant knowledge’. Absolutely! It follows that a skilled and honest academic will be comfortable with the notion of showing the students how they got to where they did in their understanding. If this includes reading, or perhaps even editing, Wikipedia – then why not?

  12. Anne Marie Cunningham Says:

    Thanks Dave.

    I wanted to share two posts from my own blog from 2009. The first is about where first year medical students told me they ‘looked things up’ :http://wishfulthinkinginmedicaleducation.blogspot.com/2009/06/where-do-first-year-medical-students.html
    Wikipedia featured prominently and I had no problem with that. But I was interested in the views of others- see interesting discussion in comments. And it got picked up in a ZDNet post too: http://www.zdnet.com/blog/education/med-students-should-be-editing-not-using-wikipedia/2661

    Later I met one of these students again and he told me about how he thought he had sabotaged an information literacy exercise by editing a Wikipedia article to make it better.
    http://wishfulthinkinginmedicaleducation.blogspot.com/2009/10/information-literacy-teaching-sabotage.html

    Hope that these might be of some help:)
    Anne Marie

  13. David White (@daveowhite) Says:

    @Anne That story of ‘sabotage’ is a great example of how formal education approaches have not yet shifted to take account of the web. The way in which a student improving the quality of our collective knowledge became an act of pedagogical sabotage is telling.

  14. David White (@daveowhite) Says:

    @Paul I think that culturally we are still in love with the notion of the ‘expert’ which is why Wikipedia makes people nervous. Perhaps all courses should start with a critique of relevant Wikipedia pages? Better still, as Anne mentions any errors or weaknesses in the entries could be corrected as part of the process.

  15. UK Access Management Focus · Life will find a way Says:

    […] debates about in REFEDS and Shibboleth circles. I was really pleased to see his latest piece on the Learning Black Market as it highlighted concerns I have had for some time about the way we are presenting resources to […]

  16. staplegun Says:

    I’ve always found it hypocritical that lecturers ban Wikipedia, then turn around and provide handouts of all the reading they need in photocopied articles!

  17. » JISC Online Conference session on digital literacy (#jiscel11) literaci.es Says:

    […] and Residents but spent most of his time talking about his intriguing idea of there being a ‘Learning Black Market‘ in education. Students, he contends, develop their ‘user-owned’ literacies that […]

  18. UK Access Management Focus · How can we create an identity economy for research and education? Says:

    […] David. “The Learning Black Market”: <http://tallblog.conted.ox.ac.uk/index.php/2011/09/30/the-learning-black-market/&gt;. Accessed 10th October 2011. No comments Comments feed for this article Trackback […]

  19. Visitors & Residents with @daveowhite #JISC — Digital Fingerprint Says:

    […] The Learning Black Market : http://tallblog.conted.ox.ac.uk/index.php/2011/09/30/the-learning-black-market/ […]

  20. Wikipedia ist keine Loseblattsammlung « Jakoblog — Das Weblog von Jakob Voß Says:

    […] In einer Studie zum Lernverhalten im Internetzeitalter fasste kürzlich ein Tutor das Problem für die passive Wikipedia-Nutzung zusammen: The problem with Wikipedia is it’s too easy. You can go to Wikipedia, you can get an answer, you don’t actually learn anything, you just get an answer. […]

  21. #vandr: the webinar experience at Danegeld Says:

    […] axis in order to plot a student’s online learning activity (described further in a post on the learning black market), and other axes could be added, perhaps consumer vs producer, individual vs social […]