The importance of piloting for real

We are currently in the middle of piloting our new online assignment handling system as part of the Cascade project.  While we are finding out all the usual technical glitches, more than anything what testing this with real students, real course directors and real tutors, submitting real assignments has revealed is:

  • how generous people can be in trying a new system for something which is so important to them.
  • how you can think you have thoroughly mapped all processes in abstract but there will always be some aspect which nobody mentioned until it happens in practice.
  • how completely random people can be.

While we certainly did not think our documentation and support assumptions were going to be perfect, with a lot of testing on trial assignments we thought we were probably on the right track, and for most of the process and the vast majority of  students and tutors we were.

However where things did deviate from our expected norms, they did so in unanticipated ways.  I won’t go into the minutiae here but it is certainly making us think about what are the issues you can plan for and design out, and what is going to happen no matter what you do.

Piloting VLE support for F2f courses 1 year in

As part of the Cascade project  one of the things we have been looking at is how to take the best of what we know about supporting our online distance learning students and use it to see how we should use a VLE to support students who are essentially studying face to face courses with the Department.  As part of this we piloted this activity with a few courses in  over the last academic year, including our Undergraduate Diploma in Archaeology and our Psychodynamic counseling Certificate, Diploma and MSc.  We’re still collecting feedback from our students (more on this later) but have finished our initial collection with staff.

Some of the findings have been reasonably predictable – using the VLE to easily contact students (especially during extreme snow) and to share materials are clear winners in the value stakes.  However some are slightly less so.  We have a lot of courses with many different sessional teachers, and while we did a good job at explaining Moodle to our core staff, piloting partners and students we did a less good job of engaging with these stakeholders, who often remained confused or oblivious about what Moodle was for and how they could use it.

So a new task for the summer to develop materials for this group.

Testing Moodle templates

http://www.flickr.com/photos/mrbill/3267227227/

In the Cascade project we are in the middle of an intensive period of testing Moodle templates with departmental staff.  In the terms of our project the “templates” are Moodle courses with certain core materials and structures already in place which hopefully offer the following benefits to our staff:

  1. Save them from recreating the wheel in terms of identifying resources, links etc
  2. Ensuring all expectation setting and contextual materials are in place – what is unacceptable online behavior? does an online course support site mean my tutor will answer my emails 24 hours a day?
  3. Improving chance of producing something which will be truly valuable to students from the start, rather than having to try and work out what might be useful from scratch.

We have shaped the templates from the results of our pilots over the last year or so as well as our experience in learning design and from the literature more generally .  With this in mind we were pretty confident that the elements we were including were likely to be appropriate and useful, however it is fascinating to actually work through the process with  practitioners.

I think what has really changed in the last few years is the baseline awareness of the sorts of things technology might be able to offer to support a course – this has moved on immensely even in the last couple of years – even if staff are not always confident of how to get the technology to do what they want.  It also feels like for many academics that their perceptions of their IT competence is often worse than the reality.  Moodle is easy enough to use,  that if you can add an attachment to an email you really should be able to get pretty far.

Beyond Borders – OERs at Oxford

Yesterday I was at the very enjoyable  Beyond Borders event, hosted by our colleague at OUCS which looked at OERs and work of the OpenSpires in particular.  With many of the presenters stranded all over the globe they did an amazing job of bring things together and managed a truly multimedia experience. In one respect I was there with a Mosaic hat on, and it is a relief to find that our conclusions from that project remain equally true today.  More generally it was great to hear what OpenSpires has achieved in the last year.There is an great  summary of the event here, generated from twitter feeds and live blogging throughout the event.

However for me personally the most interesting aspects were hearing:

  • Andy Lane talk about the OU experience, they are  continuing to do so much and there is a lot I want to follow up – In particular i think the work Patrick McAndrew and others are doing through OLnet is going to produce some very interesting findings in coming years.
  • Jan Hylén showing  how much the OER movement has grown in a short time
  • Timm Unwin talking about his experiences ICT4D in Africa I completely agree that the idea that greater challenges of HE in Africa should make reuse more prevalent is wrong.  We should not be surprised that people find it just as hard if not harder to reuse in resource poor contexts.  But real sympathies on the challenges of working in this space which really took me back to our Global Health project.
  • Robin Wilson who presented using OHPs but in the best practice of trendy PowerPoints used virtually all images and no words, although I wonder if they were all copyright cleared images?

Also a great chance to catch up with so many interested in this area.  I am sure they will have most of the sessions released as OERs themselves soon, so do check them out.

OERs and China

I was recently teaching a session on online distance learning as part of the  e-Learning MSc here in Oxford.  During this I asked the students to critique an OER as an examples of effective online distance learning (or not).  As part of this  one of our students, Kitty Tong reported on her experience of OER use in China which revealed a picture of much more systematic reuse than seems to be the case in most other palces.

She demonstrated Core (China Open Resource for Education) which act as a portal for OERs in China (there may be many others).  In particular it was amazing to hear about the amount of volunteer translation taking place and the extent that students were making their own informal learning opportunities around these resources.  Her description reminded me of some of the vision of independent learning, collaboration and reuse the OpenLearn team had for their resources which was only realised to a limited extent.

Now all I need to do is learn Chinese so that I can check this out properly for myself.

Reuse in action

Having been involved in several research projects around the area of OERs (especially OpenSpires) and more specifically the reuse of existing content (Mosaic and Cascade),  it is really gratifying to see some of this work enter our mainstream course production practice.   A major benefit of Mosaic was a real tightening up of our approaches to reuse, copyright and IPR across our entire short course programme and this is now starting to really pay dividends.

An example is the course we are currently developing on Globalization, available in May.  Among other things, this course is using podcasts recorded by the author Jonathan Michie with the OpenSpires team.  As we will be providing transcripts to make the course fully accessible we can make sure that these are fed back to enhance the original OERs – a virtuous circle.

Reciprocate at Copenhagen

Learning

The RECIPROCATE programme will allow global access to innovative online learning materials to enable scientists, climate practitioners and policy-makers to understand and exploit regional climate predictions.

Community
RECIPROCATE will additionally build and support an online community of practice through which, knowledge and expertise about regional climate modelling can be shared. This will be of particular benefit in countries where such expertise is not so readily available.

Expertise
RECIPROCATE combines climate prediction expertise from the University of Oxford climateprediction.net team and the Met. Office Hadley Centre PRECIS team with the expertise of the University of Oxford Department for Continuing Education’s expertise in delivering innovative and effective education and training solutions.

logo-bbg-nq8

Like everyone else in the climate world some of the partners in the RECIPROCATE project will be at the Copenhagen COP 15.  Richard Jones (Met Office) and Niel Bowerman (climateprediction.net) will be at the Met Office and University of Oxford stands.  If you are at Copenhagen you can try and catch up with them, otherwise you can just visit our website to find out more and register your interest.

Finding OERs

One of the biggest challenge for OERs is getting used.  Despite many large scale projects I suspect most would say that uptake is relatively disappointing. I am sure the new JISC funded OER projects won’t be satisfied with only making everything available in JORUM – but it will be interesting to see what you can find using a basic Google search in the spring.

For OpenSpires the  OERs we are producing are podcasts which also means that they don’t have the full text information inherent in most other online content, suddenly metadata and perhaps more importantly resource description becomes more important. However we also know that for the creation of OERs to really take off it is more important for the sharing process to be lightweight and easy then to expect our academics to not only podcast in the first place but then to subsequently provide all the information a consumer could ever require.

However with web 2.0 we are also in a situation where it is not just the content creator who can potentially supply information that makes a resources more discoverable.  Recommendations, ratings and comments, as per Amazon etc as well as the sort of metadata a system holds about how a resource is used, by who , when and where, are all things that help a user work out which resource is most likely to be for them.

The problem with educational metadata

Continuing to think around the information to provide around our OpenSpires content it is reminding me how problematic educational metadata is.  It seems obvious that learning objects or OERs should be discoverable by metadata describing things such as, subject and educational level and it is arguably desirable that things such as instructional method or pedagogy might be covered as well.  However from both our work reusing content and in learning design it is clear that the latter is almost never something that can be usefully encapsulated in a few simple terms, and while there are many lists for subject and level they are often surprisingly hard to penetrate. Browsing by subject in JORUM English literature is under Linguistics (can you tell what subject Mosaic was in) and while I know what Undergraduate level 1 means I am not confident I am right in guessing it maps to  SCQF 2, Entry level 1, CQFW Entry, Access 2.

Clearly repositories like JORUM are just trying to make sense of a complex landscape – but we already know perceived complexity of the process is a barrier to sharing – and the reality won’t help.

So for now I think we are going to ask people to provide information in the following areas, title, description, subject, keywords and some variation on intended audience/use which will hopefully be a way of indicating level.  As much as possible relying on existing information and individually provided definitions and see what comes out.

OERs for teachers or learners?

I am sure most OER projects would say both…but in looking at this area recently it is clear there is a fundamental difference in expectations between making your OER available in iTunesU or YouTube and placing it in a repository – yet most of the debate in this area does not make the distinction.

In Oxford we have a track record in both, iTunesU is acting as the launch pad for our OER work, but projects like Mosaic were always more teacher focused.  I know both camps would want all of these to be used by everyone, but I suspect there is more we could be doing to make it actually happen.