RSAMD Mahara

ePortfolio’s

“An unfolding narrative of a unique learning journey”

(JISC 2008)

How can ePortfolio solution’s such as Mahara provide and enhance employability skills through Personal Development Planning to Academy students?

Current research being carried out by organisations such as JISC and BECTA have identified that e-Portfolio’s can enhance Employability Skills, Lifelong Learning provision, Internationalisation, Retention, Widening Participation, Achievement and Attainment Levels along with offering a high level of Personalisation to the learner. (JISC 2008) With these high level agenda items in mind and a pressing need for an improved Personal Development Planning framework within the Academy, this investigation was both timely and required.

The Academy’s Learning and Teaching strategy clearly states that its mission which, in essence, is to nurture creativity through a focus on the individual through the promotion of innovative methodologies and the exploitation of new and emerging technologies.

The term portfolio has a range of meanings, depending on the context you are engaged with, with Higher Education it can be best described as a collection of artifacts (evidence) presented alongside associated reflections for learning. This archive is collated and drawn on by the learner as evidence of learning achievement. These achievements can then be used to plan targets and set goals. Therefore a portfolio can be associated with the gathering of records which can be used in the Personal Development Planning (PDP) process. The concept of Personal Development Records (PDRs) is closely related to the Higher Educa-tion Progress File, a recommendation found in the Report of the National Committee of Inquiry into Higher Education (Dearing, 1997) and extends beyond that, to incorporate artifacts which may evidence claims made in PDRs. Many institutions are choosing to implement PDP (and to encourage learners to manage their PDRs) through electronic means, often linking this to the term e-portfolio (Ward & Richardson, 2005) .

In 2008 The Academy made the bold decision to implement Mahara as its institutional e-Portfolio solution. It was a bold move as the software was, as yet untested, having only been released two months prior to it’s installation. Two main reasons for it’s adoption was it’s integration with Moodle and that it was Open Source i.e. free. Further to this, the Academy also made the commitment to contract e-Learn Design as consult-ants and to maintain both Mahara and Moodle installations, for a period of 12 months. This move was seen as a positive step towards fulfilling it’s Learning Resources and Student Support Strategy which states, as an objective for December 2009 to “implement Mahara as an Academy-wide platform for Personal Development Planning” . Four Moodle site-wide Administrators were found, including myself and a single Administrator for Mahara (myself), appropriate training was provided for Moodle.

Lessons learned on the JISC funded ISLE (Individualised Support for Learning through ePortfolio’s) Project found that ePortfolio’s cannot be introduced during the academic year. Greater success was found when you introduce them at induction. (ISLE). This Pilot scheme initially focused on employability skills amongst learners at Dumfries and Galloway College. Themed templates were created to provide structure to this process of PDP with categories which included: about me, My CV, my learning style, my interests and hobbies etc… All of which exist as default fields in Mahara, thus reducing the workload of tutors.

Encouraging students to personalize their learning spaces by deciding on layout as well as content can enthuse them to become more creative with their learning. The celebration of achievements can hence be more rewarding, with positive feedback from both peers and tutors acting as motivational devices. Improved retention levels were also recorded during the ISLE Project ranging from 30% to 100% improvement in some cases (JISC, 2008).

Results of an online survey I conducted, where I canvassed the opinion of 79 students and 11 staff members on ePortfolio’s, returned some revealing results. Out of the total number surveyed only 17% currently used an ePortfolio solution and from those, most (13 individuals) used Mahara. When asked the question, “Would you considering using one?” 53% said yes, with a further 36% stating that they “didn’t know” (see Chart 1). This shows that there is an interest worth considering and more promotion of Mahara needed.

Chart 1
Chart 1

When asked what they considered to be the single most important benefit of keeping an ePortfolio, the results were revealing (see Chart 2).

Chart 2

Chart 2

The results in Chart 2 clearly show that Employability would be a major contributing factor towards a learner engaging with an ePortfolio, with the organistaion of work being a major secondary concern. These statistics appear to align with the theory that both professional and vocational focus relies heavily on the development of praxis rather than knowledge alone. In this light, the ePortfolio serves as a developmental log in which to track ‘fitness of practice’. (Beetham & Sharpe, 2007).

In Art, we find ourselves confronted with a series of stimuli, such as a performance, a design, literary text or a piece of music. These artifacts  of learning more than often require our learners to ‘respond’ rather than to unravel an answer. These responses are often aesthetic in nature and require a degree of reflection that involves more than finding a formula which leads to a solution. (Beetham & Sharpe, 2007). Having the ability to present these stimuli as media; .mp4, jpeg, .doc or mp3 etc. provides the learner with a platform to host their evidence alongside their interpretations of it. It is hoped that the outcome would be that the learner has a greater understanding of the artifact.

“focus on creative activity is typical of the arts and that the methodologies (i.e. discussion) used to study the artefactual focus of these disciplines are to some degree themselves inspired by the methodologies employed in the creation of those artifacts.” (Beetham & Sharpe, 2007).

This form of reflective discourse based on the study of existing artifacts lends itself perfectly to the learning artist. The creation of new work commonly inspired by existing work. e.g. a learner uploads an .mp3 to their Mahara view then invites collaborators to listen to it, a discussion builds around the work from within a Mahara group forum. Changes are made to the work based on peer evaluation and the view is opened to the tutor for feedback and perhaps assessment.

The collection of this evidence could be a key driver to PDP being a key element to the UK Governments e-strategy (DfES, 2005). The Center for International ePortfolio Development is based in the University of Nottingham and is proof of the United Kingdoms commitment to research and development of this important learning tool.

To promote employability skills is as much about good learning experiences as it is about work placements or careers advice. (Bloxham & Boyd, 2007). They go on to state that more traditional methods of enhancing employability (entrepreneurship, careers guidance and PDP) do not necessarily contribute to the overall learning environment that is designed to foster employability, as they are often stand alone modules or lie outside of programme altogether. In this respect, there seems to be the need for a tool which draws all of these elements together and is still designed for learning. As the electronic portfolio is essentially a student centered solution, in which the learner has control over who and when their evidence is to be subject to academic scrutiny, then it would be fair to conclude that they can also choose when their work is open for employers to gauge their suitability for employment. Mahara can be viewed externally, allowing the learner to produce a media rich CV, which can be viewed by anyone of their choosing. Access to a particular view can also be time-limited or suspended at any point, by the learner.

In the online survey I asked how often those who completed it reflected  on their learning and whether these reflections were self motivated (non-assessed) or part of their course (assessed).  Chart 3 shows the frequency of reflection:

Chart 3

Chart 3

Now that the statistics were in place (and I was surprised at the amount of reflective practice stated) the task was then to ascertain why the learners were reflecting i.e. was it because they had to or was it because they felt it was a viable learning process?

Chart 5

Is this reflection….?

Chart 4

The findings here are even more surprising, it shows that learners are prepared to take ownership of their own learning where reflective practice is concerned. Thus going some way to prove that reflection is seen by a cross section of students in the Academy as an effective way to learn. Couple these statistics with those who outlined an interested in finding out more information about Mahara (85% of those surveyed wished to learn more, while 10% did not) and there is a clear case for further investigation.

To find out which methods were used in reflection I asked ‘how’ these learners reflected, giving a choice of the most common tools available. The results were mixed (Chart 6) and dependent on the learners definition of nomenclature e.g. a log book could be considered a journal by some. What is interesting is that 89% of those surveyed considered themselves to be computer literate which aligns closely to those interested in pursuing an interest in ePortfolio’s, yet most reflections seem to be recorded using analogue (paper-based) tools. One could conclude that this was due to the learners preference. Though when asked if the Academy should be doing more to promote Mahara, the response was that 58% thought so, 6% thought the Academy shouldn’t be promoting it and 35% didn’t know we even had one!

Chart 6

Chart 6

Mahara also has social networking functionality which has great potential to create both formal and non-formal learning environments. The ability to build communities of practice within a rich learning environment has obvious collaborative and knowledge sharing potential. This approach could open the door to both self and peer assessment models. These assessment skills are seen as valuable in developing lifelong learning skills such as self-evaluation, giving feedback, justifying a point and negotiation skills (Boud, 2000). Furthermore Stefani reminds us that “If assessment processes are intended to enhance student learning then it follows that students must be able to reflect on their current attainment” (Stefani 1998: 346, cited in Bloxham & Boyd, 2007). The skills required to develop objectivity (needed for self assessment) by reflecting on their own work, carves a path for the learner to direct their own work and thus making steps towards becoming autonomous learners. (Bloxham & Boyd, 2007). Peer feedback is often more accessible to the learner, being that it is not ‘emotionally loaded’ (Black et al, 2003:77) being that the language of peers is much easier for the student to understand, digest and evaluate.

When asked the question, “How often are you required to collaborate with others on your course?” (Chart 7), the results were as expected on programmes that involved both group and individual tuition. Only a 3% minority perceived that they did not collaborate at all, it should be a serious consideration to offer a support platform for these students to enter the fold and be able to reflect and collaborate with other learners. There is scope here for further development in cross curricula design and implementation, there would seem to be strong evidence that student aspirations stretch to include both peer feedback and a more collaborative environment in which to learn.

Chart 7

Chart 7

The final chart (Chart 8 ) was based around formative feedback and it’s perceived quantity available on individual courses. This question was purely subjective i.e. “What are your feelings on formative feedback?”, this was done intentionally as I wished to gauge student perception rather than objective fact. Feedback, or the amount of, is an academic responsibility and the student perception of this is dependent on the individuals requirements. A student who is struggling will percieve that they require more formative feedback, delivered in a timely manner. Race recommends that; “ if assessment is the engine that drives learning (Cowan cited in Race, 2007) then feedback is the oil that lubricates the cogs of understanding” (Race, 2007). Boud goes on to add that, “Assessment methods and requirements probably have a greater influence on how and what students learn than any other single factor. This influence may well be of greater importance than the impact of teaching materials.” (Boud, 1988).

I order to ascertain student perception of formative feedback provision within the Academy I asked, “What are your feelings on formative feedback?” with options depicting quantity rather than quality:

Chart 8

Chart 8

These statistics seem to suggest that there is a balance needing addressed in this area of learning. It has often been alleged that the Academy is heavy on summative assessment and light on the side of formative assessment. With these statistics in place it would seem that this is indeed the case. ePortfolio provision can address this issue head on, with 24 hours access to student evidence and reflection, more importantly it is the learner who opens their portfolio’s for scrutiny by tutors. This places the procurement of feedback firmly in their own hands.

Recommendations

The following are recommendations for the implementation of ePortfolio-based practice within the Royal Academy of Music & Drama, in order to address the findings in this investigation:

1. Staff training on the use of ePortfolio’s with particular emphasis on Mahara as a tool to enhance learning and employabilty within the student body.

2. The implementation of a robust framework for PDP in which ePortfolio provision can exist.

3. The introduction of ePortfolio-based learning at induction at the very latest.

4. Further investigation into allowing new and incoming 1st Year students to access and build ePortfolio’s on Mahara.

5. The introduction of a pilot scheme to encourage FE feeder courses to implement ePortfolio provision within their institutions as a recruitment driver.

6. The introduction of a pilot scheme to encourage employers to access final year students work as a recruitment driver.

Bibliography

Dearing, R (1997) Report of the National Committee of Inquiry into Higher Education (The Dearing Report) http://www.leeds.ac.uk/educol/ncihe/

(accessed 18.06.09)

Developing a progress file for HE: Guidelines on HE progress files http://www.qaa.ac.uk/academicinfrastructure/progressfiles/guidelines/default.asp

(accessed 18.06.09)

Ward, R & Richardson, H (2005) Report to the JISC: Generic guidance for stakeholders implementing Personal Development Planning through e-portfolio systems http://www.erdee.org.uk/natsem/eport_seminar_report.pdf

(accessed 18.06.09)

ISLE: Individualised Support for Learning through ePortfolio’s, http://isle.paisely.ac.uk/default.aspx

(accessed 19.06.09)

Bloxman S & Boyd P, (2007) Developing Effective Assessment in Higher Education: A Practical Guide. Open University Press, Berkshire

Stefani, L.A.J. (1998) Assessment in partnership with learners, Assessment and Evaluation in Higher Education, 23(4): 339-50.

Black, P., Harrison, C., Lee, C., Marshall, B. and William, D. (2003) Assessment for Learning: Putting It into Practice. Maidenhead, Open University Press.

Beetham, H & Sharpe, R et al (2007) Rethinking Pedagogy for a Digital Age: Designing and delivering e-learning. Oxon, Routledge

Boud, D (1988) Implementing Student Self-Assessment, HERDSA Green Guides Vol.5, University of New South Wales, Australia

Race, P (2007) The Lecturers Toolkit: A practical guide to assessment, learning and teaching, Oxon, Routledge

Boys, J & Ford, P (2008) The e-Revolution and Post Compulsory Education: Using e-Business models to deliver quality education. In association with JISC. Oxon, Routledge

Being Student

I know that these posts should be purely academic in order to satisfy the learning outcomes of my PG-Cert Class and I promise to return to referencing and citations again shortly. I have wanted to write this for a while now and  though I will seek evidence from other sources to back up my opinions, I want to veer away from sterile academia, as it is not appropriate for this subject matter. In short, I want to write this as a student.

For the past several months I have been both student and teacher. I understand that we are all lifelong learners and there should be no defined split, however my job has a framework and so does the PG-Cert programme. Where you would expect to find the boundaries blurred between the two remits, it really doesn’t. When the course started it was assumed by many that it would be based in our learning workspaces, in and around our cohort of students, assessments would be designed around our practice and feedback given in the same way. This hasn’t been the case. The PG-Cert has been ‘bolted on’ to our practice and the only cross over has been what we have chosen to implement ourselves. To this end it has been successful for me, as I have added several important elements to my practice as we have went along to varying degrees of success. However, I digress…

There are a few big issues I have identified through my experience as being a student, all of which are products of designing for learning:

  • Timely feedback

Quite simply, this hasn’t happened. Our feedback has always come months after our submissions. Formative feedback has been scant, I have no way of knowing how well I am progressing or  where I need to place extra effort until we are well into the next module. I read as much as I am physically able to within the time I have at my disposal, I have written over 50 blogs, I feel my citations etc.. have become more accurate and abundant (reflecting the amount of reading I have been engaged with) and yet, I still have little idea of how my reflections are being received. Early on in the PG-Cert we were asked to provide a position statement, in which I outlined that my goal was to make reflective practice central to my learning and teaching. I feel that I am well under way with this, encouraging my students to reflect consistently and real progress is being made in area’s of quality and understanding. Surely, this is an assessable point? Where I am demonstrating a deeper pedagogical approach to my practice?

  • Assessment without any stated pre-requisites

At what point were we shown an example position statement? A self-assessment form? There seems to be an expectancy that we can bring a level of academia to the table without having been even shown examples or given an idea of how to approach these tasks. The first time I had seen a self assessment form was when I was filling one out. In my practice I wouldn’t ask my students to complete anything, where an assessment  hinged on it, without first introducing them to the concept. Whether this was delivered in the form of a tutorial or within classroom content. Pre-requisites have not been explicit on the PG-Cert course. We are pacified with the reasoning that it is a ‘masters level’ qualification and should be expected to have pre-requisite knowledge, sadly I seem to be lacking in this area.

  • Workload

This is the area that is seriously damaging my prospects of excelling on the course. Since I began several months ago, my workload has increased drastically, what with having to Production Manage four shows and (due to my new term time only contract), take annual leave and TOIL over the course of this term. This has concentrated more work into less available time. So, sadly, I aim to pass but little more.

  • Parity in Assessment

We have had two major assessments on the course so far, by two separate assessors. Both have completely different styles and seem to be bi-polar in their approach. Now, I do expect different people to have different opinions on the same subject, but there seems to be little collusion or moderation on the grades presented. As a result my overall average has suffered I feel. On the Production strand there are three of us involved in assessment over three specialisms and we all work within the same assessment framework. Perhaps we are simply ‘like minded’ in our expectations of student achievement, but there is also a flexible framework which we all adhere to and tend to come to more-or-less the same conclusions.

This may all sound like criticism, but I assure you it is not. I am thoroughly enjoying my course and the benefits that I have reaped from it far outweigh these concerns. This is simply an attempt to reflect on some of the negativity that is flying around inside my head at the moment, in the hope that I can rationalise (and record) it.

The PG-Cert course has firmly put me back into a students shoes, I now have a better understanding or what a learner is and how much pressure they are put under. It has made me re-think workload issues and how much time should be given to reflective practice, at the moment the only time my students get to reflect are during the wee small hours. Hardly conducive to deep learning through critical analysis.

Twitter Revisited

I’m having real trouble with Twitter of late. The stream of student consciousness that I am party to 24 hours a day, 7 days a week has revealed a world of stress, confusion and unrest. To be fair, it isn’t all negative but one tends to tune into ‘what’s wrong’ especially where it is relevant to your teaching practice or the course you are part of. Familiarity also breeds contempt and though this may be overly strong, it isn’t far from the truth.

Twitter has exposed holes in our course, that would not have been noticed by us before. Many of the tweets are ‘spur of the moment’, ‘knee-jerk reactions from tired minds, I am sure. However, it is becoming increasingly difficult to decide which to act on and which to leave, in the hope they are transient concerns. I find myself constantly struggling whether to take the “ignorance is bliss” option and pretend that I had never opened Pandora’s Box, unfortunately it is not that easy.

Alternatively, I could face the issue more positively and use Twitter as a feedback mechanism. I know have information that could lead to enhancing the programme or improving communications between staff and learner. The ease in which we can know point students in a particular direction (to professional practitioners or hyperlinks for example) has proven to be invaluable.  I now feel closer to my learners and more readily able to enagage in a more honest dialogue after the tweets have flown about. Sometimes the tweeting verges on becoming a tutorial, where snippets of guidance can be afforded 24/7. I’m sure that a few of the students actually prefer this type of support.

A great deal of  the messages are frivalous and irreleavant to the programme and sifting through these streams can be both time consuming and tedious. I tend now to only read direct messages, @ replies and whatever is on my screen at the time (without having to scroll down).  This method seems to work and has cut out a great deal of the open tweets that are wild and trivial.

All said and done…. the jury is still out….

Follow

Get every new post delivered to your Inbox.