RSAMD Mahara

ePortfolio’s

“An unfolding narrative of a unique learning journey”

(JISC 2008)

How can ePortfolio solution’s such as Mahara provide and enhance employability skills through Personal Development Planning to Academy students?

Current research being carried out by organisations such as JISC and BECTA have identified that e-Portfolio’s can enhance Employability Skills, Lifelong Learning provision, Internationalisation, Retention, Widening Participation, Achievement and Attainment Levels along with offering a high level of Personalisation to the learner. (JISC 2008) With these high level agenda items in mind and a pressing need for an improved Personal Development Planning framework within the Academy, this investigation was both timely and required.

The Academy’s Learning and Teaching strategy clearly states that its mission which, in essence, is to nurture creativity through a focus on the individual through the promotion of innovative methodologies and the exploitation of new and emerging technologies.

The term portfolio has a range of meanings, depending on the context you are engaged with, with Higher Education it can be best described as a collection of artifacts (evidence) presented alongside associated reflections for learning. This archive is collated and drawn on by the learner as evidence of learning achievement. These achievements can then be used to plan targets and set goals. Therefore a portfolio can be associated with the gathering of records which can be used in the Personal Development Planning (PDP) process. The concept of Personal Development Records (PDRs) is closely related to the Higher Educa-tion Progress File, a recommendation found in the Report of the National Committee of Inquiry into Higher Education (Dearing, 1997) and extends beyond that, to incorporate artifacts which may evidence claims made in PDRs. Many institutions are choosing to implement PDP (and to encourage learners to manage their PDRs) through electronic means, often linking this to the term e-portfolio (Ward & Richardson, 2005) .

In 2008 The Academy made the bold decision to implement Mahara as its institutional e-Portfolio solution. It was a bold move as the software was, as yet untested, having only been released two months prior to it’s installation. Two main reasons for it’s adoption was it’s integration with Moodle and that it was Open Source i.e. free. Further to this, the Academy also made the commitment to contract e-Learn Design as consult-ants and to maintain both Mahara and Moodle installations, for a period of 12 months. This move was seen as a positive step towards fulfilling it’s Learning Resources and Student Support Strategy which states, as an objective for December 2009 to “implement Mahara as an Academy-wide platform for Personal Development Planning” . Four Moodle site-wide Administrators were found, including myself and a single Administrator for Mahara (myself), appropriate training was provided for Moodle.

Lessons learned on the JISC funded ISLE (Individualised Support for Learning through ePortfolio’s) Project found that ePortfolio’s cannot be introduced during the academic year. Greater success was found when you introduce them at induction. (ISLE). This Pilot scheme initially focused on employability skills amongst learners at Dumfries and Galloway College. Themed templates were created to provide structure to this process of PDP with categories which included: about me, My CV, my learning style, my interests and hobbies etc… All of which exist as default fields in Mahara, thus reducing the workload of tutors.

Encouraging students to personalize their learning spaces by deciding on layout as well as content can enthuse them to become more creative with their learning. The celebration of achievements can hence be more rewarding, with positive feedback from both peers and tutors acting as motivational devices. Improved retention levels were also recorded during the ISLE Project ranging from 30% to 100% improvement in some cases (JISC, 2008).

Results of an online survey I conducted, where I canvassed the opinion of 79 students and 11 staff members on ePortfolio’s, returned some revealing results. Out of the total number surveyed only 17% currently used an ePortfolio solution and from those, most (13 individuals) used Mahara. When asked the question, “Would you considering using one?” 53% said yes, with a further 36% stating that they “didn’t know” (see Chart 1). This shows that there is an interest worth considering and more promotion of Mahara needed.

Chart 1
Chart 1

When asked what they considered to be the single most important benefit of keeping an ePortfolio, the results were revealing (see Chart 2).

Chart 2

Chart 2

The results in Chart 2 clearly show that Employability would be a major contributing factor towards a learner engaging with an ePortfolio, with the organistaion of work being a major secondary concern. These statistics appear to align with the theory that both professional and vocational focus relies heavily on the development of praxis rather than knowledge alone. In this light, the ePortfolio serves as a developmental log in which to track ‘fitness of practice’. (Beetham & Sharpe, 2007).

In Art, we find ourselves confronted with a series of stimuli, such as a performance, a design, literary text or a piece of music. These artifacts  of learning more than often require our learners to ‘respond’ rather than to unravel an answer. These responses are often aesthetic in nature and require a degree of reflection that involves more than finding a formula which leads to a solution. (Beetham & Sharpe, 2007). Having the ability to present these stimuli as media; .mp4, jpeg, .doc or mp3 etc. provides the learner with a platform to host their evidence alongside their interpretations of it. It is hoped that the outcome would be that the learner has a greater understanding of the artifact.

“focus on creative activity is typical of the arts and that the methodologies (i.e. discussion) used to study the artefactual focus of these disciplines are to some degree themselves inspired by the methodologies employed in the creation of those artifacts.” (Beetham & Sharpe, 2007).

This form of reflective discourse based on the study of existing artifacts lends itself perfectly to the learning artist. The creation of new work commonly inspired by existing work. e.g. a learner uploads an .mp3 to their Mahara view then invites collaborators to listen to it, a discussion builds around the work from within a Mahara group forum. Changes are made to the work based on peer evaluation and the view is opened to the tutor for feedback and perhaps assessment.

The collection of this evidence could be a key driver to PDP being a key element to the UK Governments e-strategy (DfES, 2005). The Center for International ePortfolio Development is based in the University of Nottingham and is proof of the United Kingdoms commitment to research and development of this important learning tool.

To promote employability skills is as much about good learning experiences as it is about work placements or careers advice. (Bloxham & Boyd, 2007). They go on to state that more traditional methods of enhancing employability (entrepreneurship, careers guidance and PDP) do not necessarily contribute to the overall learning environment that is designed to foster employability, as they are often stand alone modules or lie outside of programme altogether. In this respect, there seems to be the need for a tool which draws all of these elements together and is still designed for learning. As the electronic portfolio is essentially a student centered solution, in which the learner has control over who and when their evidence is to be subject to academic scrutiny, then it would be fair to conclude that they can also choose when their work is open for employers to gauge their suitability for employment. Mahara can be viewed externally, allowing the learner to produce a media rich CV, which can be viewed by anyone of their choosing. Access to a particular view can also be time-limited or suspended at any point, by the learner.

In the online survey I asked how often those who completed it reflected  on their learning and whether these reflections were self motivated (non-assessed) or part of their course (assessed).  Chart 3 shows the frequency of reflection:

Chart 3

Chart 3

Now that the statistics were in place (and I was surprised at the amount of reflective practice stated) the task was then to ascertain why the learners were reflecting i.e. was it because they had to or was it because they felt it was a viable learning process?

Chart 5

Is this reflection….?

Chart 4

The findings here are even more surprising, it shows that learners are prepared to take ownership of their own learning where reflective practice is concerned. Thus going some way to prove that reflection is seen by a cross section of students in the Academy as an effective way to learn. Couple these statistics with those who outlined an interested in finding out more information about Mahara (85% of those surveyed wished to learn more, while 10% did not) and there is a clear case for further investigation.

To find out which methods were used in reflection I asked ‘how’ these learners reflected, giving a choice of the most common tools available. The results were mixed (Chart 6) and dependent on the learners definition of nomenclature e.g. a log book could be considered a journal by some. What is interesting is that 89% of those surveyed considered themselves to be computer literate which aligns closely to those interested in pursuing an interest in ePortfolio’s, yet most reflections seem to be recorded using analogue (paper-based) tools. One could conclude that this was due to the learners preference. Though when asked if the Academy should be doing more to promote Mahara, the response was that 58% thought so, 6% thought the Academy shouldn’t be promoting it and 35% didn’t know we even had one!

Chart 6

Chart 6

Mahara also has social networking functionality which has great potential to create both formal and non-formal learning environments. The ability to build communities of practice within a rich learning environment has obvious collaborative and knowledge sharing potential. This approach could open the door to both self and peer assessment models. These assessment skills are seen as valuable in developing lifelong learning skills such as self-evaluation, giving feedback, justifying a point and negotiation skills (Boud, 2000). Furthermore Stefani reminds us that “If assessment processes are intended to enhance student learning then it follows that students must be able to reflect on their current attainment” (Stefani 1998: 346, cited in Bloxham & Boyd, 2007). The skills required to develop objectivity (needed for self assessment) by reflecting on their own work, carves a path for the learner to direct their own work and thus making steps towards becoming autonomous learners. (Bloxham & Boyd, 2007). Peer feedback is often more accessible to the learner, being that it is not ‘emotionally loaded’ (Black et al, 2003:77) being that the language of peers is much easier for the student to understand, digest and evaluate.

When asked the question, “How often are you required to collaborate with others on your course?” (Chart 7), the results were as expected on programmes that involved both group and individual tuition. Only a 3% minority perceived that they did not collaborate at all, it should be a serious consideration to offer a support platform for these students to enter the fold and be able to reflect and collaborate with other learners. There is scope here for further development in cross curricula design and implementation, there would seem to be strong evidence that student aspirations stretch to include both peer feedback and a more collaborative environment in which to learn.

Chart 7

Chart 7

The final chart (Chart 8 ) was based around formative feedback and it’s perceived quantity available on individual courses. This question was purely subjective i.e. “What are your feelings on formative feedback?”, this was done intentionally as I wished to gauge student perception rather than objective fact. Feedback, or the amount of, is an academic responsibility and the student perception of this is dependent on the individuals requirements. A student who is struggling will percieve that they require more formative feedback, delivered in a timely manner. Race recommends that; “ if assessment is the engine that drives learning (Cowan cited in Race, 2007) then feedback is the oil that lubricates the cogs of understanding” (Race, 2007). Boud goes on to add that, “Assessment methods and requirements probably have a greater influence on how and what students learn than any other single factor. This influence may well be of greater importance than the impact of teaching materials.” (Boud, 1988).

I order to ascertain student perception of formative feedback provision within the Academy I asked, “What are your feelings on formative feedback?” with options depicting quantity rather than quality:

Chart 8

Chart 8

These statistics seem to suggest that there is a balance needing addressed in this area of learning. It has often been alleged that the Academy is heavy on summative assessment and light on the side of formative assessment. With these statistics in place it would seem that this is indeed the case. ePortfolio provision can address this issue head on, with 24 hours access to student evidence and reflection, more importantly it is the learner who opens their portfolio’s for scrutiny by tutors. This places the procurement of feedback firmly in their own hands.

Recommendations

The following are recommendations for the implementation of ePortfolio-based practice within the Royal Academy of Music & Drama, in order to address the findings in this investigation:

1. Staff training on the use of ePortfolio’s with particular emphasis on Mahara as a tool to enhance learning and employabilty within the student body.

2. The implementation of a robust framework for PDP in which ePortfolio provision can exist.

3. The introduction of ePortfolio-based learning at induction at the very latest.

4. Further investigation into allowing new and incoming 1st Year students to access and build ePortfolio’s on Mahara.

5. The introduction of a pilot scheme to encourage FE feeder courses to implement ePortfolio provision within their institutions as a recruitment driver.

6. The introduction of a pilot scheme to encourage employers to access final year students work as a recruitment driver.

Bibliography

Dearing, R (1997) Report of the National Committee of Inquiry into Higher Education (The Dearing Report) http://www.leeds.ac.uk/educol/ncihe/

(accessed 18.06.09)

Developing a progress file for HE: Guidelines on HE progress files http://www.qaa.ac.uk/academicinfrastructure/progressfiles/guidelines/default.asp

(accessed 18.06.09)

Ward, R & Richardson, H (2005) Report to the JISC: Generic guidance for stakeholders implementing Personal Development Planning through e-portfolio systems http://www.erdee.org.uk/natsem/eport_seminar_report.pdf

(accessed 18.06.09)

ISLE: Individualised Support for Learning through ePortfolio’s, http://isle.paisely.ac.uk/default.aspx

(accessed 19.06.09)

Bloxman S & Boyd P, (2007) Developing Effective Assessment in Higher Education: A Practical Guide. Open University Press, Berkshire

Stefani, L.A.J. (1998) Assessment in partnership with learners, Assessment and Evaluation in Higher Education, 23(4): 339-50.

Black, P., Harrison, C., Lee, C., Marshall, B. and William, D. (2003) Assessment for Learning: Putting It into Practice. Maidenhead, Open University Press.

Beetham, H & Sharpe, R et al (2007) Rethinking Pedagogy for a Digital Age: Designing and delivering e-learning. Oxon, Routledge

Boud, D (1988) Implementing Student Self-Assessment, HERDSA Green Guides Vol.5, University of New South Wales, Australia

Race, P (2007) The Lecturers Toolkit: A practical guide to assessment, learning and teaching, Oxon, Routledge

Boys, J & Ford, P (2008) The e-Revolution and Post Compulsory Education: Using e-Business models to deliver quality education. In association with JISC. Oxon, Routledge

Technogogy

Over the past few months I have been playing around with the term ‘Technogogy’ to describe the hybridisation of Technology and Pedagogy. Sadly, I wasnt the first to coin this word as a quick Google search presented a number of sites using it. The term seems to have been first coined by Professor Rozhan M. Idrus at the 5th International Educational Technology Conference (with the theme, Distance Education) held in Sakarya, Turkey from 21-23 September 2005. At which he defined the term as:

“the transformative use of technology to foster learning.” (Idrus & McComas, 2005)

The premise of using internet technology (in its broadest sense) as a means for creating new knowledge has forced educators to re-think pedagogical approaches towards both how and when we learn.  No longer can we consider an institutional ‘classroom’ as the ‘walled garden’ of learning, a place where learning starts at 9am and finishes at 5pm. Furthermore, technology has allowed intellect to be amplified to a wider audience of external learners at a global level.

“Instruction begins when you, the teacher, learn from your learner. Put yourself in his place so that you may understand what he learns and the way he understands it.”

(Kierkegaard, cited in Idrus & McComa, 2005)

Learning cannot be enhanced or improved upon by technology itself, instead it should be redesigned with technology in mind. In much the same way as the  pencil or pen only evolved to support learning, so the computer should be considered in the same way. Technology can only enhance learning when it is grounded in established theory, the marriage of technology and pedagogy is perhaps best described by the term ‘technogogy’.

Idrus & McComa, (2005).Technogogy: Facilitating the Transformation of Learning. [PDF]. Available: http://www.ijcim.th.org/v14nSP1/pdf/p5.1-9-fin-58-keynote-Rozhan-%20Karen.pdf [Accessed: 2009]

Stage Management ICT

This morning I had my first attempt at an ICT Class, specifically for Stage Managers. To be honest, I wasn’t happy with it and it is definitely and area that requires further development. I was guilty of under-planning, assuming that I could engage my class simply with the technology itself. I underestimated how difficult it was to engage the Facebook generation with specific online activities using Web 2.0. Give them a fast internet connection and they instantly take ownership of their own browsing and do not completely focus on the task at hand. However, a balance was reached as the class progressed, the time that we lost with ‘distractions’ such as Twitter and Facebook was regained almost instantly with the expertise and speed the class brought to completing the tasks I set out.

Noticing Twitter windows hidden behind behind the ‘task’ windows (which became active when I returned to my own workstation) a realisation hit me, I had openly encouraged the use of these technologies in the past and had reflected about their use in classroom environments, now I was actually engaging in my reflections. Up until that point in the morning I had been ‘instructing’ and that left a bad taste in my mouth. I swiftly changed my tact and was thankful that I hadn’t commented on these ‘distractions’ yet. I started to encourage the students to openly Twitter about the class, which they had already been doing (I discovered later when viewing the tweet streams). Personally, the whole dynamic of the class changed for me, I didn’t mention it as I wanted to see where this openness would take us.

We had started working with Google Docs, for a long time I had been aware of it’s potential for Stage Management. One of my personal goals was to explore eDocumentation and how to distribute and share paperwork electronically. Google had supplied a fantastic tool for this purpose. We set up accounts and began to work on several files I had uploaded. After a brief discussion on the benefits for Stage Managers, it was clear that the students found it useful but only if everyone used it. Collaborations would be fruitless without participants. It was a brief introduction, but a useful one, awareness had been established but further self determined orientation and development was the next stage.

We moved onto to exploring the possibilities behind Scribd, an online publishing web facility that allowed participants to upload files for viewing and scrutiny. I had used this in the past for the purposes of research and wanted the students to glimpse it’s potential. Again, we set up accounts and began to explore the basic premise behind this powerful yet simple tool. I had uploaded our Deputy Stage Managers Handbook and, as with Google Docs earlier, we all linked our accounts in order to share resources. This Web 2.0 tool was more suited to learning and research than to Stage Management, but I wanted this morning to be for both learning and professional practice.

After a short break, we stepped into the world of Wiki. Using PAPERCLIP (Stephen Macluskie’s innovative site for technical theater collaborative solutions) we added our very own m-SM project and began to explore Wiki script. Covering the basic’s; uploading photo’s, hyperlinking and page layouts we build a page for the project. This should now give us a base to expand the m-SM project. Through our explorations we also discovered how to link directly to the iTunes applications store, opening iTunes on the host machine in the process. Creating Wiki’s in PAPERCLIP will become an assessable part of their learning in the near future. This tool will eventually replace the old ‘box file’ system which is traditionally used to archive production paperwork. Another example of RSAMD Stage Management attempt to modernise an industry that still uses archaic paper-based systems, which are less efficient and unsustainable.

The next tool we looked at was Diigo, a social bookmarking site. This is an excellent resource in which web pages can be centrally bookmarked, portions of text highlighted, commented on and finally shared. Highlights and comments are saved with the bookmark, drawing the attention of fellow collaborators to the relevant sections. In turn, comments can be returned and collaborations are built. All of this can be done ‘live’ while surfing, using a series of browser plug-ins, meaning that you only have to return to your profile to review your bookmarks at the end of a browsing session. Another important research tool.

We finished the session with 15 minutes on Moodle and the students filled in a couple of Critical Incident online reports that I had set up earlier. For those who finished (or had already completed the task prior to coming to the class) they were given time to ‘play’ online with any of the tools we had used today.

The general consensus was that, as an introduction to these facilities, the class was useful. Some were more engaged than others and each student had different opinions on the resources we had covered. Each student showed a level of individual expertise and I felt the issue of engagement drifted from student to student as they crossed into thier own comfort zones. This, of course was to be expected. We all agreed that a regular series of SM ICT classes should be in place throughout the course, allowing orientation to take place. I also want to stage similair classes were skills sharing through peer learning can take place i.e. a student with particular interest and expertise using a specific e-Tool or software solution can lead a session with their peers. This would open up a host of learning opportunities, as yet untried, within Stage Management.

Flexible Delivery

Over the last few weeks students on the PG-Cert class have been furiously posting on the Academies Moodle site. We were each given an enhancement theme to research and present our findings on individual forum posts. In addition to encouraging others to post and keeping our own spaces topped up with enhancement information, we were expected to contribute to the other themes postings. The Enhancement themes were divided up as follows:

The First Year Experience
Integrated Assessment
Flexible Delivery
Research – Teaching Linkages
Meeting Student Support Needs
Employability – Skills for Life
Assessment

At first I struggled to get my forum off the ground, I seemed to be the only one posting. I reflected on WordPress, searching for a solution, when it struck me that perhaps I was being too technical (not sure if thats the right word?) and decided to bring the subject closer to home, especially with my posed questions. i.e. I aimed the content directly at how we were currently benefiting on the PG-Cert course by using a flexible, online approach. It seemed to work and the posts began to appear.

It was an interesting exercise. Studying flexible learning whilst partaking in it. At times I did feel as if I was cheating! The others didn’t have the benefit of a live scenario in which to test their themes. By the end of the research period, I had very little to do but encourage and answer the others questions. They all seemed appreciative of the effort I had put in, as I was of them and what they had provided. It really felt like a community of learners, communicating and collaborating effectively.

There were a few things that I would do differently next time though and I began to address them nearer the end:

1. Change the subject line when posting a new thought or sub-category.
2. Maintain a better balance between reporting in an Academic style and a lighter more social tone.
3. Present more research into the pitfalls of the subject matter. I don’t feel I presented a well balanced discussion.
4. Reduce the amount of personal opinion i.e. non-cited theories.

What do I still need to do?

Having scraped the surface of flexible delivery I am, more than ever, convinced that it is the way to go. My worry is that I have been blinded by technology. Even though I know that eLearning is not all that a flexible program would have to offer, but merely a very effective tool that helps facilitate it, both terms have almost become synonymous with each other. I must separate the two in my head as I still refer to a flexible program as being a wholly technological solution.

I still have to look, in more depth, at how best to assess on a flexible learning activity. It would seem that self and peer assessment are the most popular solutions, or at least the ones that are cited most often. More research is needed in this area, I am particularly interested in how to assess reflective journals, especially online blogs.

Follow

Get every new post delivered to your Inbox.