Archive for March, 2015

Community of Practice Evaluation Strategy

This post is one in a series sharing the case study of the development of a Community of Practice for Maintenance and Engineering teams at Coca-Cola Amatil.

As discussed in the case study post on context, this initiative is expected to contribute to reducing equipment down-time and decreasing risk associated with concentration of deep process knowledge in a small number of long-tenured Engineers.  A number of Key Performance Indicators (KPIs) were identified up-front to evaluate the value created by this community.  This was informed in part by the conceptual framework of value creation from online interactions from Etienne Wenger, Beverly Traynor and Maarten De Laat.  See Jane Bozarth’s article for an introduction to the value creation cycles in the framework.

Value creation cycles

KPIs and Measures

MaintEng COP KPIs

Measurement Points & Methods

Three main measurement points have been identified:

  • Prior to community launch – to establish a baseline
  • Immediately following the Work Connect & Learn program (guided social learning program to support the development of skills and behaviours to participate in the community)
  • Six months after completion of the Work Connect & Learn (WCL) program

Monitoring of some of the measures will occur on a monthly basis during this six month period to help inform community management.

Data and feedback will be gathered using the following methods:

  • Surveys of all maintenance and engineering team members at the three main measurement points
  • Monitoring of activity on online community spaces in SharePoint
  • Interviews / discussions with Maintenance & Engineering Managers and Capability Managers (who are providing on the ground supporting to community members to participate)
  • Focus groups with community members immediately following and six months after the WCL program
  • Capture of value creation stories on an ongoing basis in the six months after the WCL program

Additional Thoughts on Value Creation Cycles

The careful reader may have noticed that indicators of Reframing Value have not been explicitly included in the KPIs.  While we have not explicitly set objectives for value at this level, it will be surprising if this does not follow success in the other value creation cycles.  Reframing Value will be identified through value creation stories.

The value creation framework has recently been expanded to include strategic value and enabling value.  We’ve not yet considered whether / how to include these in our evaluation strategy.

4 Comments

Staying up to date with Google Alerts via Feedly

Last November I set up some Google alerts in order to receive automated updates on the latest internet search results on topics that I’m interested in.  It distills the results from the first 20 or so pages of its search engine results and sends you an alert.  Rather than receive results by email, I set my alerts up as an RSS Feed into Feedly by following the instructions at How to Curate Content With Feedly and Google Alerts .  (For those unfamiliar with RSS Feeds, refer to this article for a straightforward explanation.)

Google Alerts

A scan of the alerts that I set up shows that I’ve used alternative terms with minor variations to increase the range of search results.  You’ll also notice the use of quotation marks around phrases to ensure that results only include items that use the full term,not the indivudal words spread out throughout an article. (Here’s more tips on setting up Google alerts.)

Automating searching allows me to be fed new articles and information on topics I’m interested in.  So long as I am reading on Feedly a couple of times a week it is a reliable way to be pushed new content without having to make the effort to do manual searches.

Reading Alert results helps me to stay abreast of industry trends and developments.  It supplements the content that the “human filters” in my online Personal Learning Network feed me through Twitter, LinkedIn and the blogs that I follow. It also allows me to increase my value and contribution to my networks by sharing content that may not already be in circulaton in those networks.

Google Alerts have been a valuable addition to my Personal Knowledge Mangement toolkit.

4 Comments

702010 Forum Value Creation Story

I came across the idea of using value creation stories to assess the value of online interactions in an article by Jane Bozarth.  She used a conceptual framework from Etienne Wenger, Beverly Traynor and Maarten De Laat to write the story of how her online interactions create value.  Their framework thinks about value in terms of five different cycles, which Jane summarises clearly in a diagram in her article.

Value creation cycles

Value creation cycles

As Jane urges, I have read the full text of this framework, and have used their guiding questions to write a value creation story about my participation in the 702010 Forum.  This is my practice run in preparation for gathering value creation stories to evaluate communities that I am helping develop in my organisation. I’ve written this post by responding directly to the guiding questions relating to each cycle of value creation.  However, I would document value creation stories within my organisation by writing or recording (audio or video) a more natural narrative.

702010Forum banner

The 702010 Forum is a community of practice for learning and performance professionals applying the 702010 framework. Membership is subscription based, with some resources and webinars publicly available.  A toolkit contains resources to support application of 702010, and members can participate in a range of events and an online discussion forum.

1. What meaningful activities did you participate in? (Cycle 1 – Immediate Value)

I have participated in a variety of asynchronous and synchronous activities including:

– attending webinars or viewing recordings, especially case studies by members
– delivering two case studies on webinars
– attending face-to-face events
– initiating and replying to discussions in the forum – and extending this in one case to email and phone discussions on a solution shared in the forum (more below)
– participating in a pilot of the Forum’s 702010 Practitioner Certification
– sharing and applying resources from the Toolkit with others in my organisation to assess status and develop improvements

Toolkit snapshot - showing entries I've ticked off as read

Toolkit snapshot – showing entries I’ve ticked off as read

2. What specific insights did you gain?  What access to useful information or material? (Cycle 2 – Potential Value)

702010Forum Webinar RoleWithin a few months of joining the Forum I realised that while my organisation had adopted the 702010 framework a number of years ago, we had narrowly interpreted it.  We were deploying blended learning where we used activities based on learning from experience (70) and others (20) within formal structured programs.  However, we were not purposefully enabling people to learn as they worked or building ongoing social learning capability. From a webinar on the changing role of the learning function I saw that the skills of our capability team needed to be broadened. I gained an understanding and language to talk to key stakeholders about the opportunity to impact organisational performance more effectively if we added performance consulting, performance support, and social learning to our toolkit.

3. How did this influence your practice?  What did it enable that would not have happened otherwise? (Cycle 3 – Applied Value)

These activities and insights enabled me to have different discussions about 702010, our learning strategy, and internal Capability skills, particularly with senior managers and our Capability team.  The most significant shift it enabled was an update to our Capability strategy in April 2014 to include ‘Continuous Workplace Learning’ as an element.  This broadened the remit of our Capability team and created the space for us to get strategic with social learning.

We revamped our Governance Board by applying the “Toolkit for Establishing a Learning Governance Board.”  Consequently we get better value out of our quarterly meetings by focussing on alignment with our business strategy.

Tonkin & Taylor Knowledge Shots webinar

Tonkin & Taylor Knowledge Shots webinar

A specific initiative accelerated by a case study in a Forum webinar was setting up a knowledge sharing site on SharePoint.  When a senior manager gave me 1 day to prepare a prototype of a community hub on SharePoint I recalled a webinar where Tonkin & Taylor demonstrated their Knowledge Shots solution.  I incorporated this into our prototype, and went on to build a variant of this for my organisation.  You can see what this looks like in the guided tour of a community hub now set up on SharePoint.  (Big thank you to Tammy Waite and Mark Thomas from Tonkin & Taylor, Forum members, for the support they provided by email and phone.)

 

4a. What difference did it make to your performance?  How did this contribute to your personal/professional development? (Cycle 4 – Realized Value)

As per the examples given above, application of ideas, tools and solutions from the 702010 Forum has enabled me to perform and contribute to my organisation in ways I may not otherwise have been able to.

The 702010 Forum was one of the first Learning & Development communities that I’ve participated in.  During 2014 I got active on Twitter and started this blog.  This helped me to create a Personal Learning Network (PLN) which encompasses many other communities (e.g. Third Place, OzLearn, PKMChat).  Collectively my participation in a number of communities and interaction with my PLN has transformed and accelerated my professional development.

My first webinar delivery

My first webinar delivery

One way that the Forum has supported my development has been by increasing my confidence to work out loud publicly in order to learn and improve.  In December 2013 I delivered a case study in a Forum webinar.  I found the reflection and learning from delivering this webinar valuable, and saw that others could benefit from me working out loud.  This was a catalyst – it gave me the motivation and confidence to continue working out loud by blogging and speaking at conferences.

4b.  How did this contribute to the goal of the organisation?  Qualitatively?  Quantitatively? (Cycle 4 – Realized Value)

Realised value for my organisation is unfolding.  It’s also difficult (and unnecessary) to unravel the influence of the 702010 Forum on my organisation’s performance versus that of other communities and networks I participate in.  Our Capability strategy is better aligned to our overall business strategy as a result of applying ideas and tools from the 702010 Forum.  We are using a broader range of Capability approaches and activities to achieve our goals.  I think it will be another 6-9 months before we are clear on the outcome of these activities.

5. Has this changed your or some other stakeholder’s understanding of what matters? (Cycle 5 – Reframing Value)

An emphatic YES to this question.  It’s shifted the perspective of two very important stakeholder groups, senior managers and the Capability community, about the importance of the 70 and 20 elements of the framework and the range of approaches we can use to build Capability.  We’ve reframed our Capability strategy, launched communities of practice and embraced performance consulting.

Participate, Participate, Participate

I shall close by encouraging everyone reading this to reflect on the communities and networks they are part of and consider their current level of participation.  The more you participate, interact with others, apply ideas from these groups and share back what happened, the more value you create for yourself, your organisation and other community members.  So, what are you waiting for?  Get in there and participate.

I’d love to hear about the value that others have found in participating in communities and networks – you can leave your thoughts below or pingback to your own blog posts.

 

 

 

9 Comments

%d bloggers like this: