SHOW  ME  THE  CHANGE

Complexity and the Art of Evaluation – Reporting Sheet

Leader: Damien Sweeney

Background to Toolbox:

• Four councils involved with their project and Swinburne University is the academic partner

• Current stage – putting tools together, have piloted some already with participating councils

• Phone contact for case studies

• Online forum would be useful

• Have limitations of evaluation technique is useful

• Qualitative is common – interview and qualitative

• Cost benefit analysis is useful for CSIRO examples

• Attribution – were you influenced by something else or this project? (Categorises the other influences)

• Links to online surveys and tips to use that would be useful

• Need to say what evaluation to have when ie. Evaluation plan for duration of project

• City of Ballarat – project on planning and how engaged people are in programs – would be willing to pilot toolbox

• Behaviour Change blog – through conference, could be useful to have this on site for blog

• Survey – difficult to follow up on outcomes. Survey monkey is useful

• Needs to be able to change the toolbox – not have it static, eg, add case studies, reviews of tools etc – make it interactive

• Have volunteer from City of Ballarat willing to pilot the toolbox

• Wicki page – people can add their own information and use as a blog

• The National Social Marketing Centre in the UK is a good example of an online toolbox

• Clear Water – storm water project

SHOW  ME  THE  CHANGE

Complexity and the Art of Evaluation – Reporting Sheet

Leader: Candice Bruce

Key Points:
•    Ask for input – pose a question = ownership – outcome
•    Run perpetual initiates
– normalise behaviour
•    Develop trust
–    Adaptation
–    Solution focus
–    Visuals – “in a perfect world?” Grading from 1 to 10
–    where are you now? What are the good things and the learnings? What is one thing that you can do to move forward?
•    Collective Social Learning Process – Professor Valerie Brown – “Leonardo’s Vision”
•    Spacial marking (buy special chalk to mark on carpet) – participants step in and out
•    Structured workshops
–    home work before
–    brain storming
–    objectives –  business plan
–    options
–    time frame
–    post-it notes
•    Action learning (W.I.L)
•    Getting action at the end – pair up – what I’m going to do
– follow up in 2-3 weeks – accountable
•    Never make a statement when you can ask a question
•    Two ears, one mouth – listening – hear how you are being heard.
•    Telling stories about our own journey
–    photos – pick a picture you identify with and say why
–    share with 1 other person
–    then share with the table
•    Disposable camera – photos of what are their favourite areas or their home
•    Shared Resources:
– “Estelo” specialist training supplier Sydney
– Book – Climate Action – Diesendorf
– Edward de Bono – 6 Thinking Hats
– Storms of my grandchildren – Hanson
– The Rational Manager – Kepner and Tregoe
– “Kids Teaching Kids” Aaron and Richard Wood
– MS Project – Microsoft Excel
•    Make time for individual reflection and to do visual stuff
–    Role model deliberate actions
•    Transition handbook – share slides – use art and participant centred
•    Use of PCs – SKYPE – Web Cam – interactive learning solutions
•    Conversation Tech World Café – small group, slightly different question
•    Avoid Death by PowerPoint – ½ page is read by each – feedback to group
•    Lend out lecture notes eg. Harvard – ask for question out of the lecture (day before) – get student to answer questions – 5 minute lecture
•    Participants to present chapters in book
•    Question – what is in it for them? List main outcomes – collect at beginning, everyone walks out satisfied
•    Appreciative enquiry process
•    Look for criteria – start where they are at
•    Australia Standard on Governance – transition towns: Heart, Head, Hand, grassroots, self-sustaining
•    Favourite warm up – yes, but = blocker, yes, and opens up possibilities

SHOW  ME  THE  CHANGE

Complexity and the Art of Evaluation – Reporting Sheet

Leader: Zandy Tibballs

Participants: 12

• Identify tools to use that will lead to wider uptake.  Tools such as:
• Focus group work – contact primary leaders to help shape the type of information that is needed to be obtained,  > contact secondary group to determine banners and the type of information that they need to have to be willing to change.
• Target specific members / leaders and tune into their radio station to identify and understand the needs of the target audience > identify pathways that the change leaders go down – what made them change, what’s needed to help others change.
• Be adaptive to needs of target group audience – be willing to switch needs – identify “hook” & type of messaging to be used.
• Identify & work with user groups capable of influencing the target audience group.
• Pick the right champions / community leaders to help influence the target market.
• Consider the use of creative evaluation, eg films, media to influence.
• Utilise envisioning tools to help people identify type of future they woud like.
• Make links to accreditators / certificators / cost savings / rewards / recognitors.
• Undertake more independent measurement to highlight benefits and provide proof of effects that the program / products provides.
• Go to where they go eg conferences that they attend and present findings.
• Establish / or link “people” into a reference group where they can share information and network – “create opportunities” for target users to learn from each other.
• Identify champions that the target group would value and respect.
• Use formative evaluation / action research to help determine next steps.
• Utilise simple marketing tools eg

1. 1. peer review articles in relevant magazines;
   2. develop fact sheets adapted from case studies, suitable for different audiences;
   3. include different information for different audiences;  and
   4. explain & promote the benefits / use diagrams.