For a number of years I have been studying and learning about evaluation. To be honest, working primarily in the non-profit world and working for social good and social change, evaluation always seemed to me to be the bugaboo that ruined the party. While we’re out there trying to create new things, innovate and respond to novel challenges, build relationships and community, and experiment and fail, evaluation loomed over us like a dark spectre, scolding us for being flakey or demanding that we be more grown up and more responsible.
More than that, I had many experiences of evaluation being used as a weapon of power to exert control over the way projects were unfolding. Controlling the money and controlling the standards under which it is spent is hugely powerful. That power can be used badly or by people who don’t want to let go of control over their agendas. And it’s costly and frustrating for people in small organizations to feel like your strategic vision is always subservient to the evaluation framework.
So my foray into evaluation began when I started learning about Developmental Evaluation, and from there, learning about all the cool things that evaluators are doing to try to help organizations and communities makes sense of action in complexity. It has led me into powerful learning relationships with colleagues like Trilby Smith from the Vancouver Foundation, with whom I have been learning through a long term Theory of Philanthropy project with that organizations. I’ve connected with Art of Hosting practitioners like Rita Fierro (with whom I’m developing a course) and Nancy Fritsche-Eagan who are really curious about how to do deep participatory facilitation work in the service of good evaluation. And I’ve developed the start of some really beautiful learning relationships with Jara Dean-Coffey who is spearheading the world of Equitable Evaluation and Kim Van der Woerd and Billie Joe Rogers from Reciprocal Consulting who use culturally responsive evaluation to decolonize learning and research.
All of this learning and relationship has made me a more conscious facilitator and strategist. It has turned me from someone who is afraid of evaluation to someone who embraces it as a beautiful way to deepen learning, innovation, and strategic work. And it has equipped to confront people who abuse evaluation practice by using it to hide bald faced power grabs and subtle colonization.
Yesterday I got to play with one of my new learning and working partners, Ciaran Camman and their podcasting pal Brian Hoessler as a guest on their EvalCafe Podcast where we explored the intersection of evaluation, facilitation and complexity. This February Carolyn, Trilby, Rita, and Jara will join me to run an online course exploring these topics with my buddies at Beehive Productions. I invite you to join us there for what will be a really amazing set of conversations intended to open up our practices and apply these tools to complex projects.
I’m excited by the fact that I’m doing work in which facilitation and evaluation meet and moosh together. It’s making me better at what I do.
Back in December I announced my intention to take a sabbatical from Facebook and see what would happen. There were a number of factors in that decision, and I’ll share what I learned and what I’m doing now.
I had a few reasons for wanting to take a break:
- Facebook was a huge time waster, and earlier last year I deleted the app from my phone (it and Messenger and Instagram track your life your life and serve you ads based on what you’ve been doing). As a result, I have spent a lot less time there, although I do spend a lot of time on twitter.
- Facebook in engaged in undermining democracy and articles I was reading in 2018 pointed to their intentional and unintentional aiding and abetting behaviour with respect to undermining elections and eroding democratic engagement. Here is a good Atlantic article on that.
- Facebook creates a deep gravity well for conversation. It tailors your news feed using algorithms to only serve you a very small slice of your friends’ activity. Much of what you see confirms what you know and it is designed to activate your brain in a way that causes you to share information and pass it on, deepening confirmation bias, and spreading rumours and lies.
- People communicate on Facebook in shallow and brief ways, meaning large and important conversations for local communities become pile ons, where people that have never made the effort to introduce themselves to others in real life nevertheless feel free to be mean spirited and even borderline libellous while hiding behind their virtual identities. This has major implications in a small community like mine, where big local issues result in people starting rumours, passing judgements and ostracizing and slandering others in a way they would never do if they had to write to the newspaper, or see these people at the General Store. Discussions of complex ideas have devolved into the equivalent of drive-by shootings, often deeply personal.
These were the reasons I took a break and these are the reasons I am not coming back in a meaningful way.
When I started blogging in 2001, the promise of the Web 2.0 was that it would usher in the era of the creator. Any one could now create work on line. Recording studios, radio stations, television and film productions, newspaper, and magazines and book publishing all used to be inaccessible for the common person or the beginner artist. Now anyone could use whatever form of medium they wanted to say what is important to them. Before social media, Web 2.0 was about content creation media. It took time and effort to do it, but you could build a life, connect with others, find community in far flung corners of the globe, and make a contribution.
When social media came about into widespread use, around 2007 in my case with Facebook, the blogging world almost completely disappeared. People whose blogs I followed moved into facebook where I followed them for a while until their well crafted posts were lost in the endless stream of mindless diarizing, half-baked opinions and, later, the endless copypasta of shared memes and viral content. I had a hard time finding my people, but I was enjoying wishing friends a happy birthday and connecting with people from school, 30 years ago.
Over the past ten or so years what has happened is that my time has disappeared into the suck hole of scrolling through useless content instead of producing some of my own. Yesterday, talking with my friend Julien Thomas, I remembered that somewhere I said that democracy depends on us being active participants and not consumers.
Social media has made us consumers of other people’s content. In the 2001-2007 era of blogging, someone would write a post and if it was meaningful to you, you would quote it with an annotation about why it mattered and what your take was on it. Conversation was more considered and content was savoured and appreciated and hardly ever simply passed on. We were all content creators, hyperlinked to other content creators. When commenting began, discussion started to remain in a limited number of places but it was all open in the public and available to anyone. Comment spam really killed open discussion on blogs and maintaining spam-free comments sections became time-consuming. (Luckily there are better tools now, which is why you need to wait for me to approve comments on my blog).
With the dawn of Facebook however, content creation became highly concentrated in only a relatively and proportionally small number of places. Most people on Facebook simply pass it on other people’s stuff, often without any credit or link back to the original creator, and discussion happens behind closed doors and isn’t archived or very easy to access.
These days we are consumers of other people’s content, and we generally pass on what we like and agree with, amplifying it’s impact without adding to it. A few people have complained that they miss me on facebook, that they miss my voice and the things I say. But what I notice is that they like those things mostly because they can pass them on, or because what I have to say validates their views. It makes me I wonder where THEIR voice is, why they haven’t been thinking about things and sharing original opinions. And I wonder half-heartedly why I never get stuff from in my news feed that challenges my biases and my ideas anymore.
I have recently created a sock puppet twitter account to engage with conservatives in Canada, including those who are nationalist, populist and extreme right-wing. I am curious and concerned about the rise of populism and nationalism in Canada and the global connections between far right leaders who are promoting anti-immigrant, anti-globalist politics and messages. Through my “fake” twitter account, I am meeting conservatives that are also opposed to these far right echo chambers, and I am having my own ideas challenged. I am getting into debates and conversations with people I vehemently disagree with. I am posing on twitter as a real person, but not as “Chris Corrigan.”
I’m not going to reveal the identity of that twitter account. It says something to me about the nature of the social media landscape that I feel deeply uncomfortable showing up as my own self in those conversations. Debating with Nazis is not a safe thing to do, especially when one is debating with people hiding behind anonymous identities. And so I show up as a real person but with a fake name. Interesting.
Social media has become a place where relationships have become commercialized transactions and where democratic engagement has devolved into a fact free festival of insulting the other and patting your friends and allies on the back while being served highly specific advertising messages from corporations and political influencers. All the while, someone other than you is getting rich every time you connect to a friend. While it is nice to “stay in touch” I have to say that most of what passes across my screens on facebook is of very little value to me.
I would encourage people to go back to, or start blogging, and I’d encourage you to do it in the spirit of 2001 blogging, not in the spirit of “blog as PR tool” that we see today: share things, speculate, use it as a platform for what I call “Open Source Learning.” Use it as a gift exchange, not as a digital business card. Embed links to other people and add to the gifts of knowledge you receive before passing them on. You can start with WordPress as a powerful, free and easy-to-get-started-with tool.
For me I’ll be using facebook in these ways going forward:
- I’ll be continuing to promote workshops and events there, and for limited times, participating in facebook groups where that is chosen by the group as a way of keeping in touch.
- I will occasionally scan my feed and if I see that you have a birthday, or have experienced a death in the family, and you are a person with whom I have a personal relationship, you may well get an email or a phone call from me.
- I will share blog posts on facebook, but encourage discussion to happen here on the blog, where the world can see it and anyone can participate.
I’ll be going off Instagram and What’s App entirely (both owned by Facebook) and continuing to use twitter (@chriscorrigan) as a place for spontaneous conversation and meeting new voices. You can find my photos on Flickr, which has recently become revitalized and awesome again. If you have a blog, let me know and I’ll add you to my RSS feed (I use Inoreader for that)
On the Art of Hosting email list last month, there was an inquiry posted by Monica Nissén asking about scaling the Art of Hosting as a leadership practice through levels of engagement. By “Art of Hosting” Monica means the four fold practice, which is the basic framework for leadership that gives our community a coherent centre of practice, around presence, participation, hosting others, and co-creation. Monica asked whether hoping these practices would just go viral in a networked way is enough, and I replied with the following, tracing a couple of long term projects I have been involved in that have supported systems change in child and family services in British Columbia.
It’s definitely deliberate and networked. For me, it’s about building capacity. Our biggest work the last 9 years has been providing the Leadership 2020 program to social service workers in British Columbia working with children, youth and families in agencies, indigenous communities and government.
(You can read a summary of our five year evaluation of this program here)
We continue to developmentally evaluate as we go, and as a result, each cohort is different, each curriculum is slightly changed and we find new and more relevant ways to introduce people to this practice.
The basis of that program is a leadership approach that is very similar and deeply informed by what we in the Art of Hosting community know as the four-fold practice: that great leadership is personal, practice-based, participatory and perceptive. The program is structured in cohorts made up of people that have to apply. We mix “legacy” leaders with experienced and emerging leaders to show that learning never ends. Each cohort participates in two 5 day residencies – which are basically extended Art of Hosting workshops – and a nine month program of learning in between, featuring webinars and coaching and peer support for the application of tools and methods.
Over the past eight years we have brought about 450 people through the program. While it’s about learning in participatory ways, the program has a kind of hidden agenda. We are very clear that, about every 20 years or so, the child welfare system in our province goes through a massive restructuring, often provoked by a crisis, but not always. We have always invited our participants to both practice their leadership on the issues that are immediately in front of them, but to do it in a way that builds their capacity to respond when that later transformation happens. We want them to be the first to run to the centre when the old system is dying, eager to use their capacity, relationships, and practice to create the new.
In these days, the system is now beginning that deeper transformation, and fortunately it hasn’t been preceded by a crises. Instead, the woman who founded the Leadership 2020 program, Jennifer Charlesworth, was appointed to a five-year term as the Representative for Children and Youth in British Columbia, a very powerful position that is independent of the government and that can make powerful recommendations about systems change, usually as a result of different issues or events. Jennifer is bringing a collaborative approach to her work and to be successful in that, she is partly relying on the 450 Leadership 2020 graduates that are spread all through the system. There is a built-in capacity that is being invited into its biggest calling, reaching across traditional divides of indigenous/non-indigenous and government/community. Jennifer’s appointment to the position was received with widespread enthusiasm and optimism. We are hoping to see that the system is able to evolve faster with this capacity embedded in a way that is less painful than a collapse and transformation.
Participatory practices have been used for a long time in the field of social work and child and family services. In 2003 I started working with David Stevenson to use Open Space, Cafe, Circle, and the four fold practice to begin to build an indigenous governance systems for child and family services in BC. Our colleagues Kris Archie and Kyla Mason, Pawa Hayupis and many other indigenous Art of Hosting practitioners came into and out of that work. Toke Moeller and Monica Nissen and Patricia Galaczy joined us to teach Art of Hosting to families and community members who were participating in that work: http://www.turtleisland.org/healing/healing-cousins.htm. Between 2003 and 2009 we did something important on Vancouver Island. We started something and then had to abandon it for a different form, because not every idea works. But David later took that work with him into his work in executive positions in government. Kris has now become the CEO of the Circle on Philanthropy and Aboriginal Peoples in Canada and Kyra has become an extraordinary executive director of Usma, a Nuu-Chah-Nulth agency on Vancouver Island. Pawa is currently doing her Masters of Arts in indigenous governance and she and David continue to offer Art of Hosting trainings locally, as do Caitlin and I. In each of these new settings capacity building for participatory leadership has been used.
Meanwhile, Jennifer and a small group of us began Leadership 2020 in 2011. It has taken 15 years of developing leadership at the grass roots level and seeing that leadership grow into positions of power that has allowed us to work with the system this way. There is capacity in BC now, hopefully enough to take the system through the changes that are now coming, the ones we have prepared for, the ones we are waiting for, the ones we are making, and the ones that will surprise us.
It takes courage, patience, time, power, stewardship, relationship, and community to do this work. It takes a common language and shared perspectives and it takes massive diversity and difference to build resourcefulness and resilience. It is costly, politically, emotionally and materially, and it is not easy work. It requires a fierce commitment to relationship and a willingness to be at the edge of safety, with one foot out into the dangerous world. You get uplifted, hurt, angry, and joyful. But it’s a long game and you cannot sacrifice the depth of the work for ease and comfort. And no one person or team can do it alone.
It is not enough to do some trainings and walk away. The viral network does not just magically appear. Beautiful workshop experiences are only useful for systems change if they are connected to power. It requires staying in.
I just realized a few weeks ago that, although I never intended to work in the field of child and family services, that this may indeed be my life’s work. It has been nearly 20 years since I first walked into Vancouver Aboriginal Child and Family Services to take on a job organizing their negotiations to become a “delegated agency” able to make decisions for and with indigenous children and families instead of government doing it. I think in that time I’ve learned a bit about what it takes to create the capacity in a large system that gives us a chance. That’s all I can say we’ve done at the moment, but I’m an optimist, so I live with the hope and gratitude that the legacy of the work we have done will make the world better for the kids who suffer the most in it.
Many times when clients contact me they ask if I can help them come to consensus or alignment on their shared purpose or desired outcomes. They expect facilitation will help them to do this.
Sometimes this is a good idea. If we are working in a highly constrained project, like building a new building, getting everyone on the same page is important. But it’s also easy. All you have to do is bring in the experts, design a good implementation plan for a good solution and have project managers keep everyone on track, step by step. Most organizations are good at that, and if they aren’t they can easily learn the skills to do it.
Its not the linear project managers that are the problem. Its the problem that is the problem.
Conditioned to planning and implementing in this linear fashion, many organizations get flummoxed when they confront a problem with no obvious solution and no clear pathway forward. There may be multiple ways to think about the issues, multiple experiences of what is happening, and divergent and even contradictory desires around where we should be going. These kinds of wicked, seemingly intractable problems breed conflict, and the only recourse for leaders is to tolerate it for a while and then impose a solution with no guarantee that folks will be happy, or even that the solution is the best one possible.
These kinds of problems are complex: wicked, sticky, intractable, Volitile Uncertain Ccomplex and Ambiguous. Tough nuts to crack. There are lots of ways to describe them and lots of ways they drive frustration and conflict.
The common reactive response to these situations seems to be to first gather more information and try harder to find the obvious answer and try to get everyone on the same page. When I’m first working with clients experiencing these kinds of issues, I try to steer them away from certainty and alignment. I point out that in complex environments you don;t get to predict outcomes and you need to look for emergent practices and emergent solutions. Innovation never looks like something you’ve ever done before. Studying the present for the answer will not turn up the gold lying just out of eyesight under a rock. Complex solutions are for all practical purposes, infinitely unpredictable.
So what is the answer? Throw a bunch of ideas at teh wall and see what sticks?
Well, sometimes that can work, especially if you are truly out of ideas. But generally you have something to go on: a sense of direction, a sense that HERE isn’t where we want to be and that there is probably a better THERE that we should get to.
The issues is that, if we truly knew how to get from the undesirable HERE to the much coveted THERE, we probably would have done it by now. In complexity work, the first step here is admitting that trying to achieve pre-planned outcomes simply won’t work. Instead we need to go in a direction of travel towards a better place.
There are a couple of key ways to get started here. First, I always have groups spend time describing their current situation. We are looking for the patterns and dynamics that keep the system stuck in a place that isn’t working. Sometimes this can involve sophisticated research and narrative capture and other times it’s a simpler process of observation and pattern detection. Understanding the state of play helps us to discover an important secret, and that is, the inclination of the system to change.
Imagine an organization whose culture is fragmented and siloed with petty conflicts and turf wars over resources. Politics is rampant and some people seem to be at work only to stir the pot and not actually do the work. If you are a leader you might want to try to ay down the law and tell everyone to smarten up and focus on the organization’s mission. That never works. You can’t simply command a culture to change.
Instead you might convene a group of people to talk about what would be better. And people may say that they want a place that is more collaborative, more connected, and more fun to be at. What you have there is a group of people describing a preferred direction. It’s different from an outcome. It is instead a starting place, a place to orient their inquiry and their work to change things.
One thing you can do is begin by looking for places of positive deviency in the system. Bad as it is, there may well be people that are nevertheless already working in the preferred way, even in small ways. Those stories give you something to experiment with, and they reveal an inclination in the system that might lead to change. Conversely you may find that literally no one is working in this way and that the organization is truly mired in a pattern of deep dysfunction. In this case, the way forward is a radical breaking of the patterns that keep it in place.
Doing both of these things is a wise way to get started. INstead of requiring everyone to work together towards a common goal, you give space to people to work in small and diverse ways to discover how they might nudge the system towards a better THERE.
If you watch a river for a while you will notice that the river flows in both directions at once. Little obstacles in the river, like logs and rocks, create eddies that cause the current to turn back on itself. A living river is full of these back eddies and contradictory currents. Small creatures take refuge there, food and nutrients get trapped there and don’t all wash away to the sea. At the finest granularity of scale, it may even seem that the river is flowing backwards.
And yet the direction of the water i undeniable. It flows down, towards the sea and will always find the low point in its terrain.
That’s how strategic direction looks in complexity. Choose a direction, try multiple things that might work or might not. Contradict each other. Find the places where someone is working against the current and thriving in that little back eddy. Commit to a direction and see what can get you to go that way.
Rivers sit in a topography and changing the landscape is very hard. But changing the culture of a team or and organization can be easier if you work at the level of patterns. Find the patterns that hold behaviours in place and try small things to shift them . See what happens. In organizations you do get the shift the river banks.
It’s more work than making everyone sign your pledge of values, but it’s more meaningful, because the change you get is creative, co-owned and sustainable.
Things change in different ways.
A couple of weeks ago, I took a deep dive into Glenda Eoyang’s Human Systems Dynamics, learning about her theory of complexity and getting my hands on the tools and methods that HSD uses to work in complex adaptive systems. (The tools are very good by the way, and highly recommended as ways to both get a good introductory grasp on complex problems, and work within those contexts to make decisions and lead).
One of the useful ways of looking at things concerns the kinds of change that happen, and if you’ve been reading my blog lately, you’ll know that accurately describing your theory of change is a key discipline for me.
In HSD we talk about three kinds of change: static, dynamic and dynamical. I’m not 100% sold on the terminology, but I invite you to think of these are ways of describing the start and end points of an intervention.
Static change begins and ends with a fairly stable system. An example is nailing drywall to a frame. You start with a frame, a sheet of drywall and some nails. The act of change is a predictable and controllable action that fastens the drywall to the framing and creates a wall. The system is stable to begin with and stable after the intervention.
Dynamic change is change that is full of motion and movement but that motion follow a predictable trajectory and also begins with a fairly stable beginning and end point. To extend our metaphor, this is about building a house, or using a crane to raise and lower materials on the building site. There are dynamics at play but the beginning is knowable and the end state is predictable. The interventions are dynamic, requiring little adjustments as you go, applied with expertise. Hire a crane operator if you want to avoid accidents.
Dynamical change comes from the world of physics, where small perturbations in a system result in massive changes and emergent outcomes. The beginning state is in motion and has a history that matters. The end state is also in motion and has a trajectory that matters. The intervention will alter the the future state in unpredictable ways. This is what happens in most complex systems. Small changes make big and unpredictable differences. Extending our house building metaphor even further, this is what happens when you build a variety of structures in a neighbourhood and fill them with people. The neighbourhood changes, sometimes for the better, sometimes for the worse.
We can try to reduce the amount of unpredictability in our work but there are limits to that. Externalizing the results of our decisions is not without peril, and in fact I would say that there is a moral imperative to taking responsibility for the kinds of interventions that we make in a system. While we can’t know everything that is going to happen, we need to bear some responsibility for our actions. In highly ordered systems where causality is attributable, we can do this with solid accountability mechanisms. In highly unordered, complex and emergent systems, we can’t attribute causality and accountability, but we can take care to use the right tools and views. This sometimes paralyzes people into not acting – the well known “analysis paralysis” situation. Sometimes not acting, or simply ignoring consequences, comes with some moral peril. The problem is that, despite the nature of the problem, we still need to act.
I find in general that it helps to know that complexity is fundamentally unknowable in its totality. in this kind of system, no amount of data and research will give us definitive answers before making decisions about what to do. This is why adaptive action is so important. It shortens the feedback loop between planning, acting and evaluating so that you can start small and being to watch for the effects of your decisions right away. Of course with large scale system work, the process of understanding the system is important, but it’s a never-ending process. One studies it but one shouldn’t treat a large complex system as if it is always subject to static change: moving between one state and another. We need to learn to see that and operate within a dynamic and changing environment, finding “just enough” information to initiate changes and then watching for what happens, adjusting as we go.