Tue 13 Dec 2011
Bigmother is back in the air
Posted by Mikkel Holm Sørensen under General , Mikkel's blog | 1 CommentTo celebrate Marius‘ heroic work to raise Bigmother from the web-ashes (after a Chinese hack-attack) and to test if it actually works allow me to cross post from a recent post from /KL7. A little reflection on the ethics of behavioral engineering.
Even if you – at least for the sake of the argument – admit us the practical value of monitoring to obtain knowledge and thus give up on well-exercised arguments for the inbreachable privacy rights of people, there is still a question of ‘elitist’ ethics: “What allows you or your client” you might ask, “to decide what people ‘ought’ to do in your so called behavioral engineering approach?” That is, you might admit us the right to act ‘bigbrother’ to gain knowledge but not a normative ‘bigmother’ to achieve a certain behavior. That is a perfectly legitimate question. Let us deal with it once and for all.

In their book Nudge – Improving Decisions About Health, Wealth, and Happiness Thaler and Sunstein discuss this issue and argue at length for the legitimacy of ‘paternalism’. As long as it is liberitarian paternalisme leaving agents with a free choice. This basically means lowering the cost (mentally, cognitively, resource-wise) of making the ‘right’ choice not coercively forcing anyone. The basic argument is that humans – as opposed to the theoretical construct homo economicus – quite frequently make bad choices for a number of reasons. As such, humans needs little ‘nudges’ to make the right choices faced with complexity and insufficient information.
But what is our reason in /KL7? They are very different in origin but univocal in consequence: Humans simply need help to make the right choices in a lot of contexts as we tend to act against our own long term interests. The last couple of hundred years of thinking has been one long dethronement of human rationality. Let us have a look at some of the reasons for questioning mans ‘rationality’:
Philosophical: Nietzsche, Freud, and Marx seriously questioned the merits of our explicit motives. Nietzsche was probably most brutal to our self-understanding when he claimed that all rationality is covered up irrationality: The true boss running the show is our hidden drives.
Cognitive: Cognitive science has amply demonstrated how bodily emotions and basically animal drives stands for a majority of actions and decisions.
Neurological: According to neurology rationality – or the frontal lobes in this terminology – can at best ‘orchestrate’ the symphony of impulses rather than originate or control them.
Biological: From biology we know how we are e.g. prone to eat as much sugar and fat as we can come across since such energy-rich nutritions are rare in nature. But we all know how cheap and available sugar and fat are in our modern world without our spontaneous reaction adapting.
Sociological: Humans are embedded in a social and cultural context often blurring the motivation and thus ‘rationality’ of personal choice.
Economical: Homo economicus, the notion of the perfectly rational, optimizing agent suffers badly in the famous ‘ultimatum game’ experiment. Emotions and our sense of fairness simply trumps rationality when it comes to accept an haphazardly uneven distribution of means: You rather have nothing than only $10 out of $100 if your partner takes the other $90.
Branding: We know that some of the most adored brands in this world act as filters of complexity by making a lot of choices on behalf of the customers. Apple, BMW, Google anyone? In design it is called minimalism, in branding identity and in everyday lingo we call it focus. Most people love brands preciselt for the choices they make on their behalf. This is more about emotional coupling than rationality. Add to this religion as an existential coupling that is also about narrowing the window of available actions and interpretations.
Rational impotence: We have worked long enough with health, traffic, smoking etc. campaigns to know that ‘what I ought to’ is totally decoupled from ‘what I will actually do’. If you conducted a multiple choice test with smokers, alcoholics or obese they would probably have most facts relating to their vice right. But sine this ‘rational’ knowledge is decoupled from emotionally based motivation changed behavior remains a fatamorgana.
Self-inspection: Last but not least; we know ourselves and our rational shortcomings too well. It is only too human. And just like you adjust for physical dysfunctions we think it is perfectly empathetic and ethic to help people behave constructively. As long as it’s not against their or others own long term interests (as deemed by themselves).
And what about the opposite: No intended or unintended influence? How about design, management, didactics or a message that does not willingly or unwillingly stimulate a certain behavior? Quite unthinkable right? You would not deny parents the right to enforce a specific kind of behavior on their offspring either (in general that is. There are extreme examples challenging our norms). So yes, KL7′s business model is to stimulate behavior that would not have arisen spontaneously in the same context. But we always make sure to make choices as transparent as possible by making the stimulation explicit or peoples behavior available to themselves through feedback and only support behavior that the agent herself would otherwise sanction or even cherish. As such we are proud of making peoples life a little better and apply our abilities to support consumerism, pushing around even more communication or add to the visual pollution of the world.
January 13th, 2012 at 2:11 pm
Hey Martin (?) and thanks for the comment. We ought to have this discussion at KL7.dk but let that be.
First of all: I’m actually making quite a trivial point – that humans often need a hand to navigate this world (like the bright colors of a lifebuoy to metromaps only highlighting routes and not the entire infrastructure) – but by accentuating it it suddenly becomes an ethical issue of manipulation. But I’m thrilled that anybody joins us to explore the details. Thanks!
Let’s take your comment bit by bit. Regarding the dethronement of rationality I cannot quite figure out if we disagree or if it’s just hairsplitting. I think that few today regard our rationality as supreme, ‘clean’ and autonomous as we did just a century ago (why do you think Freud and Nietzsche created such a fuzz?). So yes, there is something wrong in believing in rationality as good guidance whether it’s individually or collectively. And that is NOT common knowledge if you study people choices and not least their explanations for choosing so.
As regard communication I cannot follow your point that its sole purpose is to make people ‘find out more about themselves’. Communication serves numerous different purposes. Instruction, information, communication, etc. And as for the beautiful philosophical aim of ‘know thyself’ as the ultimate goal in life I can only say: well for some (rationalistic enlightenment philosophers) that might be so. The rest just want a flat screen television, a little love and a yearly trip abroad.
So the point of not helping people to make fewer mistakes is flawed. A 25 year old drug-infused man drives your 3 year old daughter over at high speed. Should we try to avoid that kind of behavioral mistakes from other 20-28 old males (that unfortunately doesn’t have the cognitive capacities to recognize own mortality and the consequences of their actions) or just let them reflect upon their mistakes and change behavior some 10-15 years later? I think most agree we should ‘help’ them. On a less dramatic note: Should we help obese people with the wrong network, habits and trouble understanding nutrition loose weight by stimulating the right choices? Again yes I think we should? Should we do it covered, with coercion or commercially? No of course not. The Nudge literature is full of examples of the importance of free choice (proponents confess to ‘libertarian paternalism’) and in KL7 we are proponents of transparency (e.g. through monitoring and feedback as the agent for behavioral change). But the break assistant in modern cars that step in if you approach the object at too high speed first with a notification and ultimately just taking over breaking control doesn’t need your consent. There is simply no scenario where the non-breaking outcome is desired (we do not design for suicide). So the need for freedom is a continuum and not a ultimatum. Besides the situations in life where our solutions are relevant is only a fraction of everyday choice. So I still haven’t issues sleeping at night in trying to make this world a little healthier, safer, cleaner, and more beautiful.
Hope my answer made sense, clarified our position and helped you find out just a little bit more about yourself