Tuesday, 26 August 2014

God Didn't Propose Thus


The prevailing theory of jurisprudence in the West at the moment goes back to Hobbes. It was developed by Immanuel Kant and later by Rousseau, and is sometimes called the contractarian model after Rousseau's idea of the social contract. It's not the sort of contract that you look at and think, oh gosh, that might be nice, I might think about opting in to that, it's more like a pop up license agreement that says, do you want to comply with this contract, or would you rather be an outlaw. So you don't get a lot of choice about it. Sometimes the same theory flying the flag of Immanuel Kant, is called transcendental institutionalism, because the basic approach says, you identify the legal institutions that in a perfect world would govern society, and then you look at the processes and procedures, the protocols that everyone should follow in order to enable those institutions to work, and then you say, right, that can't be transcended, so therefore there's a moral imperative for everyone to do it. So this model doesn't pay any attention to the actual society that emerges, or to the incentives that these processes actually place on various people to act in a particular way. It doesn't look at any interaction effects, it simply says, well you have to behave in this particular way because that's what the law says you have to do, and the law is the law, and anybody who doesn't behave in that way is a criminal, or (in our terms) is an attacker.

In the vanilla model of secure systems design that we find in books for children, we advocate the same kind of approach; you have a security policy, you identify the institutions and protocols that are going to implement this policy, and you say, well people have to behave in accordance with the security policy because otherwise they are policy breakers, and that's the definition of an attacker. And the problem with these assumptions is not only do they make systems hard to use, and unpleasant, but they also have the effect of building in the weak links to the system.
For example, I don't have a choice but to trust my bank, it's that or nothing. I don't have a choice but to trust the doctor or the boss. What's their incentive to be honest and competent? Well their incentive is that the policy says they have to be, yes, the law is the law, and it applies to everyone, so that's your guarantee. So what will be our Enlightenment? We're
actually working with a medieval model of secure systems design, and so the argument is that the Holy Roman emperor approach to system security is not just a bad deal just for users, its actually a bad deal for system security as well.
In terms of low level details, which is, to what extent there's an analogy between bugs in ordinary systems where users just want performance and usability and things like that, and security violations in systems where we have some sort of anti-requirement; the things that we want the system not to do are just as important as what we do want it to do. It's almost a de nition of maturity; a system is mature when most of your bugs come from fixes that you have put in to correct bugs that were there before. But there are two important differences. The first is, bugs don't get fixed unless they actually caused a problem, right, there's no notion of prophylactic fixing, if it does not cause a problem, its not a bug yet. And the second thing is that after any piece of code is in the field for a certain length of time the fix is to document the bug carefully and propose a work around. In other words you change the behavior of the client so as not to get the system misbehave, because that's got a good chance of working, whereas any bug that has been out there for a long that hasn't been fixed yet, either its really not a problem or not easy to fix.
In the last twenty years when our worst fears have come true and we have more than realized that such a model does not address security requirements even if we tend to ignore the requirements of freedom and liberty......I would like to conclude with an analogy of our immune system Our immune system is not perfect but its a vital defense and it moderates itself against attacks as best as it can and for most of us this works. God proposed a system that takes into account as attacks evolve. Lets learn.....and unlearn a lot