Modéliser les interactions entre agents : un prérequis pour analyser l’éthique des systèmes complexes

Modéliser les interactions entre agents : un prérequis pour analyser l’éthique des systèmes complexes

Robert Demolombe  

Institut de Recherche en Informatique de Toulouse (collaborateur extérieur)

Corresponding Author Email:
31 December 2018
| Citation



Ethical rules applied to complex systems, such as weapons systems involving drones, require a detailed analysis of the interactions between the agents. These rules involve institutional, human, software and hardware agents. Their interactions involve causality, influence and relationships between human tutional. Starting from examples, these notions are analyzed informally then formalized in modal logic. This formalization highlights different rules of reasoning which are often confused: the reasoning on the logical consequence, the reasoning on causality and influence, and the reasoning on the relations between institutional agents’ actions and actions of agents acting on their behalf. This formalization can help to design consistent ethical rules.  


agents, causality, influence, ethics, modal logic

1. Introduction
2. Analyse semi-formelle
3. Formalisation
4. Relations avec d’autres travaux
5. Conclusion

Bonnemains V., Claire S., Tessier C. (2016). How ethical frameworks answer to ethical dilemmas: Towards a formal model. In 1st workshop on ethics in the design of intelligent agents.

Broersen J., Dastani M., van der Torre L. (2003). BDIO-CTL: obligations and the specification of agent behaviour. In International joint conference on artificial intelligence.

Carmo J., Jones A. (2002). Deontic logic and contrary-to-duties. In D. Gabbay (Ed.), Handbook of philosphical logic (volume 8). Reidel.

Carmo J., Pacheco O. (2001). Deontic and action logics for organized collective agency, modeled through institutionalized agents and roles. Fundamenta Informaticae, vol. 48, p. 129– 163.

Chellas B. F. (1988). Modal logic: An introduction. Cambridge University Press.

Cointe N., Bonnet G., Boissier O. (2016). Ethical judgment of agents’ behaviors in multi-agent systems. In International conference on autonomous agents & multiagent systems.

Cuppens F. (2015). Roles and deontic logic. In 28th annual conference on legal knowledge and information systems.

Demolombe R. (2012). Causality in the context of multiple agents. In T. Agotnes, J. Broersen,

D. Elgesem (Eds.), Deontic logic in computer science (LNAI volume 7393). Springer Verlag.

Demolombe R., Jones A. (2002). Actions and normative positions. a modal-logical approach.

In D. Jacquette (Ed.), Companion to philosophical logic. Blackwell.

Demolombe R., Louis V. (2006). Norms, institutional power and roles: toward a logical framework. In F. Esposito, Z.W. Ras, D. Malerba, , G. Semeraro (Eds.), Foundations of intelligent systems (LNAI 4203). Springer Verlag.

D. Grossi J.-J. C. M., Dignum F. (2008). The many faces of counts-as: A formal analysis of constitutive rules. Journal of Applied Logic, vol. 6.

ETHICAA. (2015). Dealing with ethical conflicts in autonomous agents and multi-agent systems. In 1st international workshop on artificial intelligence and ethics at the 29th AAAI conference on artificial intelligence.

Garion C., Roussel S., Cholvy L. (2009). A modal logic for reasoning on consistency and completeness of regulations. In Normative multi-agent systems.

Grossi D. (2007). Desigining invisible hancuffs. formal investigations in institutions and organizations for multi-agent systems. Thèse de doctorat non publiée, Utrecht University.

Hilpinen R. (1997). On action and agency. In E. Ejerhed, S. Lindstrom (Eds.), Logic, action and cognition: Essays in philosophical logic. Kluwer.

Horty J. (2001). Agency and deontic logic. Oxford University Press.

Horty J., Belnap N. (1995). The deliberative STIT: A study of action, omission, ability, and obligation. Journal of Philosophical Logic, vol. 24, p. 583–644.

J. Gelati A. R., G. Governatori, Sartor G. (2002). Declarative power, representation, and mandate: A formal anaysis. Frontieres in Artificial Intelligence and Applications, vol. 89.

Jones A. J., Sergot M. (1996). A formal characterisation of institutionalised power. Journal of the Interest Group in Pure and Applied Logics, vol. 4, no 3.

Lewis D. (1973). Counterfactuals. Harvard University Press.

Lorini E., Sartor G. (1994). Influence and responsibility: A logical analysis. In 2nd international workshop on deontic logic in computer science.

Lorini E., Sartor G. (2016). A STIT logic for reasoning about social influence. Studia Logica, vol. 104, no 4.

Makinson D. (1998). On a fundamental problem of deontic logic. In P. McNamara, H. Prakken (Eds.), Norms, logic and information systems. IOS Press.

Pacheco O., Santos F. (2004). Delegation in a role-based organization. In A. Lomuscio, D. Nute (Eds.), Deontic logic in computer science (LNCS 3065). Springer.

Porn I. (1977). Action theory and social science. some formal models. Synthese Library, vol. 120.

Santos F., Pacheco O. (2003). Specifying and reasoning with institutional agents. In 9th international conference on artificial intelligence and law.

Segerberg K. (2002). Outline of a logic of action. In F. Wolter, H. Wansing, W. de Rijke,

M. Zakharyaschev (Eds.), Advances in modal logic (volume 3).World Scientific Publishing Co.

von Wright G. H. (1963). Norm and action. Routledge and Kegan.