Proefschrift

153 SUMMARY as research approach. The VSD is a three-partite approach that allows for considering human values throughout the design process of technology. It is an iterative process for the conceptual, empirical and technological investigation of human values implicated by the design of an artifact. In the conceptual investigation phase of our research, we propose a Comprehensive Human Oversight Framework for Autonomous Weapon Systems. This framework consists of three layers that connect the technical, socio-technical and governance perspectives of control. These layers link the control perspectives to a time perspective which shows when a process is taking place with respect to autonomous action: (1) before deployment of a weapon, (2) during deployment of a weapon and (3) after deployment of a weapon. This results in a nine-block framework that contains several control mechanisms. Our main claim is that combining the control mechanisms in the technical, socio-technical and governance layer will lead to Comprehensive Human Oversight over Autonomous Weapon Systems which may ensure solid controllability and accountability for the behaviour of Autonomous Weapon Systems. When applied to the case of Autonomous Weapon Systems the Comprehensive Human Oversight Framework reveals two gaps in control, one gap in the governance layer and one in the sociotechnical layer during deployment of an Autonomous Weapon System. The application of the Glass Box framework on the Comprehensive Human Oversight Framework could mitigate these gaps in control. The Glass Box framework is built around the black box (in the socio-technical layer during deployment of an Autonomous Weapon Systems) with an interpretation and the observation stage which allows for a transparent human oversight process. A feedback process can close the loop after deployment of a weapon from the accountability process back to the interpretation stage before a next deployment of a weapon. As part of the empirical investigation phase of our research, we build on our conceptual work by conducting qualitative research through interviews, value deliberation in expert panels and a survey. We conducted value elicitation by means of the Value Deliberation Process as first step of the interpretation stage of the Glass Box framework. We designed an online Value Deliberation Process consisting of a bipartite survey and a virtual session for the expert panel discussion. The value deliberation was done with 14 participants divided over two groups. The participants were a mix of military personnel and civilians working at the Dutch Ministry of Defense, an NGO, researchers, policymakers and industry. The value elicitation conducted using the Value Deliberation Process not only shows that value discussion leads to changes in perception of the acceptability of alternatives in a scenario of Autonomous Weapon System deployment, it also gives insight into which values are deemed important and highlights that trust in the decisionmaking of an Autonomous Weapon System is crucial.

RkJQdWJsaXNoZXIy MjY0ODMw