64 3 CHAPTER 3 3.1 COMPREHENSIVE HUMAN OVERSIGHT FRAMEWORK In the literature review of the conceptual investigation phase of our research, we studied the work of Van den Berg (2015) and his three-layered model consisting of a technical, socio-technical and governance layer (see section 2.9) that he created to describe cyber space. In our analysis we linked these layers to the accountability mechanisms (section 2.9) and control perspectives (section 2.11) to a time perspective which shows when a process is taking place. This analysis led to the design of the Comprehensive Human Oversight Framework (Figure 7). On the x-axis of the Comprehensive Human Oversight Framework time is plotted which can be divided into three phases: (1) before deployment of a weapon, (2) during deployment of a weapon and (3) after deployment of a weapon. These phases are depicted by the vertical columns of the framework. The y-axis describes the environment of the system which can range from more internal to more external to the technical system. The combination of layers and columns result in nine blocks that each contain a component of control in each phase and layer. For example, before deployment the input to a system is a component to control the goal of the system in the technical layer. The Comprehensive Human Oversight Framework allows to highlight the existence of gaps in control. These are presented below in section 3.3. Figure 7 depicts the three layers of the Comprehensive Human Oversight Framework. The bottom technical layer describes the internal environment of the system and the upper governance layer the external environment of the system. The middle socio-technical layer is the intersection between the internal and external environment. Technical layer The technical layer describes the technical conditions required for the system to remain under control. The system should be able to receive the right input (for example restrictions on the boundaries of the area of operation) from the human operator (block 7), the system’s feedback mechanism should be robustly and verifiably to check the difference between output and goals during development (block 8) in order to keep responding to the reasons (goals and norms) of the human operators, and after deployment it should be technically possible to verify and understand the output (e.g. check if the system did not cross the boundaries of the allocated geographical area) and the processes behind them (block 9).
RkJQdWJsaXNoZXIy MjY0ODMw