65 3 CONCEPTUAL FRAMEWORK Ex ante supervision Ex ante control Ongoing control Ex post review Ex post control (accountability) Input Feedback mechanism Output Goal of system Behavior of system Oversight of system Governance layer Socio-technical layer Technical layer Time Environment External Internal Socio-technical perspective on control Engineering perspective on control Governance perspective on control 1 2 3 4 5 6 7 8 9 Figure 7: Comprehensive Human Oversight Framework Socio-technical layer The socio-technical layer describes the operators’ psychological and motivational conditions required for the system to remain under control. Ex ante, the human operators should be able to set the right control measures before deployment and to correctly appreciate the capabilities and limitations of the systems (block 4). Ex ante control is a preliminary control mechanism that defines the boundaries of the autonomy of agents to achieve a delegated task (Busuioc, 2007). During use, the human operators should have the capacity to have a meaningful interaction with the system and understand what it is doing in order to supervise the system to have ongoing control (block 5). Ongoing control is an informal type of direct control of an agent that specifies the goals but not the specific actions an agent has to take to achieve a delegated task (Busuioc, 2007). Supervision is seeing to it that something is achieved by an actor (see section 2.12). Ex post, after deployment of the system, the human operators should be able to inspect and assess the behaviour of the system to be able to account for its actions (block 6). Ex post control is the principle of delegating powers to an agent and therefore renouncing direct control. It is a process of providing information, discussion and evaluation to determine the extent to which the agent has lived up to its ex ante mandate (Busuioc, 2007). Governance layer The governance layer describes the political and institutional conditions and the
RkJQdWJsaXNoZXIy MjY0ODMw