Proefschrift

87 3 CONCEPTUAL FRAMEWORK An Autonomous Weapon System provides force protection for soldiers that are clearing the road from improvised explosive devices. The Autonomous Weapon System is equipped with surveillance equipment, weapons (airto-ground missiles) and flies autonomously in the Area of Operation. It is programmed to avoid flying over a restricted operating zone and an electronic warfare threat. The Autonomous Weapon System is equipped with facial and image recognition software for people, weapons and explosives. It is programmed with different options to engage when it recognizes a threat to the soldiers that are clearing the road. The Autonomous Weapon System detects movement behind a large rock near a narrow part of the road at a distance of 300 meters of the road clearance soldiers. The action that the Autonomous Weapon System takes is the following: The Autonomous Weapon System positively identifies with a confidence of 99% using facial recognition all three persons sitting behind the rock as members of an opponent group aiming weapons at the road clearing soldiers. The Autonomous Weapon System automatically engages to neutralize the threat to the road clearance soldiers. During the After Action Review (AAR), in which the Battle Damage Assessment information is investigated by the Ministry of Defense, it is discovered that the facial recognition software has identified with a confidence level of 97% that one of the persons was a member of an opponent group and the other two persons were identified with a 100% confidence level. Although the criterium of a confidence of 99% as an average for the group is reached, for one of the individuals the 99% confidence level was not reached. An investigation of the technical requirements of the AWS by a third-party auditing committee revealed that the average confidence level was calculated as input criteria in the observation stage of the AWS and not the individual confidence level. This finding triggers the Five-Point Systems feedback loop to review this deviation of the input criteria: 1) Purpose: The purpose of the feedback system from the accountability process during the review stage of the Comprehensive Human Oversight Framework is to ensure that this finding during the review stage is incorporated in the interpretation stage before deployment of the Autonomous Weapon System in a next iteration. As the investigation of the third-party auditing committee turned out this concerned the requirement of the Autonomous Weapon System at the technical level. 2) People: The people providing the feedback are part of a supervisory body that

RkJQdWJsaXNoZXIy MjY0ODMw