Home/Articles/Article 14
Chapter IIIHigh-Risk

Article 14

Human Oversight

Plain-Language Summary

High-risk AI systems must be designed and developed to enable effective oversight by natural persons during the period of use. Oversight must allow humans to monitor, intervene, understand, and override the system, and operators must be assigned appropriate oversight responsibilities.

Keywords

human oversightautomation biasoverrideinterventionmonitoringhuman controlstop button

Legal Text

Article 14 — Human Oversight

1. High-risk AI systems shall be designed and developed, including with appropriate human-machine interface tools, in such a way that they can be effectively overseen by natural persons during the period in which the AI system is in use.

2. Human oversight shall aim at preventing or minimising the risks to health, safety or fundamental rights that may emerge when a high-risk AI system is used in accordance with its intended purpose or under conditions of reasonably foreseeable misuse.

3. The oversight measures shall be commensurate with the risks, level of autonomy, and context of use of the high-risk AI system, and shall be ensured through one or all of the following:
(a) the ability to fully understand the capacities and limitations of the high-risk AI system and be able to duly monitor its operation, so that signs of anomalies, dysfunctions and unexpected performance can be detected and addressed as soon as possible;
(b) the ability to remain aware of the possible tendency of automatically relying or over-relying on the output produced by the high-risk AI system (automation bias);
(c) the ability to correctly interpret the high-risk AI system's output, in particular when the output has the form of a recommendation, decision, or prediction;
(d) the ability to decide, in any particular situation, not to use the high-risk AI system or otherwise disregard, override or reverse the output of the high-risk AI system;
(e) the ability to intervene on the operation of the high-risk AI system or interrupt the system through a stop button or similar procedure.