06 / 08

Human Agency, Oversight and Competence

People overseeing AI should have the knowledge, authority and ability to intervene, while organizations preserve human judgment and professional skills.

Human Agency, Oversight and Competence

6.1 Meaningful human command, oversight and intervention

Organizations shall determine whether, why, and under what conditions artificial intelligence is used. Oversight shall be proportionate to the system’s context and risks and shall be meaningful only where the responsible person is informed of its purpose, limitations, uncertainty, and foreseeable failures; can access the relevant facts and evaluate its output independently; and has the competence, authority, and practical ability to question, override, suspend, or terminate its operation.

6.2 Preservation of human judgment and professional skill

The introduction of artificial intelligence shall not erode the knowledge and judgment needed to supervise the system, detect errors and perform essential work when technology fails. Organizations shall identify the competencies that must remain human and shall organize training and work allocation so that those competencies continue to develop. Junior professionals shall receive sufficient opportunity to acquire foundational skills before AI is allowed to replace the learning processes through which sound judgment is formed.