–
Project Lead: Dr. Lael Rudd
Sponsoring Organization: DARPA
Website: https://www.darpa.mil/program/competency-aware-machine-learning
Project Synopsis: In order to transform machine learning (ML) systems from tools to partners, users must trust their machine counterpart. While state-of-the-art ML systems can perform well when their behaviors are applied in contexts similar to their learning experiences, they can’t communicate their task strategies, the completeness of their training relative to a given task, the factors that may influence their actions, or their likelihood to succeed under specific conditions. CAML seeks to address this challenge by enabling learning systems to be aware of their own competency. Systems will have knowledge of their learned abilities, the conditions under which those abilities were learned, knowledge of their resultant task strategies, and the situations for which those strategies are applicable. By creating a fundamentally new ML approach, CAML will facilitate mission planning, giving human operators insight into available machine assets based on task requirements, determining the level of autonomy to be granted, and controlling behaviors to adapt for operating conditions.