An official website of the United States government
Here's how you know
A .mil website belongs to an official U.S. Department of Defense organization in the United States.
A lock (lock ) or https:// means you’ve safely connected to the .mil website. Share sensitive information only on official, secure websites.

NEWS | March 31, 2023

CAML: Competency-Aware Machine Learning

Project Lead:  Dr. Lael Rudd                                                                        

Sponsoring Organization:  DARPA


Project Synopsis:  In order to transform machine learning (ML) systems from tools to partners, users must trust their machine counterpart. While state-of-the-art ML systems can perform well when their behaviors are applied in contexts similar to their learning experiences, they can’t communicate their task strategies, the completeness of their training relative to a given task, the factors that may influence their actions, or their likelihood to succeed under specific conditions. CAML seeks to address this challenge by enabling learning systems to be aware of their own competency. Systems will have knowledge of their learned abilities, the conditions under which those abilities were learned, knowledge of their resultant task strategies, and the situations for which those strategies are applicable. By creating a fundamentally new ML approach, CAML will facilitate mission planning, giving human operators insight into available machine assets based on task requirements, determining the level of autonomy to be granted, and controlling behaviors to adapt for operating conditions.