Trustworthy AI: Decision Making Systems


Section 1Q1: Define the Problem

The Challenge We're Addressing

The interaction modalities between human decision-makers and AI systems are currently under-specified, lacking clear definitions of mutual expectations and role allocation. While decision-making topologies are becoming increasingly complex—ranging from direct Human-AI dyads (e.g., User(H)-to-tool(AI)) to extended, heterogeneous sequences involving multiple agents (e.g., Trainer(H)-to-learner(AI), Trainer(H)-to-learner(H)-to-tool(AI), or Trainer(H)-to-learner(AI)-to-tool(AI))—system designs fail to account for these nuances. Critically, while the sequence always starts with a single human decision-maker, the variable number of embedded learners, users, and AI tools in these chains complicates the flow of information. This interaction ambiguity contributes to decision-makers placing inappropriate levels of trust in AI outputs, as the systems are not designed to support the transparency, feedback loops, or retrospective analysis required for human learning and effective decision oversight.

Section 2Q2: What is the Research?

Our Research Approach

Research Focus
[Description of research focus areas, key topics, and domains]
Methodology & Approach
[Research methods, frameworks, tools, and strategic approach]
Section 3Q3: What Value Will the Research Provide?

Anticipated Impact & Benefits

Benefit Type 1
[Description of specific value/impact]
Benefit Type 2
[Description of specific value/impact]
Benefit Type 3
[Description of specific value/impact]
Section 4Q4 & Q5: Stakeholders & Audience

Who's Involved & Who Should Care

Key Stakeholders

Primary Stakeholders

AI System Developers/Engineers: They will use the design guidelines and taxonomies to build more usable and trustworthy systems
Decision-makers/Learners: They will benefit from better calibrated trust and improved understanding of AI outputs, leading to better decision quality.
HCI and Cognitive Science Researchers: The taxonomy and empirical data will provide foundational knowledge for future studies on human-AI collaboration.

Secondary Stakeholders

Regulatory Bodies: They can use the trust calibration metrics and design principles to establish certification standards for high-stakes AI tools.
Government/Defense Agencies: They have a critical need for reliable human-AI teams in complex environments (e.g., intelligence analysis, military command).
Educational Institutions: Findings will inform curriculum development for training future professionals who must work alongside AI.
Target Audience / Beneficiaries

Primary Audience

AI Researchers (HCI, Cognitive Science, and Systems Engineering)
Technology Leaders responsible for deploying and governing AI in industry and government

Secodnary Audience

Academic journal reviewers and policy analysts
Section 5Q6: Identify Possible Funding

Potential Funding Sources

Source 1
[Grant/Type]
Source 2
[Grant/Type]
Source 3
[Grant/Type]
Source 4
[Grant/Type]
Section 6

Our Interdisciplinary Research Sub-Group

Mueen Abdullah
Co-Lead/Prof. Computer Science
Meeko Oishi
Co-Lead/Prof. Electrical & Computer Engineering
Stephanie Moore
[Role/Title]
Fan Xu
[Role/Title]
Claus Danielson
[Role/Title]
Kari Yacisin
[Role/Title]