ICO - Design for Data Rights and Non-Discriminatory AI

ICO - Design for Data Rights and Non-Discriminatory AI

Introduction

Introduction

In collaboration with ANTI and commissioned by the Information Commissioner’s Office (ICO), we ran a research program spanning multiple weeks and research methods to map the role of design in creating non-discriminatory AI. The research will help the UK’s ICO understand how (mis)use of personal data across the AI pipeline can create harms, the technical, social & organizational challenges in mitigating them, and the support product teams and designers might need.

Timeline

November 2021 - March 2022

Team

Team
Nadia Piet
Ploipailin Flynn

Client

ICO

Introduction

In collaboration with ANTI and commissioned by the Information Commissioner’s Office (ICO), we ran a research program spanning multiple weeks and research methods to map the role of design in creating non-discriminatory AI. The research will help the UK’s ICO understand how (mis)use of personal data across the AI pipeline can create harms, the technical, social & organizational challenges in mitigating them, and the support product teams and designers might need.

Timeline

November 2021 - March 2022

Team

Team
Nadia Piet
Ploipailin Flynn

Client

ICO


This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 951911.


This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 951911.


This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 951911.

Why it matters

Not all data harm is malicious, and not all well-intended products end up being good.

Discriminatory outcomes manifest in the design of AI services through the use of personal data. We provided examples of this in the form of a pyramid of algorithmic harm, ranging from ignorance to malintent. It is important to be aware of these subtler, enabling behaviors that allow for more overt forms of harm.

Explore the Project Vault

How we did it

Through participatory workshops, we gathered perspectives, case studies, and experiences straight from the perspectives of practitioners, which fed into our the larger research project.

Explore the Reading List behind the project

Output

What we made