One of my research topics in grad school was fairness, accountability and transparency (FAT) in NLP systems. I& #39;ve kept up with the literature.
Here& #39;s a quick thread of papers I& #39;d recommend reading on the topic if you want to get up to speed.
Here& #39;s a quick thread of papers I& #39;d recommend reading on the topic if you want to get up to speed.
"The Social Impact of Natural Language Processing" by @dirk_hovy and @ShannonSpruit. One of the earliest landmark papers on the topic, reviews different types of harm (with examples) https://www.aclweb.org/anthology/P16-2096.pdf">https://www.aclweb.org/anthology...
"Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings" by Bolukbasi et al. http://papers.nips.cc/paper/6228-man-is-to-computer-programmer-as-woman-is-to-homemaker-d
This">https://papers.nips.cc/paper/622... paper set off a large body of research on bias in word embeddings. (Note: I personally don& #39;t think this is the most urgent ethical issue.)
This">https://papers.nips.cc/paper/622... paper set off a large body of research on bias in word embeddings. (Note: I personally don& #39;t think this is the most urgent ethical issue.)
"Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints" by @jieyuzhao11 et al https://www.aclweb.org/anthology/D17-1323.pdf
This">https://www.aclweb.org/anthology... is an important paper because it shows that ML systems can not just learn but also *amplify* underlying biases.
This">https://www.aclweb.org/anthology... is an important paper because it shows that ML systems can not just learn but also *amplify* underlying biases.
"Bias and Fairness in Natural Language Processing" by @kaiwei_chang et al. https://www.aclweb.org/anthology/D19-2004/
A">https://www.aclweb.org/anthology... really good survey of more recent work from 2019.
A">https://www.aclweb.org/anthology... really good survey of more recent work from 2019.
"Principled Frameworks for Evaluating Ethics in NLP Systems" by Prabhumoye et al https://www.aclweb.org/anthology/W19-3637/
Another">https://www.aclweb.org/anthology... recent paper that I like for its clear overview of relevant framework from ethics.
Another">https://www.aclweb.org/anthology... recent paper that I like for its clear overview of relevant framework from ethics.
A final note:
- ML systems have the clear potential to harm a lot of people
- It& #39;s the responsibility of EVERYONE who works on them, researchers and practitioners alike, to mitigate that harm to the greatest extent possible
- ML systems have the clear potential to harm a lot of people
- It& #39;s the responsibility of EVERYONE who works on them, researchers and practitioners alike, to mitigate that harm to the greatest extent possible