This. Everyone walks away from Therac thinking "I would never do this", ignoring the million and one other things they are doing that add up to unethical behavior. https://twitter.com/cshabsin/status/1290861634903318528

Not every ethical lapse is as clear-cut as the Therac example. As we've seen with misinformation & hate speech, killing people with software doesn't happen only by medical devices.

Until ethics courses teach about lynchings in India provoked by WhatsApp, stochastic terrorism facilitated by Facebook, radicalization fostered by YouTube...

in particular, we do an exceptionally bad job of modeling what risk factors are present in a system, when those who are impacted by that system aren't represented to sound alarm bells.

and thus people think they've applied the correct level of risk mitigations. they're wrong