Weapons of Math Destruction: A Review

In the last 8 months or so I have been making a shift from technology enthusiast to a bit of  a tech skeptic.  Technology is certainly becoming more ubiquitous and this comes with benefits but it also comes with costs.  In healthcare and mental health, I have been pondering what pieces of technology will bring about change. Not only that but what kinds of design will people use and is it ethical?

I recently captured a twitter thread about the unintended consequences of technology. Also spending the last month or so reading “Weapons of Math Destruction” by Cathy O’Neil has challenged a lot of my assumptions about data collection.

As somebody who still has my research core from my undergraduate education, I assumed that all this acceleration of data can only yield positive results (especially understanding those in under-served area’s) but the above book has proven me wrong.   There is a lot of data collection that has potential to further divide us and often exclude other. The book goes into vast detail but here are a few examples…

  1.  Judges often use algorithms to determine sentencing of criminals. This determined by “risk of further offense”. This often leads them to people in poverty and minorities; creating a vicious cycle of incarcerating communities and those who associate with them.
  2. Police Departments are using algorithms to predict where crime “may happen” also create a similar feedback loop where they focus on certain neighborhoods. Leading to increased “stop and frisk practices” and increase in arrests in certain pockets.
  3. Insurance Companies (including Life, Health, and Car insurance) have always relied on math of some kind but are increasingly leaving this work up to computers. Life and car insurance companies are frequently relying on credit scores. Not only can these credit scores be inaccurate and prejudicial but some companies use their own opaque “e-score” to determine insurance rates. Leading to people being denied or being priced out without knowing why.

She calls these algorithms that create these feedback loops Weapons of Math Destruction or “WMD’s”.  Going into detail into many other examples she describes  3 main elements of WMD’s.  First is the Opacity or lack of transparency about what is being measured and how. Second is the scale of how many individuals it may impact and lastly what is the damage or potential consequences.

On January 23,2018 the #HTreads (Health Tech reads) twitter chat will gathered to answer some questions about the book. Here were some of the resources/thoughts I found helpful..

What are some early successes with using big data in healthcare?

 

Moving forward Data Scientists have to be critical of the ways we are using big data in healthcare. In a multidisciplinary manner, we have to ensure that we are being more intentional about asking these ethical questions.

My Top 5 Blog Posts of 2017 (and some highlights

It has been an interesting year on the blog with my usual mix of musings of things that caught my eye, conferences, and of course following conferences on twitter.  Without further or do here is the blogs you found most interesting in 2017…

  1. SocialWorkr

Socialworkr is a social media platform geared just for social workers. It got the most views on LinkedIn due to interest in the The National Association of Social Workers group.  Glad to see that it lead to a boost in membership and hope more social workers take a look as result of it being tops in 2017.

2.  The Facebook Manifesto and Why Social Work Should Come Along The Ride

I continue to have an ongoing interest in technology but this year I have been more attuned to the intersection of social work and technology. Facebook has had a roller coaster year in terms of it’s impact on social issues. But earlier this year founder Mark Zuckerburgh released “Building A Global Community”. There is a lot of synergy between this and social work values.

3. Why You Need A Social Worker On Your UX Design Team 

This blog post started the conversation that I hoped it would. As I have been following technology, design thinking and looking at the UX (user experience) for apps and electronic health records has become more prevalent.  When thinking critically, one observes a lot of “tech fails” in design. I started to think about how maybe social work can come to the rescue.

4. Keeping Up With #SWDE2017 (Social Work Distance Education Conference)

As I continue to get more involved in teaching in training, twitter has continued to allow me to follow the Social Work Distance Education conference held every Spring here in the United States. Myself and others found the live tweeting both helpful and insightful.

5. #NatCon17: More Hope And Promise 

This year I had the privilege of being a social media ambassador for The National Council on Behavioral Health annual conference.  It is the largest behavioral health conference in the United States and it was great to be there. In a year of political turmoil it was great to focus on solutions and some great examples innovation in behavior health.

 

Some other highlights…

My personal highlight of the year was attending and presenting at the Network for Social Management conference in New York City.  The theme was the “Business of Social Work” and I captured my summary of the conference here. Like attending NatCon this gave me a sense of hope and empowerment.

I enjoyed writing my first guest post on Healthcare Scene about bridging the gap between the Health IT community and social work.

I am already looking forward to 2018 where I am currently working on CEU course on ethics and social media.  Also in March I will attend The Health Information and Management Systems conference as a social media ambassador.

Thanks all for stopping by and looking forward to writing more in 2018 🙂