{"id":5976,"date":"2019-01-22T22:57:42","date_gmt":"2019-01-23T02:57:42","guid":{"rendered":"http:\/\/ncjolt.org\/?p=5976"},"modified":"2020-06-04T20:52:28","modified_gmt":"2020-06-04T20:52:28","slug":"high-tech-hiring-tackling-a-new-breed-of-discrimination","status":"publish","type":"post","link":"https:\/\/journals.law.unc.edu\/ncjolt\/blogs\/high-tech-hiring-tackling-a-new-breed-of-discrimination\/","title":{"rendered":"High Tech Hiring: Tackling a New Breed of Discrimination"},"content":{"rendered":"\n<p>Artificial Intelligence was supposed to revolutionize\nthe recruitment process and end bias in hiring. It has revolutionized the\nprocess, but it <a href=\"https:\/\/www.motherjones.com\/politics\/2019\/01\/artificial-intelligence-was-supposed-to-reduce-hiring-discrimination-its-already-backfiring\/\">has\nnot ended bias in hiring decisions<\/a>. The rise of the internet and the\nincreasing ease for a job applicant to find an opening and send in a job\napplication has overwhelmed many Human Resources departments. <\/p>\n\n\n<p>This is where algorithmic hiring tools and Artificial\nIntelligence stepped in. <a href=\"https:\/\/www.theguardian.com\/technology\/2018\/oct\/10\/amazon-hiring-ai-gender-bias-recruiting-engine\">55%\nof US human resources managers said artificial intelligence, or AI, would be a\nregular part of their work within the next five years, according to a 2017\nsurvey by talent software firm CareerBuilder.<\/a> The tools work by\ncrunching employer-provided \u201ctraining\u201d data to assess how applicants match up\nwith a given opening. In theory, they can help employers sidestep their human\nhiring biases and analyze job candidates\u2019 skills without considering their sex,\nrace or other protected traits. In practice, eliminating bias is not so easy. <\/p>\n\n\n<p><a href=\"https:\/\/www.theguardian.com\/technology\/2018\/oct\/10\/amazon-hiring-ai-gender-bias-recruiting-engine\">Amazon,\nfor example discovered that its machine recruiters were favoring male resumes\nover female resumes.<\/a> The technology favored candidates\nwho described themselves using verbs more commonly found on male engineers\u2019\nresumes, such as \u201cexecuted\u201d and \u201ccaptured.\u201d Additionally, It penalized r\u00e9sum\u00e9s\nthat included the word \u201cwomen\u2019s\u201d, as in \u201cwomen\u2019s chess club captain\u201d and it\ndowngraded graduates of two all-women\u2019s colleges, according to people familiar\nwith the matter. The system, in effect, taught itself to prefer male candidates\nover female candidates. <\/p>\n\n\n<p>The issue with these systems is the underlying data\nthat the hiring tools rely on. If an employer tends to rate men\u2019s performance\nmore highly than it does women\u2019s\u2014 the tool\u2019s result will be the same. <a href=\"https:\/\/advance.lexis.com\/document\/?pdmfid=1000516&amp;crid=f62df838-27ad-4aef-98c7-74c43a672908&amp;pddocfullpath=%2Fshared%2Fdocument%2Flegalnews%2Furn%3AcontentItem%3A5V78-32K1-JJSF-2288-00000-00&amp;pddocid=urn%3AcontentItem%3A5V78-32K1-JJSF-2288-00000-00&amp;pdcontentcomponentid=122080&amp;pdteaserkey=sr0&amp;pditab=allpods&amp;ecomp=byvLk&amp;earg=sr0&amp;prid=197d0670-0bde-4660-953a-daf0c3e50a22&amp;cbc=0\">In\none example cited in a report by Upturn, one of these AI hiring tools found\nworkers who were named \u201cJared\u201d or who had played high school lacrosse tended to\nbe more successful.<\/a><\/p>\n\n\n<p><a href=\"https:\/\/advance.lexis.com\/document\/?pdmfid=1000516&amp;crid=f62df838-27ad-4aef-98c7-74c43a672908&amp;pddocfullpath=%2Fshared%2Fdocument%2Flegalnews%2Furn%3AcontentItem%3A5V78-32K1-JJSF-2288-00000-00&amp;pddocid=urn%3AcontentItem%3A5V78-32K1-JJSF-2288-00000-00&amp;pdcontentcomponentid=122080&amp;pdteaserkey=sr0&amp;pditab=allpods&amp;ecomp=byvLk&amp;earg=sr0&amp;prid=197d0670-0bde-4660-953a-daf0c3e50a22&amp;cbc=0\">If\nthese high-tech tools lead employers to select members of one protected class\nlike race or sex over those of another, they can cause what\u2019s known as\n\u201cdisparate impact\u201d discrimination.<\/a> This term refers\nto employment bias that comes about when an employer applies a seemingly\nneutral policy or practice, but it has a discriminatory effect. <\/p>\n\n\n<blockquote class=\"wp-block-quote\"><p>The point of this predictive technology is to find these correlations of workplace success, but just because a correlation exists does not necessarily mean they should be used to make hiring decisions.<\/p><\/blockquote>\n\n\n<p><a href=\"https:\/\/advance.lexis.com\/document\/?pdmfid=1000516&amp;crid=f62df838-27ad-4aef-98c7-74c43a672908&amp;pddocfullpath=%2Fshared%2Fdocument%2Flegalnews%2Furn%3AcontentItem%3A5V78-32K1-JJSF-2288-00000-00&amp;pddocid=urn%3AcontentItem%3A5V78-32K1-JJSF-2288-00000-00&amp;pdcontentcomponentid=122080&amp;pdteaserkey=sr0&amp;pditab=allpods&amp;ecomp=byvLk&amp;earg=sr0&amp;prid=197d0670-0bde-4660-953a-daf0c3e50a22&amp;cbc=0\">Title\nVII of the Civil Rights Act of 1964, the federal law that bans workplace\ndiscrimination, lets workers challenge employer practices that cause disparate\nimpacts on members of protected classes.<\/a> There\nis a strong case that these tools violate the Civil Rights Act, but the hard\npart is knowing there is any discrimination occurring in the first place. <\/p>\n\n\n<p>The Equal Employment Opportunity Commission is monitoring the space. In late 2016, the agency convened a panel of algorithmic hiring experts to discuss the discrimination risks this technology poses and created a working group to probe this area. Despite the progress, they still rely on workers to help flag discriminatory hiring and workers do not know they are being discriminated against. In addition, <a href=\"https:\/\/www.motherjones.com\/politics\/2019\/01\/artificial-intelligence-was-supposed-to-reduce-hiring-discrimination-its-already-backfiring\/\">EEOC has been left understaffed, and lacks the capacity to do large scale investigations.<\/a> <\/p>\n\n\n<p><a href=\"https:\/\/www.motherjones.com\/politics\/2019\/01\/artificial-intelligence-was-supposed-to-reduce-hiring-discrimination-its-already-backfiring\/\">An additional challenge is the way that these laws have been interpreted by the courts does not match up well with the methods these tools are using to discriminate against job applicants.<\/a> Some of the regulatory guidelines state that tools to assess job candidates are valid if they can show that there is a correlation between the thing that they\u2019re measuring and some measure of workplace success. The point of this predictive technology is to find these correlations of workplace success, but just because a correlation exists does not necessarily mean they should be used to make hiring decisions.<strong> <\/strong><\/p>\n\n\n<p>Under the law, these tools currently might be legitimate.\nand employers might be convinced to adopt them, but the laws were written 30-40\nyears ago and are not equipped to deal with the new technology employers are\nusing to weed out job applicants. <\/p>\n\n\n<p>Despite these barriers, there have been steps forward in litigating these claims. Several worker-side firms are looking closely for ways to bring suits in this space. Management side attorneys are starting to see more demand letters from Plaintiff attorneys. <a href=\"https:\/\/www.motherjones.com\/politics\/2019\/01\/artificial-intelligence-was-supposed-to-reduce-hiring-discrimination-its-already-backfiring\/\">The American Civil Liberties Union brought a complaint before the EEOC about jobs being advertised on Facebook in a discriminatory manner.<\/a>  Anti-discrimination law is focused on outcomes and putting more focus on the disparate outcomes will help bring this issue to light. <a href=\"https:\/\/www.motherjones.com\/politics\/2019\/01\/artificial-intelligence-was-supposed-to-reduce-hiring-discrimination-its-already-backfiring\/\">Furthermore, putting the regulatory focus on the technologies themselves instead of the employers using the technology is critical.<\/a> The government should work to regulate the underlying data these technologies are using, and employers should strive to make sure their AI tools are not creating any unintended bias in their hiring.  <\/p>\n\n\n<p>Kollin Bender, 21 January 2019<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Artificial Intelligence was supposed to revolutionize the recruitment process and end bias in hiring. It has revolutionized the process, but it has not ended bias in hiring decisions. The rise of the internet and the increasing ease for a job applicant to find an opening and send in a job application has overwhelmed many Human <a href=\"https:\/\/journals.law.unc.edu\/ncjolt\/blogs\/high-tech-hiring-tackling-a-new-breed-of-discrimination\/\" class=\"more-link\">&#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":5977,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[51],"tags":[],"_links":{"self":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts\/5976"}],"collection":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/comments?post=5976"}],"version-history":[{"count":1,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts\/5976\/revisions"}],"predecessor-version":[{"id":6874,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts\/5976\/revisions\/6874"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/media\/5977"}],"wp:attachment":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/media?parent=5976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/categories?post=5976"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/tags?post=5976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}