\n
![](\"https:\/\/fortune.com\/img-assets\/wp-content\/uploads\/2024\/04\/53654887972_252b71dd43_o-e1713206517836.jpg?w=2048\")
<\/p>\n [ad_1]
\n<\/p>\n
The lighting-fast advancements in AI have necessitated some guardrails and a developing philosophy on how to ethically incorporate the technology into the workplace. AI should play the role of co-pilot alongside humans\u2014not exist on autopilot, Paula Goldman, Salesforce\u2019s chief ethical and humane use officer, said during Fortune<\/em>\u2019s Brainstorm AI conference<\/a> in London on Monday.<\/p>\n \u201cWe need next-level controls. We need people to be able to understand what\u2019s going on across the AI system,\u201d she told Fortune<\/em>\u2019s Executive News Editor Nick Lichtenberg. \u201cAnd most importantly, we need to be designing AI products that take into account what AI is good at and bad at\u2014but also what people are good at and bad at in their own decision-making judgments.\u201d<\/p>\n Goldman\u2019s main worry among the growing body of users\u2019 concerns is AI\u2019s ability to generate integrous content, including those free from racial or gender biases and excessive user-generated content<\/a> such as deepfakes. She warns unethical applications of AI could curtail the technology\u2019s funding and development.\u00a0<\/p>\n \u201cIt\u2019s possible that the next AI winter is caused by trust issues or people-adoption issues with AI,\u201d Goldman said.<\/p>\n The future of AI productivity gains in the workplace will be driven by training and people\u2019s willingness to adopt new technologies, she said. To foster trust in AI products\u2014particularly among employees using the applications\u2014Goldman suggests the implementation of \u201cmindful friction,\u201d which is essentially a series of checks and balances to ensure AI tools in the workplace do more good than harm.\u00a0<\/p>\n Salesforce has started keeping in check potential biases in its own use of AI. Indeed, the software giant has developed a marketing segmentation product that generates appropriate demographics for email campaigns. While the AI program generates a list of potential demographics for a campaign, it\u2019s the human\u2019s job to select the appropriate demographics so as not to exclude relevant recipients. Similarly, the software company has a warning toggle pop up on generative models on its Einstein platform that incorporate zip or postal codes, which are often correlated with certain races or socio-economic statuses.<\/p>\n \u201cIncreasingly, we\u2019re heading toward systems that can detect anomalies like that and encourage and prompt the humans to take a second look at it,\u201d Goldman said.<\/p>\n In the past, biases and copyright infringements have rocked trust in AI. An MIT Media Lab study<\/a> found that AI software programmed to identify the race and gender of different people had less than a 1% error rate in identifying light-skinned men, but a 35% error rate in identifying dark-skinned women, including well-known figures such as Oprah Winfrey and Michelle Obama. Jobs that use facial recognition technology for high-stakes tasks, such as equipping drones or body cameras<\/a> with facial recognition software to carry out lethal attacks are compromised by inaccuracies in the AI technology, Joy Buolamwini, the study\u2019s author, said. Similarly, algorithmic biases in health care databases can lead to AI software suggesting inappropriate treatment plans for certain patients, the Yale School of Medicine found<\/a>.<\/p>\n Even for those in industries without lives on the line, AI applications have raised ethical concerns, including OpenAI scraping over hours<\/a> of user-generated YouTube<\/a> content, potentially violating copyrights of content creators without their consent. Alongside its spread of misinformation and inability to complete basic tasks<\/a>, AI has a long way to go before it can fulfill its potential as a helpful tool to humans, Goldman said.<\/p>\n But designing smarter AI features and human-led failsafes to bolster trust is what Goldman finds most exciting about the future of the industry.\u00a0<\/p>\n \u201cHow do you design products that you know what to trust and where you should take a second look and apply human judgment?\u201d<\/p>\n<\/div>\n\nWhat Salesforce has done to implement \u2018mindful friction\u2019<\/strong><\/h2>\n