With AI becoming more embedded in daily life, governments are stepping in to protect citizens from biased or opaque AI systems. . .This highlights AI's potential ripple effects in human society, extending beyond an individual's experience of a single unfair decision.
NOVEMBER 14, 2024
Unfair decisions by AI could make us indifferent to bad behavior by humans
Artificial intelligence (AI) makes important decisions that affect our everyday lives. These decisions are implemented by firms and institutions in the name of efficiency. They can help determine who gets into college, who lands a job, who receives medical treatment and who qualifies for government assistance.
As AI takes on these roles, there is a growing risk of unfair decisions—or the perception of them by those people affected.
- For example, in college admissions or hiring, these automated decisions can unintentionally favor certain groups of people or those with certain backgrounds, while equally qualified but underrepresented applicants get overlooked.
- Or, when used by governments in benefit systems, AI may allocate resources in ways that worsen social inequality, leaving some people with less than they deserve and a sense of unfair treatment.
Together with an international team of researchers, we examined how unfair resource distribution—whether handled by AI or a human—influences people's willingness to act against unfairness. The results have been published in the journal Cognition.
With AI becoming more embedded in daily life, governments are stepping in to protect citizens from biased or opaque AI systems. Examples of these efforts include the White House's AI Bill of Rights, and the European parliament's AI Act. These reflect a shared concern: People may feel wronged by AI's decisions.
So how does experiencing unfairness from an AI system affect how people treat one another afterwards?
AI-induced indifference
Our paper in Cognition looked at people's willingness to act against unfairness after experiencing unfair treatment by an AI. The behavior we examined applied to subsequent, unrelated interactions by these individuals. A willingness to act in such situations, often called "prosocial punishment," is seen as crucial for upholding social norms.
For example, whistleblowers may report unethical practices despite the risks, or consumers may boycott companies that they believe are acting in harmful ways. People who engage in these acts of prosocial punishment often do so to address injustices that affect others, which helps reinforce community standards.
We asked this question: Could experiencing unfairness from AI, instead of a person, affect people's willingness to stand up to human wrongdoers later on? For instance, if an AI unfairly assigns a shift or denies a benefit, does it make people less likely to report unethical behavior by a co-worker afterwards?
Across a series of experiments, we found that people treated unfairly by an AI were less likely to punish human wrongdoers afterwards than participants who had been treated unfairly by a human. They showed a kind of desensitization to others' bad behavior. We called this effect AI-induced indifference, to capture the idea that unfair treatment by AI can weaken people's sense of accountability to others. This makes them less likely to address injustices in their community.
- These results suggest that people's responses to unfairness depend not only on whether they were treated fairly but also on who treated them unfairly—an AI or a human.
In short, unfair treatment by an AI system can affect how people respond to each other, making them less attentive to each other's unfair actions. This highlights AI's potential ripple effects in human society, extending beyond an individual's experience of a single unfair decision.
When AI systems act unfairly, the consequences extend to future interactions, influencing how people treat each other, even in situations unrelated to AI. We would suggest that developers of AI systems should focus on minimizing biases in AI training data to prevent these important spillover effects.
Policymakers should also establish standards for transparency, requiring companies to disclose where AI might make unfair decisions. This would help users understand the limitations of AI systems, and how to challenge unfair outcomes. Increased awareness of these effects could also encourage people to stay alert to unfairness, especially after interacting with AI.
Feelings of outrage and blame for unfair treatment are essential for spotting injustice and holding wrongdoers accountable. By addressing AI's unintended social effects, leaders can ensure AI supports rather than undermines the ethical and social standards needed for a society built on justice.
More information: Raina Zexuan Zhang et al, AI-induced indifference: Unfair AI reduces prosociality, Cognition (2024). DOI: 10.1016/j.cognition.2024.105937
Journal information: Cognition
Provided by The Conversation
This article is republished from The Conversation under a Creative Commons license. Read the original article.
MORE SCIENCE NEWS
Unfair decisions by AI could make us indifferent to bad behavior by humans
Artificial intelligence (AI) makes important decisions that affect our everyday lives. These decisions are implemented by firms and institutions in the name of efficiency. They can help determine who gets into college, who ...
SOCIAL SCIENCES
1 HOUR AGO
0
0
Researchers reveal why a key tuberculosis drug works against resistant strains
Rutgers Health research has uncovered why a relatively new antibiotic for tuberculosis (TB) works against multidrug-resistant strains, potentially inspiring improved treatments and drug development strategies.
CELL & MICROBIOLOGY
1 HOUR AGO
0
0
Steroid and surfactant mix fails to impact bronchopulmonary dysplasia in preterm infants
Research led by the Royal Women's Hospital, Australia, has found that early intratracheal administration of budesonide mixed with surfactant may have little to no effect on improving survival free of bronchopulmonary dysplasia ...
Optical biosensor rapidly detects monkeypox virus
A new variant of human mpox has claimed the lives of approximately 5% of people with reported infections in the Democratic Republic of the Congo since 2023, many of them children. Since then, it has spread to several other ...
DISEASES, CONDITIONS, SYNDROMES
29 MINUTES AGO
0
0
Cholesterol may not be the only lipid involved in trans fat-driven cardiovascular disease
Excess cholesterol is known to form artery-clogging plaques that can lead to stroke, arterial disease, heart attack, and more, making it the focus of many heart health campaigns. Fortunately, this attention to cholesterol ...
CARDIOLOGY
59 MINUTES AGO
0
0
New drug targets for Alzheimer's identified from cerebrospinal fluid
A multitude of genes have been linked to the development of Alzheimer's disease. Specifically how those genes might influence the progression of neurodegeneration remains something of a black box though, in part because of ...
GENETICS
5 MINUTES AGO
0
0
Neural circuits reveal new insights into how we navigate space and store memories
Researchers led by the University of California, Irvine are the first to reveal how two neural circuits located in the brain's retrosplenial cortex are directly linked to spatial navigation and memory storage. This discovery ...
NEUROSCIENCE
39 MINUTES AGO
0
0
New lens system for endoscopes could allow physicians to see inside the body like never before
The human body contains a vast, complex, and interconnected web of organic tunnels and passageways that weave their way through the cardiovascular, respiratory, and digestive systems. For physicians, reaching into this maze ...
RADIOLOGY & IMAGING
1 HOUR AGO
0
0
The Future is Interdisciplinary
Find out how ACS can accelerate your research to keep up with the discoveries that are pushing us into science’s next frontier
Medical Xpress
Tech Xplore
Novel electro-biodiesel offers a more efficient, cleaner alternative to existing options
Vehicles fueled by diesel lead to substantial carbon emissions that are challenging to decarbonize. In 2022, diesel fuel use made up about one-fourth of total U.S. transportation carbon dioxide emissions and about one-tenth ...
ENERGY & GREEN TECH
1 HOUR AGO
0
0
Slow editing of protein blueprints leads to cell death, spliceosome study discovers
An international research team has uncovered a new mechanism crucial to the production of cellular proteins. When this mechanism is disrupted, the blueprints used by the cell to produce proteins are inaccurately edited through ...
CELL & MICROBIOLOGY
1 HOUR AGO
0
0
What carbon dioxide 'jumps' from Antarctic ice say about climate change
The atmosphere is constantly changing. Its composition has varied regularly over the course of the planet's climatic epochs, particularly with regard to its levels of carbon dioxide (CO2) concentration, a crucial factor in ...
EARTH SCIENCES
2 HOURS AGO
0
15
How plant roots change their growth pattern during 'puberty' has implications for climate-resilient agriculture
Understanding how roots grow can help us develop plants that—for example—are more resistant to drought. Research by Prof. Bert De Rybel's team (VIB-UGent), in collaboration with the VIB Screening Core and Ghent University, ...
MOLECULAR & COMPUTATIONAL BIOLOGY
2 HOURS AGO
0
0
Scientists discover laser light can cast a shadow
Can light itself cast a shadow? It may sound like a philosophical riddle, but researchers have found that under certain conditions, a laser beam can act like an opaque object and cast a shadow. The discovery challenges the ...
OPTICS & PHOTONICS
8 HOURS AGO
0
103
Vocalization study finds highly individualized preferences for singing and speaking voices
The way people talk determines, among other things, whether we listen to what the other person has to say and, for example, whether we like them. Researchers at the Max Planck Institute for Empirical Aesthetics (MPIEA) in ...
SOCIAL SCIENCES
2 HOURS AGO
0
22
Astronomers inspect the nature of an X-ray binary with a red supergiant
An international team of astronomers has conducted a multiwavelength study of an X-ray binary designated 1eRASS J085039.9-421151. Results of the study, published Nov. 4 on the preprint server arXiv, yield new information ...
Theoretical model explains the anomalous properties of water in extreme conditions
Water, a molecule essential for life, has unusual properties—known as anomalies—that define its behavior. However, there are still many enigmas about the molecular mechanisms that would explain the anomalies that make ...
SOFT MATTER
2 HOURS AGO
0
25
Maternal stress linked to increased early onset epilepsy in children
Tottori University researchers in Japan have linked maternal psychological distress during pregnancy to an increased risk of epilepsy in children.
Physicists identify key mechanism behind chiral charge density wave in TiSe₂
Chirality is a property of some molecules, subatomic particles, living organisms and other physical or biological systems. This property entails a lack of mirror symmetry in these systems' underlying structures.
Community protected by law on coast of Southeast Brazil is threatened by litter tourists leave on beach
A study conducted by researchers at the Federal University of São Paulo (UNIFESP) found high levels of contamination on Perequê Beach in Guarujá, a city on the coast of São Paulo state, Brazil, with plastic litter and ...
Researchers use nanotechnology to boost benefits of anthocyanin
An article published in the journal Food Research International describes a study in which nanoencapsulated anthocyanins passed through the digestive system without being degraded, were absorbed efficiently, and reached more ...
A strategy of ligand-protected direct hydrogen reduction to prepare bimetallic cluster catalysts
Researchers have developed a ligand-protected direct hydrogen reduction strategy to prepare zeolite-confined Pt-Pd bimetallic cluster catalysts. These catalysts efficiently facilitate hydrogen production from ammonia borane ...
What determines support for EU-climate policy? Study reveals acceptance depends on inclusion of social policy measures
Climate change is one of the greatest challenges of our time, and the European Union has set itself ambitious targets to become climate-neutral by 2050. A new policy paper from the Cluster of Excellence "The Politics of Inequality" ...
Researcher suggests beloved Disney classics convey an idealized image of fatherhood
For decades, Disney animations have shaped perceptions of family relationships and gender roles. Although much focus has traditionally been on princesses and female characters, a new study shifts attention to fatherhood and ...
Researchers shed light on the experiences of caregivers in Nunavut's family service system
Researchers at the Umingmak Centre, a child advocacy center in Nunavut, and the University of Toronto's Ontario Institute for Studies in Education (OISE) have released a study that identifies systemic challenges in Nunavut's ...
Discovery of 2,586 orphan genes in Rosa chinensis reveals stress adaptation and flower development
Orphan genes, found only in specific lineages, are key drivers of new functions and phenotypic traits. This discovery lays a foundation for understanding how roses thrive under environmental challenges.
Nationalism is surging—changing the way companies do business overseas
The resurgence of nationalism across the globe is not just a political issue. It's emerging as a powerful force that multinational companies cannot afford to ignore.
Climate change: Women's role in the economy is key to a just transition
The realities of climate change are hitting home for many people living in the Global South. Food security, water access and health have been jeopardized by increased temperatures, extreme weather events and sea level rise.
44,000 deaths and $10 billion: Study quantifies annual cost of child marriage in Nigeria
A study authored by Xiangming Fang, a research associate professor in the Georgia State University School of Public Health, provides the first estimates of the significant economic burden that child marriage imposes on the ...
Markets for forest products respond to technology, says report
Technology is changing every facet of the forest products market. That may mean fewer jobs in the future as the industry shifts to labor-saving technology, with the steepest declines in the pulp and paper sector, according ...
Decline in West African coastal fish stocks threatens food security and livelihoods
Small-scale fisheries play a vital role in providing food and livelihoods for millions of people around the world, particularly in low-income countries in Africa. However, there is limited statistical data on the composition, ...
Targeted glucosinolate conversion: How kohlrabi tissues produce health-promoting compounds
A research team at the Leibniz Institute for Vegetable and Ornamental Crops (IGZ) has analyzed how glucosinolates, health-promoting plant compounds, are broken down within various tissues of the kohlrabi plant.
Study of US law enforcement co-responder programs identifies wide variations
In response to demands for police reform, agencies have begun to pursue alternative responses to calls involving mental health crises. Across the United States, jurisdictions are adopting co-responder teams that bring qualified ...
Q&A: Holobiont biology, a new concept for exploring how microbiome shapes evolution of visible life
Microorganisms—bacteria, viruses and other tiny life forms—may drive biological variation in visible life as much, if not more, than genetic mutations, creating new lineages and even new species of animals and plants, ...
EVOLUTION
3 HOURS AGO
0
16
Carbon removal at extreme temperatures: Porous material can capture 'hot' CO₂ from industrial exhaust
Industrial plants, such as those that make cement or steel, emit copious amounts of carbon dioxide, a potent greenhouse gas, but the exhaust is too hot for state-of-the-art carbon removal technology. Lots of energy and water ...
ENERGY & GREEN TECH
3 HOURS AGO
0
8
Discovery enables effective use of gene therapy for muscular dystrophies and other large-gene diseases
Gene therapy can effectively treat various diseases, but for some debilitating conditions like muscular dystrophies there is a big problem: size. The genes that are dysfunctional in muscular dystrophies are often extremely ...
GENETICS
3 HOURS AGO
0
20
A 41-million-digit prime number is the biggest ever found—but mathematicians' search for perfection will continue
Imagine a number made up of a vast string of ones: 1111111…111. Specifically, 136,279,841 ones in a row. If we stacked up that many sheets of paper, the resulting tower would stretch into the stratosphere.
MATHEMATICS
3 HOURS AGO
0
44
Distinct neural circuits mediate anti-anxiety and hallucination-like effects of psychedelics, research reveals
New research suggests that it could be possible to separate treatment from hallucinations when developing new drugs based on psychedelics. The anti-anxiety and hallucination-inducing qualities of psychedelic drugs work through ...
PSYCHOLOGY & PSYCHIATRY
3 HOURS AGO
0
0
Altering two genes to produce sweeter tomatoes without sacrificing size, weight or yield
A team of horticulturists, bio-breeders and agriculture specialists affiliated with a host of institutions across China has produced sweeter tomatoes without sacrificing size, weight or yield by altering two of their genes. ...
Survey provides a snapshot of scientific thought on animal emotions and consciousness
The journal Royal Society Open Science published a survey of 100 researchers of animal behavior, providing a unique view of current scientific thought on animal emotions and consciousness.
PLANTS & ANIMALS
3 HOURS AGO
0
2
AI can 'hear' when a lithium battery is about to catch fire
Researchers at the National Institute of Standards and Technology (NIST) have developed a way to use sound to detect when lithium-ion batteries are about to catch fire. The NIST team included Wai Cheong "Andy" Tam and Anthony ...
ENERGY & GREEN TECH
3 HOURS AGO
0
0
Picky proteins: Understanding yeast adaptor protein selectivity
The cellular membrane controls the passage of substances in and out of the cell. Some larger cargo, such as membrane proteins, nutrients, and pathogens, enter the cell via a process known as clathrin-mediated endocytosis.
CELL & MICROBIOLOGY
3 HOURS AGO
0
13
Scientists engineer stable protein complexes for targeted cancer therapies
Researchers from Auburn University, partnering with the University of Basel in Switzerland, have discovered a new way to make a cancer-targeting protein complex more stable, opening doors to better cancer treatments. Led ...
BIO & MEDICINE
3 HOURS AGO
0
0
Managing diverse and diverging demands on forests in Germany
Forests provide biodiversity, ecosystem functions, income and much more. How can these diverse and seemingly diverging demands be met? An international research team led by the University of Göttingen has addressed this ...
There's a class gap in access to careers in the arts—innovative skills education could help, say researchers
The creative industries are of vital importance to the UK economy, accounting for £115.9 billion in 2019. It's estimated that film and high-end television production alone—one of the UK's fastest growing industries—will ...
Extended EMIT mission will explore diverse Earth science questions
Observing our planet from the International Space Station since July 2022, NASA's EMIT (Earth Surface Mineral Dust Source Investigation) mission is beginning its next act.
How the far right is evolving and growing in Canada
In early 2022, thousands of Canadians descended on Ottawa as part of the so-called "Freedom Convoy" in protest of the government's pandemic-related restrictions. Many were opposed to the government's power to impose lockdowns, ...
New species of skink in discovered central Australian desert
A new species of rock skink has been discovered in central Australia by Monash University researchers. Characterized by its orange, pointed snout, the Central Ranges rock skink, or Liopholis aputja, inhabits the hills of ...
Viewpoint: Auction houses in the UK still sell human remains, and it's time they stopped
In early October, The Swan auction house in Tetsworth, Oxfordshire, listed several lots of human remains for sale, including skulls from west Africa and shrunken heads from South America.
Northern lights: How the aurora borealis captivated 18th-century minds
Since May this year, the aurora borealis (northern lights), has at times been visible further south than usual over Britain, sparking amazement and fascination. Social media has been alive with images of the skies glowing ...
India's capital shuts all primary schools due to smog
India's capital New Delhi ordered all primary schools to cease in-person classes until further notice on Thursday night due to worsening smog in the sprawling megacity.
Study finds increase in media coverage of crises, but not in the number of crises
The world appears to be plagued by crises—at least according to the media.
Winter smog adds to pollution woes in India and Pakistan
With cities in India and Pakistan ranking among the world's most polluted, new technologies must be adopted to tackle dangerous levels of winter smog, environmentalists urge.
A new mission to Pluto could answer the questions raised by New Horizons
Pluto may have been downgraded from full-planet status, but that doesn't mean it doesn't hold a special place in scientist's hearts. There are practical and sentimental reasons for that—Pluto has tantalizing mysteries to ...
New study examines how extraterrestrial civilizations could become 'stellivores'
One of the most challenging aspects of astrobiology and the Search for Extraterrestrial Intelligence (SETI) is anticipating what life and extraterrestrial civilizations will look like. Invariably, we have only one example ...
To move or not to move: Is it cheaper to find a new place or stay when your rent increases by 10%?
Your landlord has just raised your rent by 10% and your mind starts running the numbers—should you cop it sweet or look to move?
Can self-employment delay retirement? Only if you are healthy and wealthy
Self-employment can provide an alternative career transition to retirement, but only for those in good health and in high-paying careers, research from Trinity Business School reveals.
No comments:
Post a Comment