Current:Home > ScamsAI could help scale humanitarian responses. But it could also have big downsides-Angel Dreamer Wealth Society D1 Reviews & Insights
AI could help scale humanitarian responses. But it could also have big downsides
View Date:2024-12-23 10:52:25
NEW YORK (AP) — As the International Rescue Committee copes with dramatic increases in displaced people in recent years, the refugee aid organization has looked for efficiencies wherever it can — including using artificial intelligence.
Since 2015, the IRC has invested in Signpost — a portfolio of mobile apps and social media channels that answer questions in different languages for people in dangerous situations. The Signpost project, which includes many other organizations, has reached 18 million people so far, but IRC wants to significantly increase its reach by using AI tools.
Conflict, climate emergencies and economic hardship have driven up demand for humanitarian assistance, with more than 117 million people forcibly displaced in 2024, according to the United Nations refugee agency. As humanitarian organizations encounter more people in need, they are also facing enormous funding shortfalls. The turn to artificial intelligence technologies is in part driven by this massive gap between needs and resources.
To meet its goal of reaching half of displaced people within three years, the IRC is building a network of AI chatbots that can increase the capacity of their humanitarian officers and the local organizations that directly serve people through Signpost. For now, the project operates in El Salvador, Kenya, Greece and Italy and responds in 11 languages. It draws on a combination of large language models from some of the biggest technology companies, including OpenAI, Anthropic and Google.
The chatbot response system also uses customer service software from Zendesk and receives other support from Google and Cisco Systems.
Beyond developing these tools, the IRC wants to extend this infrastructure to other nonprofit humanitarian organizations at no cost. They hope to create shared technology resources that less technically focused organizations could use without having to negotiate directly with tech companies or manage the risks of deployment.
“We’re trying to really be clear about where the legitimate concerns are but lean into the optimism of the opportunities and not also allow the populations we serve to be left behind in solutions that have the potential to scale in a way that human to human or other technology can’t,” said Jeannie Annan, International Rescue Committee’s Chief Research and Innovation Officer.
The responses and information that Signpost chatbots deliver are vetted by local organizations to be up to date and sensitive to the precarious circumstances people could be in. An example query that IRC shared is of a woman from El Salvador traveling through Mexico to the United States with her son who is looking for shelter and for services for her child. The bot provides a list of providers in the area where she is.
More complex or sensitive queries are escalated for humans to respond.
The most important potential downside of these tools would be that they don’t work. For example, what if the situation on the ground changes and the chatbot doesn’t know? It could provide information that’s not just wrong, but dangerous.
A second issue is that these tools can amass a valuable honeypot of data about vulnerable people that hostile actors could target. What if a hacker succeeds in accessing data with personal information or if that data is accidentally shared with an oppressive government?
IRC said it’s agreed with the tech providers that none of their AI models will be trained on the data that the IRC, the local organizations or the people they are serving are generating. They’ve also worked to anonymize the data, including removing personal information and location.
As part of the Signpost.AI project, IRC is also testing tools like a digital automated tutor and maps that can integrate many different types of data to help prepare for and respond to crises.
Cathy Petrozzino, who works for the not-for-profit research and development company MITRE, said AI tools do have high potential, but also high risks. To use these tools responsibly, she said, organizations should ask themselves, does the technology work? Is it fair? Are data and privacy protected?
She also emphasized that organizations need to convene a range of people to help govern and design the initiative — not just technical experts, but people with deep knowledge of the context, legal experts, and representatives from the groups that will use the tools.
“There are many good models sitting in the AI graveyard,” she said, “because they weren’t worked out in conjunction and collaboration with the user community.”
For any system that has potentially life-changing impacts, Petrozzino said, groups should bring in outside experts to independently assess their methodologies. Designers of AI tools need to consider the other systems it will interact with, she said, and they need to plan to monitor the model over time.
Consulting with displaced people or others that humanitarian organizations serve may increase the time and effort needed to design these tools, but not having their input raises many safety and ethical problems, said Helen McElhinney, executive director of CDAC Network. It can also unlock local knowledge.
People receiving services from humanitarian organizations should be told if an AI model will analyze any information they hand over, she said, even if the intention is to help the organization respond better. That requires meaningful and informed consent, she said. They should also know if an AI model is making life-changing decisions about resource allocation and where accountability for those decisions lies, she said.
Degan Ali, CEO of Adeso, a nonprofit in Somalia and Kenya, has long been an advocate for changing the power dynamics in international development to give more money and control to local organizations. She asked how IRC and others pursuing these technologies would overcome access issues, pointing to the week-long power outages caused by Hurricane Helene in the U.S. Chatbots won’t help when there’s no device, internet or electricity, she said.
Ali also warned that few local organizations have the capacity to attend big humanitarian conferences where the ethics of AI are debated. Few have staff both senior enough and knowledgeable enough to really engage with these discussions, she said, though they understand the potential power and impact these technologies may have.
“We must be extraordinarily careful not to replicate power imbalances and biases through technology,” Ali said. “The most complex questions are always going to require local, contextual and lived experience to answer in a meaningful way.”
___
The Associated Press and OpenAI have a licensing and technology agreement that allows OpenAI access to part of AP’s text archives.
___
Associated Press coverage of philanthropy and nonprofits receives support through the AP’s collaboration with The Conversation US, with funding from Lilly Endowment Inc. The AP is solely responsible for this content. For all of AP’s philanthropy coverage, visit https://apnews.com/hub/philanthropy.
veryGood! (128)
Related
- Massachusetts lawmakers to consider a soccer stadium for the New England Revolution
- Powerball winning numbers for August 10 drawing: Jackpot now worth $212 million
- Post Malone Makes Rare Comments About His Fiancée and 2-Year-Old Daughter
- Get an Extra 70% Off J.Crew Sale Styles, Old Navy Deals Under $20, 60% Off Beyond Yoga & More Sales
- Diddy's ex-bodyguard sues rape accuser for defamation over claims of 2001 assault
- Americans’ refusal to keep paying higher prices may be dealing a final blow to US inflation spike
- Chiefs WR Marquise Brown ‘will miss some time’ after dislocating a clavicle in 26-13 loss at Jaguars
- USA vs. France basketball highlights: American women win 8th straight Olympic gold
- The Cowboys, claiming to be 'all in' prior to Dak Prescott's injury, are in a rare spot: Irrelevance
- Maine can now order employers to pay workers damages for missed wages
Ranking
- Rachael Ray Details Getting Bashed Over Decision to Not Have Kids
- Ferguson officer 'fighting for his life' after Michael Brown protest, police chief says
- Jordan Chiles bumped off podium as gymnastics federation reinstates initial score
- Summer tourists flock to boardwalks and piers while sticking to their budgets
- Worker trapped under rubble after construction accident in Kentucky
- Gypsy Rose Blanchard reveals sex of baby: 'The moment y’all have been waiting for'
- First Snow, then Heat Interrupt a Hike From Mexico to Canada, as Climate Complicates an Iconic Adventure
- Who performed at the Olympic closing ceremony? Snoop, Dr. Dre, Billie Eilish, Red Hot Chili Peppers
Recommendation
-
A growing and aging population is forcing Texas counties to seek state EMS funding
-
Elle King says dad Rob Schneider sent her to 'fat camp,' forgot birthday
-
Steph Curry, Kevin Durant, LeBron James star in USA basketball Olympic gold medal win
-
Emma Hayes, USWNT send a forceful message with Olympic gold: 'We're just at the beginning'
-
Stock market today: Asian stocks decline as China stimulus plan disappoints markets
-
Winners and losers of the 2024 Olympics: Big upsets, failures and joyful moments
-
Will Katie Ledecky Compete at the 2028 Los Angeles Olympics? She Says...
-
10 brightest US track and field stars from 2024 Paris Olympics