Study: 29% of chatbot answers on voting are wrong; check county sites
A new ISD report finds nearly a third of chatbot replies about voting are inaccurate or outdated. Fresno County and California direct voters to official sites.
Study: 29% of chatbot answers on voting are wrong; check county sites
Key Takeaways
- An ISD study found 29% of chatbot answers to voting questions were inaccurate, incomplete or outdated.
- Accuracy dropped an average of 16 points when questions were asked in Spanish.
- GPT-5.5 scored 89% on accuracy and completeness; Gemini 84%; others ranged from 66% to 61%.
- Fresno County and the California Secretary of State direct voters to official election websites.
Twenty-nine percent. That’s the share of AI chatbot replies that got basic voting info wrong or out of date in a new report from the Institute for Strategic Dialogue. The finding lands as Fresno County’s elections office posts timelines for the November 3, 2026 general election and reminds residents that official county and state sites carry the rules that actually apply here.
Do not ask a chatbot where to vote.
What the researchers tested
ISD researchers asked 15 common questions about voter registration, vote-by-mail and key dates across six consumer chatbots, then checked the answers against state rules. They also tried five tougher prompts per state that echoed past controversies. The team tailored questions to 10 states with changing procedures or legal fights, then measured accuracy, completeness, sourcing and whether the models pushed back on false claims. The dataset covered 2,400 prompts and responses, a sizable sample for this kind of bench test.
How the models scored
Performance was mixed. ISD tallied 29% of answers as incomplete, inaccurate or outdated, including mistakes on Election Day dates and old ID or deadline rules. OpenAI’s GPT-5.5 answered 89% of prompts with specific, complete and correct information. Google’s Gemini 3.5 Flash came in at 84%. xAI’s Grok 4.3 scored 66%, Anthropic’s Sonnet 4.6 64%, DeepSeek V4 Pro 63%, and Meta’s Muse Spark 61%. Every model returned some outdated details. The report also flagged a language gap, with average accuracy dropping 16 percentage points when the same questions were asked in Spanish. Simple fix, use the official sites.
What this means for Valley voters
The practical takeaway for Central Valley readers is straightforward. Use the county elections office or the California Secretary of State for anything that affects your ballot. Fresno County’s Registrar of Voters lists registration tools, vote center and drop box lookups, and election calendars for local contests. Kern County’s elections site carries the same staples for Bakersfield and unincorporated communities. The state’s portal explains who is eligible, how to register, and how to track a ballot. Those pages are what clerks update when rules change, not an AI model that might cite last cycle’s deadlines.
Researchers noted most chatbots cited authoritative sources and handled debunking fairly well in English, but they still missed exceptions and conditional rules that often trip people up. That is where county specifics matter in places like Reedley or Delano, where precinct lines and vote center lists differ. If you’re unsure, call the county or check its site, then check it again close to Election Day.
A scuffed "Please take a number" dispenser sits by the public counter at the Fresno elections office.
Central Valley AI is produced by the CVAI Newsdesk team and developed by Kaweah Tech, a regional firm that builds, deploys, and integrates AI solutions for businesses across California's Central Valley.