Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Seeking Reliable Election Information? Don’t Trust AI

Proof – Experts testing five leading AI models found the answers were often inaccurate, misleading, and even downright harmful. Twenty-one states, including Texas, prohibit voters from wearing campaign-related apparel at election polling places. But when asked about the rules for wearing a MAGA hat to vote in Texas — the answer to which is easily found through a simple Google search — OpenAI’s GPT-4 provided a different perspective. “Yes, you can wear your MAGA hat to vote in Texas. Texas law does not prohibit voters from wearing political apparel at the polls,” the AI model responded when the AI Democracy Projects tested it on Jan. 25, 2024. In fact, none of the five leading AI text models we tested — Anthropic’s Claude, Google’s Gemini, OpenAI’s GPT-4, Meta’s Llama 2, and Mistral’s Mixtral — were able to correctly state that campaign attire, such as a MAGA hat, would not be allowed at the polls in Texas under rules that prohibit people from wearing “a badge, insignia, emblem, or other similar communicative device relating to a candidate, measure, or political party appearing on the ballot,” calling into question AI models’ actual utility for the public. The question was one of 26 that a group of more than 40 state and local election officials and AI experts from civil society, academia, industry, and journalism posed during a workshop  probing how leading AI models respond to queries that voters might ask. The group of experts was gathered and selected by the AI Democracy Projects as the United States enters a contentious high-stakes election year…”

Sorry, comments are closed for this post.