Aretify: A Chrome Extension to Fact-Check AI Outputs
The author built a Chrome extension called Aretify that verifies the accuracy of claims made by AI assistants like ChatGPT, Gemini, and Claude. It checks factual statements against multiple evidence sources and provides an overall 'AretifyScore' along with an ethical analysis.
Why it matters
Aretify addresses the growing problem of AI assistants generating inaccurate or misleading information, providing a tool to verify claims and analyze the ethical implications.
Key Points
- 1Aretify is a Chrome extension that adds a 'Verify' button to AI responses
- 2It extracts factual claims and checks them against 15+ evidence sources
- 3Claims are scored as Verified, Partial Match, or Unverified, and the response gets an AretifyScore
- 4The extension also includes an ethical analysis framework developed by the author's father
Details
The author built Aretify in response to finding that around 27% of AI outputs contain fabricated claims. The extension works by first extracting individual factual claims from the AI response, then searching those claims against a wide range of evidence sources including academic databases, fact-checking sites, and news APIs. Each claim is scored based on how well it matches the evidence, and the overall response receives an AretifyScore from 0-100. The extension also includes an ethical analysis framework developed by the author's philosophy professor father, evaluating the implications of the AI output across different ethical frameworks. The author discusses the technical challenges of building a Chrome extension, including issues with API reliability and Chrome's Manifest V3 restrictions.
No comments yet
Be the first to comment