Evaluating Hallucinations in LLMs like GPT4

Some examples of hallucinations in LLM-generated outputs:


Factual Inaccuracies: The LLM produces a statement that is factually incorrect.

Unsupported Claims: The LLM generates a response that has no basis in the input or context.

Nonsensical Statements: The LLM produces a response that doesn’t make sense or is unrelated to the context.

Improbable Scenarios: The LLM generates a response that describes an implausible or highly unlikely event. 

Ref: Detailed article : Mathematically Evaluating Hallucinations in LLMs like GPT4

https://medium.com/autonomous-agents/mathematically-evaluating-hallucinations-in-llms-like-chatgpt-e9db339b39c2

Comments

Post a Comment

Popular posts from this blog

Platforms for building and deploying conversational AI agents

Twenty top companies providing no-code (or low-code/no-code hybrid) platforms for building and deploying conversational AI agents—without requiring coding or specialized AI expertise, often leveraging communication infrastructure or channels to serve as the primary business-customer interaction layer—include CometChat , Kore.ai, Yellow.ai, Microsoft Copilot Studio, Voiceflow, Botpress, Synthflow, Retell AI, Landbot, ManyChat, Tidio, SiteGPT, Aisera, Lindy AI, Relevance AI, ChatFuel, Boost.ai, Cognigy.AI, Sendbird, and Gupshup. These platforms generally enable visual builders, drag-and-drop flows, pre-built templates or agents, integrations with messaging/voice channels (web, WhatsApp, SMS, phone, in-app chat), knowledge bases, and multi-agent orchestration for customer support, sales, lead gen, and internal workflows. Some emphasize real-time comms backbones (like CometChat's six-year infrastructure or Sendbird's), while others focus on enterprise CX/EX or voice telephony. In ...
Read more

Better prompts to harness capability of cgpt

 To fully harness the intelligence of AI, beyond expecting human-level capabilities, prompts should be designed to tap into areas where AI excels, such as data processing, pattern recognition, and knowledge synthesis. Here’s how you can structure prompts to utilize the full potential of AI: ### 1. **Data Processing and Analysis Prompts:**    - **Ask for complex data analysis or predictions based on multiple variables.** AI can handle massive datasets and detect patterns that are difficult for humans to discern.      - Example: *“Analyze the trends in global carbon emissions over the last 50 years and predict the potential impact on sea level rise by 2050.”*      - Example: *“Provide a comparative analysis of stock market performance for tech companies in the last decade, including correlations between major events and market shifts.”* ### 2. **Pattern Recognition and Anomaly Detection Prompts:**    - **Leverage AI’s ability to recog...
Read more

Which AI is suitable for you - Gemini, microsoft copilot, deep seek or claude?

 Which is suitable for you - Gemini, microsoft copilot, deep seek or claude? An analysis by chat gpt. ======= CP = copilot, CL= claude. Here’s a structured, critical grading of the four responses (CP, DS, CL, GE) across technical rigor, completeness, practicality, clarity, and audience-fit, followed by best-fit use cases by persona. --- 🔍 Overall Calibration (before grading) All four answers correctly identify the core physics: exploiting diurnal ΔT (temperature swing) using Seebeck, pyroelectric, phase-change, or heat engines However, they differ sharply in: engineering realism vs ideation POC practicality vs conceptual breadth audience targeting --- 🧠 Response-by-Response Grading 1. CP (Concise + Academic framing) Strengths Clean categorization (TEG, dual absorber, TREC) Good conceptual correctness (especially radiative cooling) Maintains focus on thermal gradient exploitation Weaknesses Over-indexes on literature-style solutions Lacks mechanical/DIY pathways TREC section is th...
Read more