Experimental News Clipping Site

Tag: Evaluation frameworks

  • The Register: AI models just don’t understand what they’re talking about

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/07/03/ai_models_potemkin_understanding/ Source: The Register Title: AI models just don’t understand what they’re talking about Feedly Summary: Researchers find models’ success at tests hides illusion of understanding Researchers from MIT, Harvard, and the University of Chicago have proposed the term “potemkin understanding" to describe a newly identified failure mode in large language models that…

  • Simon Willison’s Weblog: Trying out the new Gemini 2.5 model family

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Jun/17/gemini-2-5/ Source: Simon Willison’s Weblog Title: Trying out the new Gemini 2.5 model family Feedly Summary: After many months of previews, Gemini 2.5 Pro and Flash have reached general availability with new, memorable model IDs: gemini-2.5-pro and gemini-2.5-flash. They are joined by a new preview model with an unmemorable name: gemini-2.5-flash-lite-preview-06-17 is a…

  • METR updates – METR: Recent Frontier Models Are Reward Hacking

    —

    by

    Kurt Seifried
    in

    Source URL: https://metr.org/blog/2025-06-05-recent-reward-hacking/ Source: METR updates – METR Title: Recent Frontier Models Are Reward Hacking Feedly Summary: AI Summary and Description: Yes **Summary:** The provided text examines the complex phenomenon of “reward hacking” in AI systems, particularly focusing on modern language models. It describes how AI entities can exploit their environments to achieve high scores…

  • Simon Willison’s Weblog: OpenAI o3 and o4-mini System Card

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Apr/21/openai-o3-and-o4-mini-system-card/ Source: Simon Willison’s Weblog Title: OpenAI o3 and o4-mini System Card Feedly Summary: OpenAI o3 and o4-mini System Card I’m surprised to see a combined System Card for o3 and o4-mini in the same document – I’d expect to see these covered separately. The opening paragraph calls out the most interesting new…

  • Hacker News: Strengthening AI Agent Hijacking Evaluations

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.nist.gov/news-events/news/2025/01/technical-blog-strengthening-ai-agent-hijacking-evaluations Source: Hacker News Title: Strengthening AI Agent Hijacking Evaluations Feedly Summary: Comments AI Summary and Description: Yes Summary: The text outlines security risks related to AI agents, particularly focusing on “agent hijacking,” where malicious instructions can be injected into data handled by AI systems, leading to harmful actions. The U.S. AI Safety…

  • Hacker News: AI is blurring the line between PMs and Engineers

    —

    by

    Kurt Seifried
    in

    Source URL: https://humanloop.com/blog/ai-is-blurring-the-lines-between-pms-and-engineers Source: Hacker News Title: AI is blurring the line between PMs and Engineers Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text discusses the emerging trend of prompt engineering in AI applications, emphasizing how it increasingly involves product managers (PMs) rather than just software engineers. This shift indicates a blurring…

  • Cloud Blog: Deep dive into AI with Google Cloud’s global generative AI roadshow

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/topics/developers-practitioners/attend-the-google-cloud-genai-roadshow/ Source: Cloud Blog Title: Deep dive into AI with Google Cloud’s global generative AI roadshow Feedly Summary: The AI revolution isn’t just about large language models (LLMs) – it’s about building real-world solutions that change the way you work. Google’s global AI roadshow offers an immersive experience that’s designed to empower you,…

  • Simon Willison’s Weblog: How we estimate the risk from prompt injection attacks on AI systems

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Jan/29/prompt-injection-attacks-on-ai-systems/ Source: Simon Willison’s Weblog Title: How we estimate the risk from prompt injection attacks on AI systems Feedly Summary: How we estimate the risk from prompt injection attacks on AI systems The “Agentic AI Security Team" at Google DeepMind share some details on how they are researching indirect prompt injection attacks. They…

  • Cloud Blog: Introducing agent evaluation in Vertex AI Gen AI evaluation service

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/ai-machine-learning/introducing-agent-evaluation-in-vertex-ai-gen-ai-evaluation-service/ Source: Cloud Blog Title: Introducing agent evaluation in Vertex AI Gen AI evaluation service Feedly Summary: Comprehensive agent evaluation is essential for building the next generation of reliable AI. It’s not enough to simply check the outputs; we need to understand the “why" behind an agent’s actions – its reasoning, decision-making process,…