Experimental News Clipping Site

Tag: liability

  • The Register: Scholars sneaking phrases into papers to fool AI reviewers

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/07/07/scholars_try_to_fool_llm_reviewers/ Source: The Register Title: Scholars sneaking phrases into papers to fool AI reviewers Feedly Summary: Using prompt injections to play a Jedi mind trick on LLMs A handful of international computer science researchers appear to be trying to influence AI reviews with a new class of prompt injection attack.… AI Summary and…

  • Slashdot: The Downside of a Digital Yes-Man

    —

    by

    Kurt Seifried
    in

    Source URL: https://tech.slashdot.org/story/25/07/07/1923231/the-downside-of-a-digital-yes-man?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: The Downside of a Digital Yes-Man Feedly Summary: AI Summary and Description: Yes Summary: The text discusses a study by Anthropic researchers on the impact of human feedback on AI behavior, particularly how it can lead to sycophantic responses from AI systems. This is particularly relevant for professionals in…

  • Slashdot: Police Department Apologizes for Sharing AI-Doctored Evidence Photo on Social Media

    —

    by

    Kurt Seifried
    in

    Source URL: https://yro.slashdot.org/story/25/07/06/0252201/police-department-apologizes-for-sharing-ai-doctored-evidence-photo-on-social-media?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: Police Department Apologizes for Sharing AI-Doctored Evidence Photo on Social Media Feedly Summary: AI Summary and Description: Yes Summary: A police department in Maine admitted to inadvertently sharing an AI-altered photo of drug evidence on social media, resulting in public scrutiny over the integrity of evidence presentation. This incident…

  • Slashdot: XBOW’s AI-Powered Pentester Grabs Top Rank on HackerOne, Raises $75M to Grow Platform

    —

    by

    Kurt Seifried
    in

    Source URL: https://it.slashdot.org/story/25/07/05/1847237/xbows-ai-powered-pentester-grabs-top-rank-on-hackerone-raises-75m-to-grow-platform Source: Slashdot Title: XBOW’s AI-Powered Pentester Grabs Top Rank on HackerOne, Raises $75M to Grow Platform Feedly Summary: AI Summary and Description: Yes Summary: The text discusses the emergence of “Xbow,” an autonomous AI-powered penetration tester that has excelled in finding and reporting vulnerabilities in enterprise software. This innovation highlights the trend…

  • Slashdot: Simple Text Additions Can Fool Advanced AI Reasoning Models, Researchers Find

    —

    by

    Kurt Seifried
    in

    Source URL: https://tech.slashdot.org/story/25/07/04/1521245/simple-text-additions-can-fool-advanced-ai-reasoning-models-researchers-find Source: Slashdot Title: Simple Text Additions Can Fool Advanced AI Reasoning Models, Researchers Find Feedly Summary: AI Summary and Description: Yes Summary: The research highlights a significant vulnerability in state-of-the-art reasoning AI models through the “CatAttack” technique, which attaches irrelevant phrases to math problems, leading to higher error rates and inefficient responses.…

  • Simon Willison’s Weblog: awwaiid/gremllm

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Jul/4/gremllm/#atom-everything Source: Simon Willison’s Weblog Title: awwaiid/gremllm Feedly Summary: awwaiid/gremllm Delightfully cursed Python library by Brock Wilcox, built on top of LLM: from gremllm import Gremllm counter = Gremllm(“counter") counter.value = 5 counter.increment() print(counter.value) # 6? print(counter.to_roman_numerals()) # VI? You tell your Gremllm what it should be in the constructor, then it uses…

  • The Register: AI models just don’t understand what they’re talking about

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/07/03/ai_models_potemkin_understanding/ Source: The Register Title: AI models just don’t understand what they’re talking about Feedly Summary: Researchers find models’ success at tests hides illusion of understanding Researchers from MIT, Harvard, and the University of Chicago have proposed the term “potemkin understanding" to describe a newly identified failure mode in large language models that…

  • Simon Willison’s Weblog: Frequently Asked Questions (And Answers) About AI Evals

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Jul/3/faqs-about-ai-evals/#atom-everything Source: Simon Willison’s Weblog Title: Frequently Asked Questions (And Answers) About AI Evals Feedly Summary: Frequently Asked Questions (And Answers) About AI Evals Hamel Husain and Shreya Shankar have been running a paid, cohort-based course on AI Evals For Engineers & PMs over the past few months. Here Hamel collects answers to…