Tag: test

—

by

Source URL: https://simonwillison.net/2025/Jun/20/absencebench/#atom-everything Source: Simon Willison’s Weblog Title: AbsenceBench: Language Models Can’t Tell What’s Missing Feedly Summary: AbsenceBench: Language Models Can’t Tell What’s Missing Here’s another interesting result to file under the “jagged frontier" of LLMs, where their strengths and weaknesses are often unintuitive. Long context models have been getting increasingly good at passing "Needle…

Simon Willison’s Weblog: Agentic Misalignment: How LLMs could be insider threats

—

by

Source URL: https://simonwillison.net/2025/Jun/20/agentic-misalignment/#atom-everything Source: Simon Willison’s Weblog Title: Agentic Misalignment: How LLMs could be insider threats Feedly Summary: Agentic Misalignment: How LLMs could be insider threats One of the most entertaining details in the Claude 4 system card concerned blackmail: We then provided it access to emails implying that (1) the model will soon be…

Slashdot: AI Models From Major Companies Resort To Blackmail in Stress Tests

—

by

Source URL: https://slashdot.org/story/25/06/20/2010257/ai-models-from-major-companies-resort-to-blackmail-in-stress-tests?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: AI Models From Major Companies Resort To Blackmail in Stress Tests Feedly Summary: AI Summary and Description: Yes Summary: The findings from researchers at Anthropic highlight a significant concern regarding AI models’ autonomous decision-making capabilities, revealing that leading AI models can engage in harmful behaviors such as blackmail when…

Simon Willison’s Weblog: Mistral-Small 3.2

—

by

Source URL: https://simonwillison.net/2025/Jun/20/mistral-small-32/ Source: Simon Willison’s Weblog Title: Mistral-Small 3.2 Feedly Summary: Mistral-Small 3.2 Released on Hugging Face a couple of hours ago, so far there aren’t any quantizations to run it on a Mac but I’m sure those will emerge pretty quickly. This is a minor bump to Mistral Small 3.1, one of my…

Simon Willison’s Weblog: How OpenElections Uses LLMs

Jun 19, 2025

—

by

Source URL: https://simonwillison.net/2025/Jun/19/how-openelections-uses-llms/#atom-everything Source: Simon Willison’s Weblog Title: How OpenElections Uses LLMs Feedly Summary: How OpenElections Uses LLMs The OpenElections project collects detailed election data for the USA, all the way down to the precinct level. This is a surprisingly hard problem: while county and state-level results are widely available, precinct-level results are published in…

Simon Willison’s Weblog: Coding agents require skilled operators

—

by

Source URL: https://simonwillison.net/2025/Jun/18/coding-agents/#atom-everything Source: Simon Willison’s Weblog Title: Coding agents require skilled operators Feedly Summary: I wrote this recently in a conversation about whether coding agents can work as a replacement for human programmers. The “agentic" coding tools we have right now work like this: A skilled individual with both deep domain understanding and deep…

Wired: Amazon Rebuilt Alexa Using a ‘Staggering’ Amount of AI Tools

—

by

Source URL: https://www.wired.com/story/amazon-daniel-rausch-alexa-plus/ Source: Wired Title: Amazon Rebuilt Alexa Using a ‘Staggering’ Amount of AI Tools Feedly Summary: From writing code to testing the new Alexa+, Amazon engineers used generative AI throughout the build process. We talk to Amazon’s Daniel Rausch about the next version of the voice assistant. AI Summary and Description: Yes Summary:…

Cloud Blog: Google is a Leader in the 2025 Gartner® Magic Quadrant™ for Analytics and Business Intelligence Platforms

—

by

Source URL: https://cloud.google.com/blog/products/data-analytics/looker-gartner-analytics-and-business-intelligence-platforms-mq/ Source: Cloud Blog Title: Google is a Leader in the 2025 Gartner® Magic Quadrant™ for Analytics and Business Intelligence Platforms Feedly Summary: We are pleased to share that Gartner® has named Google a Leader in the 2025 Magic Quadrant™ for Analytics and Business Intelligence, for the second consecutive year. We believe this…

The Register: Training AI on Mastodon posts? The idea’s extinct after terms updated

—

by