Tag: llms

Source URL: https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/#atom-everything Source: Simon Willison’s Weblog Title: The lethal trifecta for AI agents: private data, untrusted content, and external communication Feedly Summary: If you are a user of LLM systems that use tools (you can call them “AI agents" if you like) it is critically important that you understand the risk of combining tools…

Simon Willison’s Weblog: An Introduction to Google’s Approach to AI Agent Security

Jun 15, 2025

—

by

Source URL: https://simonwillison.net/2025/Jun/15/ai-agent-security/#atom-everything Source: Simon Willison’s Weblog Title: An Introduction to Google’s Approach to AI Agent Security Feedly Summary: Here’s another new paper on AI agent security: An Introduction to Google’s Approach to AI Agent Security, by Santiago Díaz, Christoph Kern, and Kara Olive. (I wrote about a different recent paper, Design Patterns for Securing…

Simon Willison’s Weblog: Anthropic: How we built our multi-agent research system

Jun 14, 2025

—

by

Source URL: https://simonwillison.net/2025/Jun/14/multi-agent-research-system/#atom-everything Source: Simon Willison’s Weblog Title: Anthropic: How we built our multi-agent research system Feedly Summary: Anthropic: How we built our multi-agent research system OK, I’m sold on multi-agent LLM systems now. I’ve been pretty skeptical of these until recently: why make your life more complicated by running multiple different prompts in parallel…

Simon Willison’s Weblog: llm-fragments-youtube

Jun 14, 2025

—

by

Source URL: https://simonwillison.net/2025/Jun/14/llm-fragments-youtube/#atom-everything Source: Simon Willison’s Weblog Title: llm-fragments-youtube Feedly Summary: llm-fragments-youtube Excellent new LLM plugin by Agustin Bacigalup which lets you use the subtitles of any YouTube video as a fragment for running prompts against. I tried it out like this: llm install llm-fragments-youtube llm -f youtube:dQw4w9WgXcQ \ ‘summary of people and what they…

Google Online Security Blog: Mitigating prompt injection attacks with a layered defense strategy

—

by

Source URL: http://security.googleblog.com/2025/06/mitigating-prompt-injection-attacks.html Source: Google Online Security Blog Title: Mitigating prompt injection attacks with a layered defense strategy Feedly Summary: AI Summary and Description: Yes **Summary:** The text discusses emerging security threats associated with generative AI, particularly focusing on indirect prompt injections that manipulate AI systems through hidden malicious instructions. Google outlines its layered security…

Simon Willison’s Weblog: Quoting Andrew Ng

—

by

Source URL: https://simonwillison.net/2025/Jun/13/andrew-ng/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Andrew Ng Feedly Summary: There’s a new breed of GenAI Application Engineers who can build more-powerful applications faster than was possible before, thanks to generative AI. Individuals who can play this role are highly sought-after by businesses, but the job description is still coming into focus.…

Cloud Blog: How good is your AI? Gen AI evaluation at every stage, explained

—

by

Source URL: https://cloud.google.com/blog/products/ai-machine-learning/how-to-evaluate-your-gen-ai-at-every-stage/ Source: Cloud Blog Title: How good is your AI? Gen AI evaluation at every stage, explained Feedly Summary: As AI moves from promising experiments to landing core business impact, the most critical question is no longer “What can it do?" but "How well does it do it?". Ensuring the quality, reliability, and…

Simon Willison’s Weblog: Design Patterns for Securing LLM Agents against Prompt Injections

—

by

Source URL: https://simonwillison.net/2025/Jun/13/prompt-injection-design-patterns/#atom-everything Source: Simon Willison’s Weblog Title: Design Patterns for Securing LLM Agents against Prompt Injections Feedly Summary: This a new paper by 11 authors from organizations including IBM, Invariant Labs, ETH Zurich, Google and Microsoft is an excellent addition to the literature on prompt injection and LLM security. In this work, we describe…

Simon Willison’s Weblog: Agentic Coding Recommendations

Jun 12, 2025

—

by