Experimental News Clipping Site

Tag: prompt-injection

  • Slashdot: Dire Predictions for 2025 Include ‘Largest Cyberattack in History’

    —

    by

    system automation
    in

    Source URL: https://it.slashdot.org/story/25/01/04/1839246/dire-predictions-for-2025-include-largest-cyberattack-in-history?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: Dire Predictions for 2025 Include ‘Largest Cyberattack in History’ Feedly Summary: AI Summary and Description: Yes **Summary:** The text discusses potential “Black Swan” events for 2025, particularly highlighting the anticipated risks associated with cyberattacks bolstered by generative AI and large language models. This insight is crucial for security professionals,…

  • Embrace The Red: Trust No AI: Prompt Injection Along the CIA Security Triad Paper

    —

    by

    system automation
    in

    Source URL: https://embracethered.com/blog/posts/2024/trust-no-ai-prompt-injection-along-the-cia-security-triad-paper/ Source: Embrace The Red Title: Trust No AI: Prompt Injection Along the CIA Security Triad Paper Feedly Summary: Happy to share that I authored the paper “Trust No AI: Prompt Injection Along The CIA Security Triad”, based on research conducted over the past 18 months. You can download it from arxiv. The…

  • Simon Willison’s Weblog: Quoting Johann Rehberger

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/17/johann-rehberger/ Source: Simon Willison’s Weblog Title: Quoting Johann Rehberger Feedly Summary: Happy to share that Anthropic fixed a data leakage issue in the iOS app of Claude that I responsibly disclosed. 🙌 👉 Image URL rendering as avenue to leak data in LLM apps often exists in mobile apps as well — typically…

  • Simon Willison’s Weblog: Security ProbLLMs in xAI’s Grok: A Deep Dive

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/16/security-probllms-in-xais-grok/#atom-everything Source: Simon Willison’s Weblog Title: Security ProbLLMs in xAI’s Grok: A Deep Dive Feedly Summary: Security ProbLLMs in xAI’s Grok: A Deep Dive Adding xAI to the growing list of AI labs that shipped feature vulnerable to data exfiltration prompt injection attacks, but with the unfortunate addendum that they don’t seem to…

  • Embrace The Red: Security ProbLLMs in xAI’s Grok: A Deep Dive

    —

    by

    system automation
    in

    Source URL: https://embracethered.com/blog/posts/2024/security-probllms-in-xai-grok/ Source: Embrace The Red Title: Security ProbLLMs in xAI’s Grok: A Deep Dive Feedly Summary: Grok is the chatbot of xAI. It’s a state-of-the-art model, chatbot and recently also API. It has a Web UI and is integrated into the X (former Twitter) app, and recently it’s also accessible via an API.…

  • The Register: Microsoft dangles $10K for hackers to hijack LLM email service

    —

    by

    system automation
    in

    Source URL: https://www.theregister.com/2024/12/09/microsoft_llm_prompt_injection_challenge/ Source: The Register Title: Microsoft dangles $10K for hackers to hijack LLM email service Feedly Summary: Outsmart an AI, win a little Christmas cash Microsoft and friends have challenged AI hackers to break a simulated LLM-integrated email client with a prompt injection attack – and the winning teams will share a $10,000…

  • Embrace The Red: Terminal DiLLMa: LLM-powered Apps Can Hijack Your Terminal Via Prompt Injection

    —

    by

    system automation
    in

    Source URL: https://embracethered.com/blog/posts/2024/terminal-dillmas-prompt-injection-ansi-sequences/ Source: Embrace The Red Title: Terminal DiLLMa: LLM-powered Apps Can Hijack Your Terminal Via Prompt Injection Feedly Summary: Last week Leon Derczynski described how LLMs can output ANSI escape codes. These codes, also known as control characters, are interpreted by terminal emulators and modify behavior. This discovery resonates with areas I had…

  • Simon Willison’s Weblog: 0xfreysa/agent

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Nov/29/0xfreysaagent/#atom-everything Source: Simon Willison’s Weblog Title: 0xfreysa/agent Feedly Summary: 0xfreysa/agent Freysa describes itself as “the world’s first adversarial agent game". On 22nd November they released an LLM-driven application which people could pay to message (using Ethereum), with access to tools that could transfer a prize pool to the message sender, ending the game.…

  • Simon Willison’s Weblog: Leaked system prompts from Vercel v0

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Nov/25/leaked-system-prompts-from-vercel-v0/#atom-everything Source: Simon Willison’s Weblog Title: Leaked system prompts from Vercel v0 Feedly Summary: Leaked system prompts from Vercel v0 v0 is Vercel’s entry in the increasingly crowded LLM-assisted development market – chat with a bot and have that bot build a full application for you. They’ve been iterating on it since launching…