Experimental News Clipping Site

Tag: llms

  • Simon Willison’s Weblog: How Anthropic built Artifacts

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Aug/28/how-anthropic-built-artifacts/#atom-everything Source: Simon Willison’s Weblog Title: How Anthropic built Artifacts Feedly Summary: How Anthropic built Artifacts Gergely Orosz interviews five members of Anthropic about how they built Artifacts on top of Claude 3.5 Sonnet with a small team in just three months. The initial prototype used Streamlit, and the biggest challenge was building…

  • Simon Willison’s Weblog: Cerebras Inference: AI at Instant Speed

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Aug/28/cerebras-inference/#atom-everything Source: Simon Willison’s Weblog Title: Cerebras Inference: AI at Instant Speed Feedly Summary: Cerebras Inference: AI at Instant Speed New hosted API for Llama running at absurdly high speeds: “1,800 tokens per second for Llama3.1 8B and 450 tokens per second for Llama3.1 70B". How are they running so fast? Custom hardware.…

  • Simon Willison’s Weblog: Anthropic Release Notes: System Prompts

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Aug/26/anthropic-system-prompts/#atom-everything Source: Simon Willison’s Weblog Title: Anthropic Release Notes: System Prompts Feedly Summary: Anthropic Release Notes: System Prompts Anthropic now publish the system prompts for their user-facing chat-based LLM systems – Claude 3 Haiku, Claude 3 Opus and Claude 3.5 Sonnet – as part of their documentation, with a promise to update this…

  • Simon Willison’s Weblog: SQL injection-like attack on LLMs with special tokens

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Aug/20/sql-injection-like-attack-on-llms-with-special-tokens/#atom-everything Source: Simon Willison’s Weblog Title: SQL injection-like attack on LLMs with special tokens Feedly Summary: SQL injection-like attack on LLMs with special tokens Andrej Karpathy explains something that’s been confusing me for the best part of a year: The decision by LLM tokenizers to parse special tokens in the input string (,…

  • Simon Willison’s Weblog: Introducing Zed AI

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Aug/20/introducing-zed-ai/#atom-everything Source: Simon Willison’s Weblog Title: Introducing Zed AI Feedly Summary: Introducing Zed AI The Zed open source code editor (from the original Atom team) already had GitHub Copilot autocomplete support, but now they’re introducing their own additional suite of AI features powered by Anthropic (though other providers can be configured using additional…

  • Simon Willison’s Weblog: Data Exfiltration from Slack AI via indirect prompt injection

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Aug/20/data-exfiltration-from-slack-ai/ Source: Simon Willison’s Weblog Title: Data Exfiltration from Slack AI via indirect prompt injection Feedly Summary: Data Exfiltration from Slack AI via indirect prompt injection Today’s prompt injection data exfiltration vulnerability affects Slack. Slack AI implements a RAG-style chat search interface against public and private data that the user has access to,…