Experimental News Clipping Site

Tag: safeguards

  • OpenAI : Working with US CAISI and UK AISI to build more secure AI systems

    —

    by

    Kurt Seifried
    in

    Source URL: https://openai.com/index/us-caisi-uk-aisi-ai-update Source: OpenAI Title: Working with US CAISI and UK AISI to build more secure AI systems Feedly Summary: OpenAI shares progress on the partnership with the US CAISI and UK AISI to strengthen AI safety and security. The collaboration is setting new standards for responsible frontier AI deployment through joint red-teaming, biosecurity…

  • OpenAI : Working with US CAISI and UK AISI to build more secure AI systems

    —

    by

    Kurt Seifried
    in

    Source URL: https://openai.com/index/us-caisi-uk-aisi-ai-safety Source: OpenAI Title: Working with US CAISI and UK AISI to build more secure AI systems Feedly Summary: OpenAI shares progress on the partnership with the US CAISI and UK AISI to strengthen AI safety and security. The collaboration is setting new standards for responsible frontier AI deployment through joint red-teaming, biosecurity…

  • Simon Willison’s Weblog: Claude API: Web fetch tool

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Sep/10/claude-web-fetch-tool/#atom-everything Source: Simon Willison’s Weblog Title: Claude API: Web fetch tool Feedly Summary: Claude API: Web fetch tool New in the Claude API: if you pass the web-fetch-2025-09-10 beta header you can add {“type": "web_fetch_20250910", "name": "web_fetch", "max_uses": 5} to your "tools" list and Claude will gain the ability to fetch content from…

  • Wired: Psychological Tricks Can Get AI to Break the Rules

    —

    by

    Kurt Seifried
    in

    Source URL: https://arstechnica.com/science/2025/09/these-psychological-tricks-can-get-llms-to-respond-to-forbidden-prompts/ Source: Wired Title: Psychological Tricks Can Get AI to Break the Rules Feedly Summary: Researchers convinced large language model chatbots to comply with “forbidden” requests using a variety of conversational tactics. AI Summary and Description: Yes Summary: The text discusses researchers’ exploration of conversational tactics used to manipulate large language model (LLM)…

  • The Register: OpenAI reorg at risk as Attorneys General push AI safety

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/09/05/openai_reorg_at_risk/ Source: The Register Title: OpenAI reorg at risk as Attorneys General push AI safety Feedly Summary: California, Delaware AGs blast ChatGPT shop over chatbot safeguards The Attorneys General of California and Delaware on Friday wrote to OpenAI’s board of directors, demanding that the AI company take steps to ensure its services are…

  • Schneier on Security: GPT-4o-mini Falls for Psychological Manipulation

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.schneier.com/blog/archives/2025/09/gpt-4o-mini-falls-for-psychological-manipulation.html Source: Schneier on Security Title: GPT-4o-mini Falls for Psychological Manipulation Feedly Summary: Interesting experiment: To design their experiment, the University of Pennsylvania researchers tested 2024’s GPT-4o-mini model on two requests that it should ideally refuse: calling the user a jerk and giving directions for how to synthesize lidocaine. The researchers created experimental…

  • New York Times – Artificial Intelligence : ChatGPT Will Get Parental Controls and New Safety Features, OpenAI Says

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.nytimes.com/2025/09/02/technology/personaltech/chatgpt-parental-controls-openai.html Source: New York Times – Artificial Intelligence Title: ChatGPT Will Get Parental Controls and New Safety Features, OpenAI Says Feedly Summary: After a California teenager spent months on ChatGPT discussing plans to end his life, OpenAI said it would introduce parental controls and better responses for users in distress. AI Summary and…

  • NCSC Feed: From bugs to bypasses: adapting vulnerability disclosure for AI safeguards

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.ncsc.gov.uk/blog-post/from-bugs-to-bypasses-adapting-vulnerability-disclosure-for-ai-safeguards Source: NCSC Feed Title: From bugs to bypasses: adapting vulnerability disclosure for AI safeguards Feedly Summary: Exploring how far cyber security approaches can help mitigate risks in generative AI systems AI Summary and Description: Yes Summary: The text addresses the intersection of cybersecurity strategies and generative AI systems, highlighting how established cybersecurity…

  • Simon Willison’s Weblog: Piloting Claude for Chrome

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Aug/26/piloting-claude-for-chrome/#atom-everything Source: Simon Willison’s Weblog Title: Piloting Claude for Chrome Feedly Summary: Piloting Claude for Chrome Two days ago I said: I strongly expect that the entire concept of an agentic browser extension is fatally flawed and cannot be built safely. Today Anthropic announced their own take on this pattern, implemented as an…