Experimental News Clipping Site

Tag: safety measures

  • METR updates – METR: Comment on NIST RMF GenAI Companion

    —

    by

    Kurt Seifried
    in

    Source URL: https://downloads.regulations.gov/NIST-2024-0001-0075/attachment_2.pdf Source: METR updates – METR Title: Comment on NIST RMF GenAI Companion Feedly Summary: AI Summary and Description: Yes **Summary**: The provided text discusses the National Institute of Standards and Technology’s (NIST) AI Risk Management Framework concerning Generative AI. It outlines significant risks posed by autonomous AI systems and suggests enhancements to…

  • METR updates – METR: AI models can be dangerous before public deployment

    —

    by

    Kurt Seifried
    in

    Source URL: https://metr.org/blog/2025-01-17-ai-models-dangerous-before-public-deployment/ Source: METR updates – METR Title: AI models can be dangerous before public deployment Feedly Summary: AI Summary and Description: Yes **Short Summary with Insight:** This text provides a critical perspective on the safety measures surrounding the deployment of powerful AI systems, emphasizing that traditional pre-deployment testing is insufficient due to the…

  • The Register: Microsoft sues ‘foreign-based’ criminals, seizes sites used to abuse AI

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/01/13/microsoft_sues_foreignbased_crims_seizes/ Source: The Register Title: Microsoft sues ‘foreign-based’ criminals, seizes sites used to abuse AI Feedly Summary: Crooks stole API keys, then started a hacking-as-a-service biz Microsoft has sued a group of unnamed cybercriminals who developed tools to bypass safety guardrails in its generative AI tools. The tools were used to create harmful…

  • CSA: How Can Businesses Mitigate AI "Lying" Risks Effectively?

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.schellman.com/blog/cybersecurity/llms-and-how-to-address-ai-lying Source: CSA Title: How Can Businesses Mitigate AI "Lying" Risks Effectively? Feedly Summary: AI Summary and Description: Yes Summary: The text addresses the accuracy of outputs generated by large language models (LLMs) in AI systems, emphasizing the risk of AI “hallucinations” and the importance of robust data management to mitigate these concerns.…

  • Schneier on Security: Microsoft Takes Legal Action Against AI “Hacking as a Service” Scheme

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.schneier.com/blog/archives/2025/01/microsoft-takes-legal-action-against-ai-hacking-as-a-service-scheme.html Source: Schneier on Security Title: Microsoft Takes Legal Action Against AI “Hacking as a Service” Scheme Feedly Summary: Not sure this will matter in the end, but it’s a positive move: Microsoft is accusing three individuals of running a “hacking-as-a-service” scheme that was designed to allow the creation of harmful and illicit…

  • Hacker News: Phi4 Available on Ollama

    —

    by

    Kurt Seifried
    in

    Source URL: https://ollama.com/library/phi4 Source: Hacker News Title: Phi4 Available on Ollama Feedly Summary: Comments AI Summary and Description: Yes Summary: The text describes Phi 4, a state-of-the-art language model focusing on generative AI capabilities. It highlights the model’s design, enhancements for safety and accuracy, and its primary and out-of-scope use cases, along with regulatory considerations.…

  • Wired: Rumble Among 15 Targets of Texas Attorney General’s Child Privacy Probe

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.wired.com/story/texas-social-media-investigation-children-privacy/ Source: Wired Title: Rumble Among 15 Targets of Texas Attorney General’s Child Privacy Probe Feedly Summary: Texas has become a leading enforcer of internet rules. Its latest probe includes some platforms that privacy experts describe as unusual suspects. AI Summary and Description: Yes Summary: Texas Attorney General Ken Paxton is leading an…

  • OpenAI : Deliberative alignment: reasoning enables safer language models

    —

    by

    Kurt Seifried
    in

    Source URL: https://openai.com/index/deliberative-alignment Source: OpenAI Title: Deliberative alignment: reasoning enables safer language models Feedly Summary: Deliberative alignment: reasoning enables safer language models Introducing our new alignment strategy for o1 models, which are directly taught safety specifications and how to reason over them. AI Summary and Description: Yes Summary: The text discusses a new alignment strategy…

  • Unit 42: Bad Likert Judge: A Novel Multi-Turn Technique to Jailbreak LLMs by Misusing Their Evaluation Capability

    —

    by

    system automation
    in

    Source URL: https://unit42.paloaltonetworks.com/?p=138017 Source: Unit 42 Title: Bad Likert Judge: A Novel Multi-Turn Technique to Jailbreak LLMs by Misusing Their Evaluation Capability Feedly Summary: The jailbreak technique “Bad Likert Judge" manipulates LLMs to generate harmful content using Likert scales, exposing safety gaps in LLM guardrails. The post Bad Likert Judge: A Novel Multi-Turn Technique to…

  • Slashdot: Geoffrey Hinton Says There is 10-20% Chance AI Will Lead To Human Extinction in 30 Years

    —

    by

    system automation
    in

    Source URL: https://slashdot.org/story/24/12/27/1723235/geoffrey-hinton-says-there-is-10-20-chance-ai-will-lead-to-human-extinction-in-30-years?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: Geoffrey Hinton Says There is 10-20% Chance AI Will Lead To Human Extinction in 30 Years Feedly Summary: AI Summary and Description: Yes Summary: The text discusses comments made by renowned computer scientist Geoffrey Hinton, who has revised his estimates regarding the potential existential risk posed by artificial intelligence.…