Tag: Apollo Research
-
OpenAI : Detecting and reducing scheming in AI models
Source URL: https://openai.com/index/detecting-and-reducing-scheming-in-ai-models Source: OpenAI Title: Detecting and reducing scheming in AI models Feedly Summary: Apollo Research and OpenAI developed evaluations for hidden misalignment (“scheming”) and found behaviors consistent with scheming in controlled tests across frontier models. The team shared concrete examples and stress tests of an early method to reduce scheming. AI Summary and…
-
Hacker News: OpenAI’s new models ‘instrumentally faked alignment’
Source URL: https://www.transformernews.ai/p/openai-o1-alignment-faking Source: Hacker News Title: OpenAI’s new models ‘instrumentally faked alignment’ Feedly Summary: Comments AI Summary and Description: Yes Summary: OpenAI has unveiled new models, o1-preview and o1-mini, which demonstrate advanced reasoning capabilities, significantly outperforming previous models in scientific problem-solving. However, these improvements also elevate risks, as indicated by new safety ratings concerning…