Tag: model reliability

  • Simon Willison’s Weblog: Anthropic: A postmortem of three recent issues

    Source URL: https://simonwillison.net/2025/Sep/17/anthropic-postmortem/ Source: Simon Willison’s Weblog Title: Anthropic: A postmortem of three recent issues Feedly Summary: Anthropic: A postmortem of three recent issues Anthropic had a very bad month in terms of model reliability: Between August and early September, three infrastructure bugs intermittently degraded Claude’s response quality. We’ve now resolved these issues and want…

  • Simon Willison’s Weblog: Anthropic status: Model output quality

    Source URL: https://simonwillison.net/2025/Sep/9/anthropic-model-output-quality/ Source: Simon Willison’s Weblog Title: Anthropic status: Model output quality Feedly Summary: Anthropic status: Model output quality Anthropic previously reported model serving bugs that affected Claude Opus 4 and 4.1 for 56.5 hours. They’ve now fixed additional bugs affecting “a small percentage" of Sonnet 4 requests for almost a month, plus a…

  • The Register: Alibaba admits Qwen3’s hybrid-thinking mode was dumb

    Source URL: https://www.theregister.com/2025/07/31/alibaba_qwen3_hybrid_thinking/ Source: The Register Title: Alibaba admits Qwen3’s hybrid-thinking mode was dumb Feedly Summary: Chinese e-commerce giant is going back to dedicated instruct and thinking-tuned models as they prioritize quality over convenience One of the headline features of Alibaba’s Qwen 3 family of models when they launched back in April was the ability…

  • Hacker News: Show HN: Formal Verification for Machine Learning Models Using Lean 4

    Source URL: https://github.com/fraware/leanverifier Source: Hacker News Title: Show HN: Formal Verification for Machine Learning Models Using Lean 4 Feedly Summary: Comments AI Summary and Description: Yes Summary: The project focuses on the formal verification of machine learning models using the Lean 4 framework, targeting aspects like robustness, fairness, and interpretability. This framework is particularly relevant…

  • Simon Willison’s Weblog: New audio models from OpenAI, but how much can we rely on them?

    Source URL: https://simonwillison.net/2025/Mar/20/new-openai-audio-models/#atom-everything Source: Simon Willison’s Weblog Title: New audio models from OpenAI, but how much can we rely on them? Feedly Summary: OpenAI announced several new audio-related API features today, for both text-to-speech and speech-to-text. They’re very promising new models, but they appear to suffer from the ever-present risk of accidental (or malicious) instruction…

  • Hacker News: Any insider takes on Yann LeCun’s push against current architectures?

    Source URL: https://news.ycombinator.com/item?id=43325049 Source: Hacker News Title: Any insider takes on Yann LeCun’s push against current architectures? Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses Yann Lecun’s perspective on the limitations of large language models (LLMs) and introduces the concept of an ‘energy minimization’ architecture to address issues like hallucinations. This…

  • Slashdot: OpenAI Pushes AI Agent Capabilities With New Developer API

    Source URL: https://developers.slashdot.org/story/25/03/11/2154229/openai-pushes-ai-agent-capabilities-with-new-developer-api?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: OpenAI Pushes AI Agent Capabilities With New Developer API Feedly Summary: AI Summary and Description: Yes Summary: OpenAI has introduced a new Responses API aimed at enabling developers to create autonomous AI agents capable of performing tasks using its AI models. This API will replace the older Assistants API…

  • Hacker News: SepLLM: Accelerate LLMs by Compressing One Segment into One Separator

    Source URL: https://sepllm.github.io/ Source: Hacker News Title: SepLLM: Accelerate LLMs by Compressing One Segment into One Separator Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses a novel framework called SepLLM designed to enhance the performance of Large Language Models (LLMs) by improving inference speed and computational efficiency. It identifies an innovative…