Experimental News Clipping Site

Tag: o1

  • Simon Willison’s Weblog: Exploring Promptfoo via Dave Guarino’s SNAP evals

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Apr/24/exploring-promptfoo/#atom-everything Source: Simon Willison’s Weblog Title: Exploring Promptfoo via Dave Guarino’s SNAP evals Feedly Summary: I used part three (here’s parts one and two) of Dave Guarino’s series on evaluating how well LLMs can answer questions about SNAP (aka food stamps) as an excuse to explore Promptfoo, an LLM eval tool. SNAP (Supplemental…

  • Simon Willison’s Weblog: OpenAI o3 and o4-mini System Card

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Apr/21/openai-o3-and-o4-mini-system-card/ Source: Simon Willison’s Weblog Title: OpenAI o3 and o4-mini System Card Feedly Summary: OpenAI o3 and o4-mini System Card I’m surprised to see a combined System Card for o3 and o4-mini in the same document – I’d expect to see these covered separately. The opening paragraph calls out the most interesting new…

  • Slashdot: OpenAI Puzzled as New Models Show Rising Hallucination Rates

    —

    by

    Kurt Seifried
    in

    Source URL: https://slashdot.org/story/25/04/18/2323216/openai-puzzled-as-new-models-show-rising-hallucination-rates Source: Slashdot Title: OpenAI Puzzled as New Models Show Rising Hallucination Rates Feedly Summary: AI Summary and Description: Yes Summary: OpenAI’s recent AI models, o3 and o4-mini, display increased hallucination rates compared to previous iterations. This raises concerns regarding the reliability of such AI systems in practical applications. The findings emphasize the…

  • Simon Willison’s Weblog: Quoting James Betker

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Apr/16/james-betker/#atom-everything Source: Simon Willison’s Weblog Title: Quoting James Betker Feedly Summary: I work for OpenAI. […] o4-mini is actually a considerably better vision model than o3, despite the benchmarks. Similar to how o3-mini-high was a much better coding model than o1. I would recommend using o4-mini-high over o3 for any task involving vision.…

  • Slashdot: OpenAI Unveils o3 and o4-mini Models

    —

    by

    Kurt Seifried
    in

    Source URL: https://slashdot.org/story/25/04/16/1925253/openai-unveils-o3-and-o4-mini-models?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: OpenAI Unveils o3 and o4-mini Models Feedly Summary: AI Summary and Description: Yes Summary: OpenAI’s release of the o3 and o4-mini AI models marks a crucial development in AI’s capability to process and analyze images, expanding the scope of their applications. These models can utilize various tools, enhancing their…

  • Slashdot: AI Models Still Struggle To Debug Software, Microsoft Study Shows

    —

    by

    Kurt Seifried
    in

    Source URL: https://developers.slashdot.org/story/25/04/11/0519242/ai-models-still-struggle-to-debug-software-microsoft-study-shows Source: Slashdot Title: AI Models Still Struggle To Debug Software, Microsoft Study Shows Feedly Summary: AI Summary and Description: Yes Summary: The study by Microsoft Research highlights the limitations of popular AI models, such as Anthropic’s Claude 3.7 Sonnet and OpenAI’s o3-mini, in successfully debugging software. Despite advancements, AI still falls short…

  • Simon Willison’s Weblog: LLM pricing calculator (updated)

    —

    by

    Kurt Seifried
    in

    Source URL: https://simonwillison.net/2025/Apr/10/llm-pricing-calculator/#atom-everything Source: Simon Willison’s Weblog Title: LLM pricing calculator (updated) Feedly Summary: LLM pricing calculator (updated) I updated my LLM pricing calculator this morning (Claude transcript) to show the prices of various hosted models in a sorted table, defaulting to lowest price first. Amazon Nova and Google Gemini continue to dominate the lower…

  • Cloud Blog: Anyscale powers AI compute for any workload using Google Compute Engine

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/ai-machine-learning/anyscale-powers-ai-compute-for-any-workload-using-google-compute-engine/ Source: Cloud Blog Title: Anyscale powers AI compute for any workload using Google Compute Engine Feedly Summary: Over the past decade, AI has evolved at a breakneck pace, turning from a futuristic dream into a tool now accessible to everyone. One of the technologies that opened up this new era of AI…

  • Slashdot: OpenAI’s o1-pro is the Company’s Most Expensive AI Model Yet

    —

    by

    Kurt Seifried
    in

    Source URL: https://slashdot.org/story/25/03/20/0227246/openais-o1-pro-is-the-companys-most-expensive-ai-model-yet?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: OpenAI’s o1-pro is the Company’s Most Expensive AI Model Yet Feedly Summary: AI Summary and Description: Yes Summary: OpenAI has recently introduced the o1-pro AI model, an enhanced version of their reasoning model, which is currently accessible to select developers at a significantly higher cost than previous models. This…