Tag: scaling
-
The Register: Even at $200/mo, Altman admits ChatGPT Pro struggles to turn a profit
Source URL: https://www.theregister.com/2025/01/06/altman_gpt_profits/ Source: The Register Title: Even at $200/mo, Altman admits ChatGPT Pro struggles to turn a profit Feedly Summary: But don’t worry, he’s ‘figured out’ AGI comment Even at $200 a month for ChatGPT Pro, the service is struggling to turn a profit, OpenAI CEO Sam Altman lamented on the platform formerly known…
-
Simon Willison’s Weblog: Quoting François Chollet
Source URL: https://simonwillison.net/2025/Jan/6/francois-chollet/#atom-everything Source: Simon Willison’s Weblog Title: Quoting François Chollet Feedly Summary: I don’t think people really appreciate how simple ARC-AGI-1 was, and what solving it really means. It was designed as the simplest, most basic assessment of fluid intelligence possible. Failure to pass signifies a near-total inability to adapt or problem-solve in unfamiliar…
-
Hacker News: The State of Generative Models
Source URL: https://nrehiew.github.io/blog/2024/ Source: Hacker News Title: The State of Generative Models Feedly Summary: Comments AI Summary and Description: Yes Summary: The text provides a comprehensive overview of the advances in generative AI technologies, particularly focusing on Large Language Models (LLMs) and their architectures, image generation models, and emerging trends leading into 2025. It discusses…
-
Hacker News: A path to O1 open source
Source URL: https://arxiv.org/abs/2412.14135 Source: Hacker News Title: A path to O1 open source Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses advancements in artificial intelligence, particularly focusing on the reinforcement learning approach to reproduce OpenAI’s o1 model. It highlights key components like policy initialization, reward design, search, and learning that contribute…
-
Hacker News: All You Need Is 4x 4090 GPUs to Train Your Own Model
Source URL: https://sabareesh.com/posts/llm-rig/ Source: Hacker News Title: All You Need Is 4x 4090 GPUs to Train Your Own Model Feedly Summary: Comments AI Summary and Description: Yes Summary: The text provides a detailed guide on building a custom machine learning rig specifically for training Large Language Models (LLMs) using high-performance hardware. It highlights the significance…
-
Hacker News: An attempt at AGI on the Tokio Runtime
Source URL: https://www.christo.sh/building-agi-on-the-tokio-runtime/ Source: Hacker News Title: An attempt at AGI on the Tokio Runtime Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text outlines an individual’s experimental journey to build Artificial General Intelligence (AGI) through a biologically inspired neural network running on the Tokio Runtime. The project involves a unique approach to…
-
Simon Willison’s Weblog: Trying out QvQ – Qwen’s new visual reasoning model
Source URL: https://simonwillison.net/2024/Dec/24/qvq/#atom-everything Source: Simon Willison’s Weblog Title: Trying out QvQ – Qwen’s new visual reasoning model Feedly Summary: I thought we were done for major model releases in 2024, but apparently not: Alibaba’s Qwen team just dropped the Apache2 2 licensed QvQ-72B-Preview, “an experimental research model focusing on enhancing visual reasoning capabilities". Their blog…
-
Simon Willison’s Weblog: Quoting Jack Clark
Source URL: https://simonwillison.net/2024/Dec/23/jack-clark/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Jack Clark Feedly Summary: There’s been a lot of strange reporting recently about how ‘scaling is hitting a wall’ – in a very narrow sense this is true in that larger models were getting less score improvement on challenging benchmarks than their predecessors, but in a…