Experimental News Clipping Site

Tag: model scaling

  • Hacker News: How to Scale Your Model: A Systems View of LLMs on TPUs

    —

    by

    Kurt Seifried
    in

    Source URL: https://jax-ml.github.io/scaling-book/ Source: Hacker News Title: How to Scale Your Model: A Systems View of LLMs on TPUs Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses the performance optimization of large language models (LLMs) on tensor processing units (TPUs), addressing issues related to scaling and efficiency. It emphasizes the importance…

  • Simon Willison’s Weblog: Quoting Jack Clark

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/23/jack-clark/#atom-everything Source: Simon Willison’s Weblog Title: Quoting Jack Clark Feedly Summary: There’s been a lot of strange reporting recently about how ‘scaling is hitting a wall’ – in a very narrow sense this is true in that larger models were getting less score improvement on challenging benchmarks than their predecessors, but in a…

  • Simon Willison’s Weblog: Is AI progress slowing down?

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/19/is-ai-progress-slowing-down/#atom-everything Source: Simon Willison’s Weblog Title: Is AI progress slowing down? Feedly Summary: Is AI progress slowing down? This piece by Arvind Narayanan and Sayash Kapoor is the single most insightful essay about AI and LLMs I’ve seen in a long time. It’s long and worth reading every inch of it – it…