Tag: mlc

  • Simon Willison’s Weblog: Things we learned out about LLMs in 2024

    Source URL: https://simonwillison.net/2024/Dec/31/llms-in-2024/#atom-everything Source: Simon Willison’s Weblog Title: Things we learned out about LLMs in 2024 Feedly Summary: A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past twelve months, plus my attempt at identifying…

  • The Register: Wish there was a benchmark for ML safety? Allow us to AILuminate you…

    Source URL: https://www.theregister.com/2024/12/05/mlcommons_ai_safety_benchmark/ Source: The Register Title: Wish there was a benchmark for ML safety? Allow us to AILuminate you… Feedly Summary: Very much a 1.0 – but it’s a solid start MLCommons, an industry-led AI consortium, on Wednesday introduced AILuminate – a benchmark for assessing the safety of large language models in products.… AI…

  • Wired: A New Benchmark for the Risks of AI

    Source URL: https://www.wired.com/story/benchmark-for-ai-risks/ Source: Wired Title: A New Benchmark for the Risks of AI Feedly Summary: MLCommons provides benchmarks that test the abilities of AI systems. It wants to measure the bad side of AI next. AI Summary and Description: Yes Summary: The text discusses MLCommons’ introduction of AILuminate, a new benchmark designed to evaluate…

  • Simon Willison’s Weblog: Structured Generation w/ SmolLM2 running in browser & WebGPU

    Source URL: https://simonwillison.net/2024/Nov/29/structured-generation-smollm2-webgpu/#atom-everything Source: Simon Willison’s Weblog Title: Structured Generation w/ SmolLM2 running in browser & WebGPU Feedly Summary: Structured Generation w/ SmolLM2 running in browser & WebGPU Extraordinary demo by Vaibhav Srivastav. Here’s Hugging Face’s SmolLM2-1.7B-Instruct running directly in a web browser (using WebGPU, so requires Chrome for the moment) demonstrating structured text extraction,…