Tag: dataset

Source URL: https://simonwillison.net/2024/Nov/18/qwen-turbo/#atom-everything Source: Simon Willison’s Weblog Title: Qwen: Extending the Context Length to 1M Tokens Feedly Summary: Qwen: Extending the Context Length to 1M Tokens The new Qwen2.5-Turbo boasts a million token context window (up from 128,000 for Qwen 2.5) and faster performance: Using sparse attention mechanisms, we successfully reduced the time to first…

Simon Willison’s Weblog: Quoting Jack Clark

Nov 18, 2024

—

by

Source URL: https://simonwillison.net/2024/Nov/18/jack-clark/ Source: Simon Willison’s Weblog Title: Quoting Jack Clark Feedly Summary: The main innovation here is just using more data. Specifically, Qwen2.5 Coder is a continuation of an earlier Qwen 2.5 model. The original Qwen 2.5 model was trained on 18 trillion tokens spread across a variety of languages and tasks (e.g, writing,…

Hacker News: All-in-one embedding model for interleaved text, images, and screenshots

Nov 17, 2024

—

by

Source URL: https://blog.voyageai.com/2024/11/12/voyage-multimodal-3/ Source: Hacker News Title: All-in-one embedding model for interleaved text, images, and screenshots Feedly Summary: Comments AI Summary and Description: Yes Summary: The text announces the release of voyage-multimodal-3, a cutting-edge multimodal embedding model that enhances the capability of semantic search and retrieval tasks involving both text and images. Its ability to…

Hacker News: AI isn’t unleashing imaginations, it’s outsourcing them. The purpose is profit

—

by

Source URL: https://www.theguardian.com/technology/2024/nov/16/ai-isnt-about-unleashing-our-imaginations-its-about-outsourcing-them-the-real-purpose-is-profit Source: Hacker News Title: AI isn’t unleashing imaginations, it’s outsourcing them. The purpose is profit Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text reflects on the transformative impact of generative AI on creative professions and the inherent threats it poses to human artistry and originality. It underscores the challenges…

Hacker News: Don’t Look Twice: Faster Video Transformers with Run-Length Tokenization

—

by

Source URL: https://rccchoudhury.github.io/rlt/ Source: Hacker News Title: Don’t Look Twice: Faster Video Transformers with Run-Length Tokenization Feedly Summary: Comments AI Summary and Description: Yes Summary: The text presents a novel approach called Run-Length Tokenization (RLT) aimed at optimizing video transformers by eliminating redundant tokens. This content-aware method results in substantial speed improvements for training and…

Slashdot: AI Lab PleIAs Releases Fully Open Dataset, as AMD, Ai2 Release Open AI Models

—

by

Source URL: https://news.slashdot.org/story/24/11/16/0326222/ai-lab-pleias-releases-fully-open-dataset-as-amd-ai2-release-open-ai-models?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: AI Lab PleIAs Releases Fully Open Dataset, as AMD, Ai2 Release Open AI Models Feedly Summary: AI Summary and Description: Yes Summary: The text outlines PleIAs’ commitment to open training for large language models (LLMs) through the release of Common Corpus, highlighting the significance of open data for LLM…

Simon Willison’s Weblog: NuExtract 1.5

—

by

Source URL: https://simonwillison.net/2024/Nov/16/nuextract-15/#atom-everything Source: Simon Willison’s Weblog Title: NuExtract 1.5 Feedly Summary: NuExtract 1.5 Structured extraction – where an LLM helps turn unstructured text (or image content) into structured data – remains one of the most directly useful applications of LLMs. NuExtract is a family of small models directly trained for this purpose, and released…

The Register: NASA and Microsoft intro Earth Copilot to tame satellite data overload

—

by

Source URL: https://www.theregister.com/2024/11/16/microsoft_nasa_earth_copilot/ Source: The Register Title: NASA and Microsoft intro Earth Copilot to tame satellite data overload Feedly Summary: Proof of concept allows geospatial datasets to be conversationally queried Speculation over where Microsoft would take the Copilot brand next can now end thanks to the announcement of Earth Copilot in partnership with NASA.… AI…

Cloud Blog: What’s new with HPC and AI infrastructure at Google Cloud

Nov 15, 2024

—

by