batch processing – Page 2 – Experimental News Clipping Site

Simon Willison’s Weblog: Anthropic: Message Batches (beta)

Oct 8, 2024

—

by

Source URL: https://simonwillison.net/2024/Oct/8/anthropic-batch-mode/ Source: Simon Willison’s Weblog Title: Anthropic: Message Batches (beta) Feedly Summary: Anthropic: Message Batches (beta) Anthropic now have a batch mode, allowing you to send prompts to Claude in batches which will be processed within 24 hours (though probably much faster than that) and come at a 50% price discount. This matches…

Hacker News: Show HN: Open-source text classification CLI – train models with no labeled data

Sep 20, 2024

—

by

system automation

in Uncategorized

Source URL: https://github.com/taylorai/aiq Source: Hacker News Title: Show HN: Open-source text classification CLI – train models with no labeled data Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text describes a command-line interface (CLI) tool named “aiq,” which is designed for processing text data through embedding, labeling, training classifiers, and classifying text. With…

The Register: Cerebras gives waferscale chips inferencing twist, claims 1,800 token per sec generation rates

Aug 27, 2024

—

by

system automation

in Uncategorized

Source URL: https://www.theregister.com/2024/08/27/cerebras_ai_inference/ Source: The Register Title: Cerebras gives waferscale chips inferencing twist, claims 1,800 token per sec generation rates Feedly Summary: Faster than you can read? More like blink and you’ll miss the hallucination Hot Chips Inference performance in many modern generative AI workloads is usually a function of memory bandwidth rather than compute.…

Tag: batch processing

Simon Willison’s Weblog: Anthropic: Message Batches (beta)

Hacker News: Show HN: Open-source text classification CLI – train models with no labeled data

The Register: Cerebras gives waferscale chips inferencing twist, claims 1,800 token per sec generation rates