Tag: performance improvement
-
Simon Willison’s Weblog: lm.rs: run inference on Language Models locally on the CPU with Rust
Source URL: https://simonwillison.net/2024/Oct/11/lmrs/ Source: Simon Willison’s Weblog Title: lm.rs: run inference on Language Models locally on the CPU with Rust Feedly Summary: lm.rs: run inference on Language Models locally on the CPU with Rust Impressive new LLM inference implementation in Rust by Samuel Vitorino. I tried it just now on an M2 Mac with 64GB…
-
Hacker News: Io_uring and seccomp (2022)
Source URL: https://blog.0x74696d.com/posts/iouring-and-seccomp/ Source: Hacker News Title: Io_uring and seccomp (2022) Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses the Linux `io_uring` interface for asynchronous I/O and its interaction with seccomp filtering, highlighting both performance benefits and potential security implications for applications relying on syscalls. This insight is particularly relevant for…
-
The Register: AMD pumps Epyc core count to 192, clocks up to 5 GHz with Turin debut
Source URL: https://www.theregister.com/2024/10/10/amd_epyc_turin/ Source: The Register Title: AMD pumps Epyc core count to 192, clocks up to 5 GHz with Turin debut Feedly Summary: Just not on the same chip, of course Intel’s 128-core Granite Rapids Xeons are barely two weeks old and AMD has already fired back with a family of fifth-gen Epycs that…
-
The Register: MediaTek enters the 4th Dimensity with 3nm octa-core 9400 smartphone brains
Source URL: https://www.theregister.com/2024/10/09/mediatek_dimensity_9400/ Source: The Register Title: MediaTek enters the 4th Dimensity with 3nm octa-core 9400 smartphone brains Feedly Summary: Still sticking with Arm and not taking RISC-Vs Fabless Taiwanese chip biz MediaTek has unveiled the fourth flagship entry in its Dimensity family of system-on-chips for smartphones and other mobile devices. It’s sticking with close…
-
Cloud Blog: Introducing ScaNN in BigQuery vector search for large query batches
Source URL: https://cloud.google.com/blog/products/data-analytics/introducing-scann-in-bigquery-vector-search-for-large-query-batches/ Source: Cloud Blog Title: Introducing ScaNN in BigQuery vector search for large query batches Feedly Summary: We continue to add more capabilities to BigQuery to make it the AI-ready data platform for the Gemini era. Earlier this year, we introduced vector search, which enables vector similarity search on BigQuery data. Since then,…