Experimental News Clipping Site

Tag: Transformer-based

Hacker News: A ChatGPT clone, in 3000 bytes of C, backed by GPT-2

Dec 12, 2024

—

by

system automation

in Uncategorized

Source URL: https://nicholas.carlini.com/writing/2023/chat-gpt-2-in-c.html Source: Hacker News Title: A ChatGPT clone, in 3000 bytes of C, backed by GPT-2 Feedly Summary: Comments AI Summary and Description: Yes Summary: The provided text discusses a minimal implementation of the GPT-2 model in C, detailing the underlying architecture, supporting libraries, and operational principles of a transformer-based neural network. It…
Hacker News: Tencent drops a 389B MoE model(Open-source and free for commercial use))

Nov 5, 2024

—

by

system automation

in Uncategorized

Source URL: https://github.com/Tencent/Tencent-Hunyuan-Large Source: Hacker News Title: Tencent drops a 389B MoE model(Open-source and free for commercial use)) Feedly Summary: Comments AI Summary and Description: Yes **Summary:** The text introduces the Hunyuan-Large model, the largest open-source Transformer-based Mixture of Experts (MoE) model, developed by Tencent, which boasts 389 billion parameters, optimizing performance while managing resource…