Experimental News Clipping Site

Tag: model specifications

  • Simon Willison’s Weblog: DeepSeek_V3.pdf

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/26/deepseek-v3/#atom-everything Source: Simon Willison’s Weblog Title: DeepSeek_V3.pdf Feedly Summary: DeepSeek_V3.pdf The DeepSeek v3 paper (and model card) are out, after yesterday’s mysterious release of the undocumented model weights. Plenty of interesting details in here. The model pre-trained on 14.8 trillion “high-quality and diverse tokens" (not otherwise documented). Following this, we conduct post-training, including…

  • Simon Willison’s Weblog: deepseek-ai/DeepSeek-V3-Base

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/25/deepseek-v3/#atom-everything Source: Simon Willison’s Weblog Title: deepseek-ai/DeepSeek-V3-Base Feedly Summary: deepseek-ai/DeepSeek-V3-Base No model card or announcement yet, but this new model release from Chinese AI lab DeepSeek (an arm of Chinese hedge fund High-Flyer) looks very significant. It’s a huge model – 685B parameters, 687.9 GB on disk (TIL how to size a git-lfs…

  • Slashdot: Microsoft Announces Phi-4 AI Model Optimized for Accuracy and Complex Reasoning

    —

    by

    system automation
    in

    Source URL: https://slashdot.org/story/24/12/16/0313207/microsoft-announces-phi-4-ai-model-optimized-for-accuracy-and-complex-reasoning?utm_source=rss1.0mainlinkanon&utm_medium=feed Source: Slashdot Title: Microsoft Announces Phi-4 AI Model Optimized for Accuracy and Complex Reasoning Feedly Summary: AI Summary and Description: Yes **Summary:** Microsoft has introduced Phi-4, an advanced AI model optimized for complex reasoning tasks, particularly in STEM areas. With its robust architecture and safety features, Phi-4 underscores the importance of ethical…

  • Simon Willison’s Weblog: Phi-4 Technical Report

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Dec/15/phi-4-technical-report/ Source: Simon Willison’s Weblog Title: Phi-4 Technical Report Feedly Summary: Phi-4 Technical Report Phi-4 is the latest LLM from Microsoft Research. It has 14B parameters and claims to be a big leap forward in the overall Phi series. From Introducing Phi-4: Microsoft’s Newest Small Language Model Specializing in Complex Reasoning: Phi-4 outperforms…

  • Simon Willison’s Weblog: Pixtral Large

    —

    by

    system automation
    in

    Source URL: https://simonwillison.net/2024/Nov/18/pixtral-large/ Source: Simon Willison’s Weblog Title: Pixtral Large Feedly Summary: Pixtral Large New today from Mistral: Today we announce Pixtral Large, a 124B open-weights multimodal model built on top of Mistral Large 2. Pixtral Large is the second model in our multimodal family and demonstrates frontier-level image understanding. The weights are out on…