Experimental News Clipping Site

Tag: accelerator

  • Cloud Blog: Train AI for less: Improve ML Goodput with elastic training and optimized checkpointing

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/ai-machine-learning/elastic-training-and-optimized-checkpointing-improve-ml-goodput/ Source: Cloud Blog Title: Train AI for less: Improve ML Goodput with elastic training and optimized checkpointing Feedly Summary: Want to save some money on large AI training? For a typical PyTorch LLM training workload that spans thousands of accelerators for several weeks, a 1% improvement in ML Goodput can translate to…

  • Cloud Blog: How Confidential Computing lays the foundation for trusted AI

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/identity-security/how-confidential-computing-lays-the-foundation-for-trusted-ai/ Source: Cloud Blog Title: How Confidential Computing lays the foundation for trusted AI Feedly Summary: Confidential Computing has redefined how organizations can securely process their sensitive workloads in the cloud. The growth in our hardware ecosystem is fueling a new wave of adoption, enabling customers to use Confidential Computing to support cutting-edge…

  • The Register: Nvidia CEO Jensen Huang labels US GPU export bans ‘precisely wrong’ and ‘a failure’

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/05/21/jensen_huang_h20_ban_criticism/ Source: The Register Title: Nvidia CEO Jensen Huang labels US GPU export bans ‘precisely wrong’ and ‘a failure’ Feedly Summary: Argues the world needs China’s AI researchers working on his chips so the rest of us benefit Computex Nvidia CEO Jensen Huang has said the USA’s ban on exports of his company’s…

  • Cloud Blog: Google AI Edge Portal: On-device machine learning testing at scale

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/ai-machine-learning/ai-edge-portal-brings-on-device-ml-testing-at-scale/ Source: Cloud Blog Title: Google AI Edge Portal: On-device machine learning testing at scale Feedly Summary: Today, we’re excited to announce Google AI Edge Portal in private preview, Google Cloud’s new solution for testing and benchmarking on-device machine learning (ML) at scale.  Machine learning on mobile devices enables amazing app experiences. But…

  • Cloud Blog: Introducing the next generation of AI inference, powered by llm-d

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/ai-machine-learning/enhancing-vllm-for-distributed-inference-with-llm-d/ Source: Cloud Blog Title: Introducing the next generation of AI inference, powered by llm-d Feedly Summary: As the world transitions from prototyping AI solutions to deploying AI at scale, efficient AI inference is becoming the gating factor. Two years ago, the challenge was the ever-growing size of AI models. Cloud infrastructure providers…

  • The Register: Wanted: A handy metric for gauging if GPUs are being used optimally

    —

    by

    Kurt Seifried
    in

    Source URL: https://www.theregister.com/2025/05/20/gpu_metric/ Source: The Register Title: Wanted: A handy metric for gauging if GPUs are being used optimally Feedly Summary: Even well-optimized models only likely to use 35 to 45% of compute the silicon can deliver GPU accelerators used in AI processing are costly items, so making sure you get the best usage out…

  • Cloud Blog: AI Hypercomputer developer experience enhancements from Q1 25: build faster, scale bigger

    —

    by

    Kurt Seifried
    in

    Source URL: https://cloud.google.com/blog/products/compute/ai-hypercomputer-enhancements-for-the-developer/ Source: Cloud Blog Title: AI Hypercomputer developer experience enhancements from Q1 25: build faster, scale bigger Feedly Summary: Building cutting-edge AI models is exciting, whether you’re iterating in your notebook or orchestrating large clusters. However, scaling up training can present significant challenges, including navigating complex infrastructure, configuring software and dependencies across numerous…