Tag: Cloud Composer

  • Cloud Blog: What’s new with Google Data Cloud

    Source URL: https://cloud.google.com/blog/products/data-analytics/whats-new-with-google-data-cloud/ Source: Cloud Blog Title: What’s new with Google Data Cloud Feedly Summary: June 9 – June 13 Introducing Pub/Sub Single Message Transforms (SMTs), to make it easy to perform simple data transformations such as validate, filter, enrich, and alter individual messages as they move in real time right within Pub/Sub. The first…

  • Cloud Blog: Cloud Composer 3: The next generation of data pipeline orchestration

    Source URL: https://cloud.google.com/blog/products/data-analytics/cloud-composer-3-for-apache-airflow/ Source: Cloud Blog Title: Cloud Composer 3: The next generation of data pipeline orchestration Feedly Summary: As any data team can tell you, managing Apache Airflow is often a complex undertaking, with many hours spent wrestling with reliability, security, and efficient resource scaling. This valuable time could be better spent deriving insights…

  • Cloud Blog: 10 months to innovation: Definity’s leap to data agility with BigQuery and Vertex AI

    Source URL: https://cloud.google.com/blog/products/databases/definitys-leap-to-data-agility-with-bigquery-and-vertex-ai/ Source: Cloud Blog Title: 10 months to innovation: Definity’s leap to data agility with BigQuery and Vertex AI Feedly Summary: At Definity, a leading Canadian P&C insurer with a history spanning over 150 years, we have a long tradition of innovating to help our customers and communities adapt and thrive. To stay…

  • Cloud Blog: Apache Airflow ETL in Google Cloud

    Source URL: https://cloud.google.com/blog/products/data-analytics/different-ways-to-run-apache-airflow-on-google-cloud/ Source: Cloud Blog Title: Apache Airflow ETL in Google Cloud Feedly Summary: Are you thinking about running Apache Airflow on Google Cloud? That’s a popular choice for running a complex set of tasks, such as Extract, Transform, and Load (ETL) or data analytics pipelines. Apache Airflow uses a Directed Acyclic Graph (DAG)…