Source URL: https://cloud.google.com/blog/products/application-modernization/eventarc-advanced-orchestrates-complex-microservices-environments/
Source: Cloud Blog
Title: Simplify complex eventing at Scale with Eventarc Advanced
Feedly Summary: Modern application development requires organizations to invest not only in scale but also in simplification and central governance. This means more than message routing; it requires a simple, unified messaging platform that can intelligently filter, transform, and govern the flow of information in real-time, taming complexity all in one place.
Today, we are excited to announce the general availability of Eventarc Advanced, a unified, serverless eventing platform that goes beyond simple routing by combining real-time filtering, transformation, management, and delivery in one place — for a complex, multi-source event-driven architecture.
Evolving Eventarc to handle complexity
Eventarc Advanced is an evolution of Eventarc Standard and offers out-of-the-box integration patterns to simplify your eventing needs.
With Eventarc Advanced, organizations can
Integrate existing services using Publish API and leverage Google Cloud events to build sophisticated event-driven applications.
Centrally manage, secure, and observe the flow of messages across services with support for per-message fine-grained access control.
Intelligently route messages to appropriate destinations based on flexible message criteria.
Transform and convert events in real-time, with support for multiple payload formats and built-in capability to transform event attributes.
Publish to Google Cloud services using HTTP binding.
With Eventarc Advanced, you can build sophisticated eventing systems. In contrast, Eventarc Standard is best for simple one-to-one eventing needs involving Google Cloud events (comparison).
Eventarc Advanced’s key technical features include:
Publish API to ingest custom and third-party messages using CloudEvents format (details).
Message bus that acts as the central nervous system of your event-driven architecture, providing centralized observability, security and management. Message bus is based on Envoy and uses the policy engine of Cloud Load Balancers and Cloud Service Mesh.
Your existing systems can publish messages to a central message bus that can be intelligently routed to appropriate consumers based on flexible criteria. The message bus simplifies event management and reduces operational overhead.
You can gain insights into your message flows with centralized monitoring, logging, and tracing capabilities. Logs are captured in Cloud Logging, providing detailed information about event processing and errors.
Out-of-the-box event mediation capabilities to adapt messages on the fly without modifying your source or destination services, and to handle different events through support for multiple payload formats (Avro, JSON, Protobuf) and built-in capability to transform event attributes.
Eventarc Advanced incorporates error-handling by offering reliable event delivery and graceful recovery from transient failures.
Empowering developers and operators
We designed Eventarc Advanced to cater to the needs of both developers and operators:
“Simplicity” for developers: Focus on building your core application features, not on complex event routing logic. Eventarc Advanced provides a unified API and a consistent experience, letting you build decoupled, reliable, and scalable services including real-time transformations.
“Centralized governance” for platform operators: Simplify the setup and management of your eventing infrastructure. Centralized governance across projects / teams, plus monitoring and logging make it easier to identify and resolve issues, reducing operational overhead.
How Eventarc Advanced works
Imagine an order processing system where orders are created, payments are processed, and items are shipped. Each action is an “event," and in a complex system, managing this flow can be challenging. This is where Eventarc Advanced comes in. It provides a centralized way to manage, observe, and route all your application’s events. Let’s explore how it works.
Set up your message busAt the heart of Eventarc Advanced is a message bus that acts as the central nervous system for your event-driven application. Every event, regardless of its origin, is sent to the message bus to be analyzed and routed. This central hub is where you can define security policies, controlling exactly who can send events and what kind are allowed.
In our example, you would create a message bus to receive all order-related events. Whether an order is newly created, its payment is confirmed, or its status changes to "shipped," the events land here.
Connect your event sourcesNext, connect your sources that generate order events. Event sources are the services and applications that generate events and feed them into your message bus. Eventarc Advanced makes this easy, supporting a wide range of sources, including:
Google API events
External apps or custom systems via Publish API
In our example, the event source could be a custom service using the Publish API. Every time a new order is saved or an existing one is updated, it automatically sends an event to your message bus.
Configure pipelines and destinationsThis is another area where Eventarc Advanced shines. With events flowing into your message bus, you can configure pipelines to intelligently route them to the correct destinations, allowing you to filter, transform, and direct events with precision.
In the above example,
New order notification: You can set up a filter that looks for events with status: "new". This pipeline routes these events to a notification service that sends an order confirmation email to the customer.
Fraud detection: For high-value orders (e.g., amount > $1000), you can apply a transformation and route it to a specialized fraud detection service for analysis.
Unlocking new possibilities
Eventarc Advanced opens up new possibilities for your applications and workflows:
Large-scale application integration: Connect numerous services and agents, enabling them to communicate asynchronously and reliably, even across different event formats and schemas.
Event streaming for AI and analytics: Handle the influx of data from IoT devices and AI workloads by filtering and transforming them before feeding them into your analytics pipelines.
Hybrid and multi-cloud deployments: Extend your event-driven architectures beyond Google Cloud, integrating with on-premises systems and other cloud providers.
What’s next
As today’s applications become increasingly agentic, distributed and data-driven, the need for efficient and secure event orchestration is more critical than ever. With upcoming native support for Service Extensions to insert custom code into the data path and services like Model Armor, Eventarc Advanced’s message bus provides security and networking controls for agent communications.
Eventarc Advanced is available today. To learn more about Eventarc Advanced, see the documentation. To learn more about event-driven architectures, visit our Architecture Center based on Google Cloud best practices. Get ready to take your event-driven architectures to the next level!
AI Summary and Description: Yes
Summary: The text presents Eventarc Advanced, a unified serverless eventing platform by Google Cloud designed to streamline application development through centralized event management and security. Its advanced features allow for real-time event transformation, intelligent message routing, and fine-grained access control, enhancing the complexity-handling capabilities of event-driven architectures for developers and operators.
Detailed Description:
The announcement centers around the launch of Eventarc Advanced, a more sophisticated version of its predecessor, Eventarc Standard. This platform is designed to address the needs of modern application architecture, which requires both flexibility in handling events and a robust governance model to manage data flow securely.
Key Points:
– **Unified Messaging Platform**:
– Eventarc Advanced combines several functionalities — real-time filtering, transformation, management, and delivery — to facilitate complex, multi-source event-driven architectures.
– **Core Functionalities**:
– **Integration with Existing Services**: Organizations can integrate services using a Publish API and leverage Google Cloud events to build event-driven applications.
– **Centralized Management and Security**: The platform provides fine-grained access control for message flow management across services.
– **Real-Time Event Transformation**: It supports multiple payload formats and allows for real-time transformations, enabling quick adaptations in various workflows.
– **Technical Features**:
– The message bus serves as the central nervous system of the event-driven architecture with capabilities for observability, security, and management.
– A focus on centralized monitoring and logging through Cloud Logging provides insights into message processing and issues.
– Built-in capabilities for error handling ensure reliable event delivery and recovery from transient failures.
– **Target Audience**:
– **For Developers**: Streamlines event routing, allowing developers to focus on core application features instead of complex logistics.
– **For Operators**: Centralized governance tools facilitate simpler event management and reduce operational overhead.
– **Use Cases and Configurations**:
– Example use cases include an order processing system where various events (like order creation, payment confirmation, etc.) are managed through the message bus.
– The system allows configuration of pipelines to intelligently direct events based on specific criteria.
– **Future Capabilities**:
– The platform is prepared to support hybrid and multi-cloud deployments, catering to the increasing demand for interconnected systems across various environments.
– Upcoming features, such as native support for Service Extensions for custom code insertion in data paths, further enhance security and functionality for agent communications.
Eventarc Advanced represents a significant leap for organizations looking to modernize their event management practices to support complex, data-driven applications while ensuring security and governance compliance. Security and compliance professionals should pay attention to its centralized governance features, which offer enhanced visibility and control in event management, vital for maintaining regulatory compliance in today’s data-centric environments.