AI performance monitoring from Datadog and Vertex AI
Thursday, November 16, 2023
Richard Harris |
Datadog has expanded its strategic partnership with Google Cloud and integrated with Vertex AI allowing AI ops teams and developers to monitor, analyze, and optimize the performance of their machine learning models in production.
Datadog, Inc., the monitoring and security platform for cloud applications, announced an expanded strategic partnership with Google Cloud, which enables Google Cloud customers to proactively observe and secure their cloud-native and hybrid applications within Datadog’s unified platform. As part of the expanded partnership and integrations, Datadog is one of the first AI/ML observability solution partners for Vertex AI, allowing AI ops teams and developers to monitor, analyze, and optimize the performance of their machine learning models in production.
"Google Cloud continues to be a key partner for Datadog as we jointly help global businesses observe and secure their cloud applications. The new Vertex AI integration expands this partnership and gives AI and ML developers full observability into their production applications built on Vertex AI. With out-of-the-box dashboards and real-time monitors, customers can get started quickly and ensure their models are performing optimally while delivering predictions responsively at scale and without errors," said Amit Agarwal, President at Datadog.
Datadog expands strategic partnership with Google Cloud and integrates with Vertex AI
"Generative AI is fundamentally changing how many businesses operate, fueling a new era of cloud that can benefit virtually every area of an organization. With this new integration, AI teams can improve how they monitor and analyze the performance of machine learning applications built on Vertex AI, ensuring they are functioning correctly and creating optimal value," said Kevin Icchpurani, Corporate VP, Global Partner Ecosystem & Channels at Google Cloud.
Datadog’s integration with Vertex AI provides developers with full observability of the prediction performance and resource utilization of their custom AI/ML models. The integration provides an out-of-the-box dashboard with prediction counts, latency, errors, and resource (CPU/Memory/Network) utilization grouped by deployed models so teams can compare model performance side-by-side in production environments. It also helps detect data anomalies in order to maintain the reliability and robustness of machine learning applications.
Other new and expanded Google Cloud integrations that were recently announced include:
Serverless monitoring: Datadog now offers in-depth support for Google Cloud Run - the leading serverless computing technology on Google Cloud. With native distributed tracing across all runtimes and the ability to collect custom metrics and logs, Datadog provides deep insights into customers’ Cloud Run workloads and fully managed APIs, queues, streams, and data stores.
Google Cloud Ready - CloudSQL: Datadog has earned the Google Cloud Ready designation for the Google Cloud SQL integration, providing visibility into the performance and health of CloudSQL to customers. This integration monitors throughput, memory, and availability metrics in customers’ databases from MySQL, PostgreSQL, and SQL Server.
Google Security Command Center: Customers can now send their Google Cloud Security Command Center findings to Datadog, including vulnerabilities, threats, and errors from containers and virtual machines. Using Datadog Cloud SIEM, customers can automatically generate signals and perform investigations.
Quick setup: Datadog’s new setup experience allows Google Cloud customers to get started in just seconds so they can monitor their entire Google Cloud environment, even when there are thousands of projects. New projects can also be auto-discovered to ensure complete and seamless monitoring coverage. Customers can begin monitoring their services in just a few clicks with out-of-the-box dashboards and real-time monitors on over 30+ Google Cloud integrations.
These integrations are available now. To learn more about how Datadog helps organizations observe and secure their Google Cloud environments, please visit: https://www.datadoghq.com/solutions/gcp/.
Become a subscriber of App Developer Magazine for just $5.99 a month and take advantage of all these perks.
MEMBERS GET ACCESS TO
- - Exclusive content from leaders in the industry
- - Q&A articles from industry leaders
- - Tips and tricks from the most successful developers weekly
- - Monthly issues, including all 90+ back-issues since 2012
- - Event discounts and early-bird signups
- - Gain insight from top achievers in the app store
- - Learn what tools to use, what SDK's to use, and more
Subscribe here