Dynatrace is expanding its existing platform with AI Observability, a new solution that helps companies gain visibility and control over all layers of AI-powered applications. This means Dynatrace can now offer a comprehensive monitoring and security solution for large language models (LLMs) and generative AI-powered applications. The enhancement enables companies to safely and cost-effectively deploy generative AI – while increasing performance, innovation, productivity and revenue.

– Generative AI has enormous potential, but we need to gain control over whether AI investments are truly successful and avoid the risk of unpredictable behavior, AI hallucinations and poor user experiences, says Johan Dahlin, Nordic Head at Dynatrace.

– This further strengthens our leadership in application security and observability. The old solutions that people have been dependent on have created a fragmented way of controlling their digital channels and applications. With Dynatrace AI Observability, you no longer have to live with fragmented data, fragmented processes and lack of insights, but everything is gathered in a common platform. This has not been possible before, continues Johan Dahlin.

Advertisement

Dynatrace AI Observability Dynatrace leverages AI solution Davis and other core technologies to provide an accurate and complete view of AI-powered applications. This improves user experiences while automatically identifying performance issues, security risks, and root causes.

The solution also makes it easier to comply with privacy, security, and compliance standards by tracking the origin of data created by apps. It also helps predict and control costs by monitoring consumption of so-called tokens, which are the basis generative AI models use to handle queries (and which drive costs).

Cost concerns for generative AI-powered services

According to Gartner, AI will lead to over 50 percent of cloud computing resources being dedicated to AI workloads by 2028, compared to less than 10 percent in 2023.

The growth partly reflects the growing interest in generative AI when looking to improve efficiency, productivity, automation and fostering innovation. Despite that, many business and organizations are concerned about the costs associated with generative AI-powered services. They can be many times more expensive than traditional cloud services and difficult to predict because they are based on the consumption of generative AI tokens and applications that are not yet in production. At the same time, governments around the world are introducing regulations for our use AI technology in a responsible and ethical manner – and in accordance with applicable laws.

– Generative AI enables the creation of innovative solutions that increase productivity, profitability and competitiveness. But it also brings new challenges in security, transparency, reliability, user experiences and cost management. Organizations therefore need to get a complete overview of all their generative AI solutions and now we are expanding our offering in monitoring and AI to meet this need, says Bernd Greifeneder, CTO at Dynatrace.

– AI-driven transformation is a key driver of productivity and competitiveness for organizations worldwide. Microsoft “Azure OpenAI Service is a robust generative AI solution for enterprises and the public sector worldwide. We are excited to partner with Dynatrace, a leader in AI-powered monitoring, to empower our mutual customers driving innovation in the world’s largest organizations to create generative AI-based services using Azure Open AI Service and Dynatrace AI Observability. Together, they help ensure AI services meet the highest standards of security, reliability, and performance, while helping teams control their costs,” said Ali Dalloul, VP, AI at Microsoft.

Dynatrace AI Observability covers the entire AI stack, including infrastructure like Nvidia GPUs, foundational models like GPT4, semantic caches, and vector databases like Weaviate. It also supports major platforms for building, training, and delivering AI models like Microsoft Azure OpenAI Service, Amazon SageMaker and Google AI Platform.

Dynatrace AI Observability is available to all Dynatrace customers. Visit Dynatrace website for the current list of technologies and integrations supported by Dynatrace AI Observability. Visit the Dynatrace AI Observability blog for further information about the solution.