This presentation will introduce participants to the concept of open-source observability and tailor it LLM applications, highlighting the advantages of leveraging the open-source ecosystem for comprehensive system insights.

We will delve into the openllmetry project, a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions that you already have at your monitoring stack - like for datadog, Honeycomb, and others.

Best practices for deployment, monitoring, and performance optimization will be shared, along with real-world case studies demonstrating the impact of effective observability on LLM applications, with sample trace chains built with LangChain and Redis a vector store.