{"id":22706795,"date":"2023-05-11T10:00:12","date_gmt":"2023-05-11T17:00:12","guid":{"rendered":"https:\/\/thenewstack.io\/?p=22706795"},"modified":"2023-05-11T07:54:22","modified_gmt":"2023-05-11T14:54:22","slug":"how-opensearch-visualizes-jaegars-distributed-tracing","status":"publish","type":"post","link":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/","title":{"rendered":"How OpenSearch Visualizes Jaeger’s Distributed Tracing"},"content":{"rendered":"\n

We all know how important observability is. Open source tooling is always a popular option. The complexity of selecting tooling is always a challenge. Typically, we end up with several best-of-breed tools in use in most organizations, which include many different projects and databases.<\/p>\n

As organizations continue to implement microservices-based architectures<\/a> and cloud native technologies, operational data is becoming increasingly large and complex. Because of the distributed nature of the data, the old approach of sorting through logs is not scalable.<\/p>\n

As a result, organizations are continuing to adopt distributed tracing<\/a> as a way of gaining insight into their systems. Distributed tracing helps determine where to start investigating issues and ultimately reduces the time spent on root cause analysis. It serves as an observability signal that captures the entire lifecycle of a particular request as it traverses distributed services. Traces can have multiple service hops, called spans<\/em>, that comprise the entire operation.<\/p>\n

Jaeger<\/h2>\n

One of the most popular open source solutions for distributed tracing is Jaeger<\/a>. Jaeger is an open source, end-to-end solution hosted by the Cloud Native Computing Foundation <\/a>(CNCF). Jaeger leverages data from instrumentation SDKs that are OpenTelemetry<\/a> (OTel) based and support multiple open source data stores, such as Cassandra and OpenSearch and Elasticsearch, for trace storage.<\/p>\n

While Jaeger does provide a UI solution for visualizing and analyzing traces along with monitoring data from Prometheus, OpenSearch<\/a> now provides the option to visualize traces in OpenSearch Dashboards, the native OpenSearch visualization tool.<\/p>\n

Trace Analytics<\/h2>\n

OpenSearch provides extensive support for log analytics and observability use cases. Starting with version 1.3, OpenSearch added support for distributed trace data analysis with the Observability feature. Using Observability, you can analyze the crucial rate, errors, and duration (RED) metrics in trace data. Additionally, you can evaluate various components of your system for latency and errors and pinpoint services that need attention.<\/p>\n

The OpenSearch Project launched the trace analytics feature with support for OTel-compliant trace data provided by Data Prepper — the OpenSearch server-side data collector. To incorporate the popular Jaeger trace data format, in version 2.5 OpenSearch introduced the trace analytics feature in Observability.<\/p>\n

With Observability, you can now filter traces to isolate the spans with errors in order to quickly identify the relevant logs. You can use the same feature-rich analysis capabilities for RED metrics, contextually linking traces and spans to their related logs, which are available for the Data Prepper trace data. The following image shows how you can view traces with Observability.<\/p>\n

\"\"<\/p>\n

Keep in mind that the OTel and Jaeger formats have several differences, as outlined in OpenTelemetry to Jaeger Transformation<\/a> in the OpenTelemetry documentation.<\/p>\n

Try It out<\/h2>\n

To try out this new feature, see the Analyzing Jaeger trace data<\/a> documentation. The documentation includes a Docker Compose file that shows you how to add sample data using a demo and then visualize it using trace analytics. To enable this feature, you need to set the `–es.tags-as-fields.all` flag to `true`, as described in the related GitHub issue<\/a>. This is necessary because of an OpenSearch Dashboards limitation<\/a>.<\/p>\n

In Dashboards, you can see the top service and operation combinations with the highest latency and the greatest number of errors. Selecting any service or operation will automatically direct you to the Traces<\/em> page with the appropriate filters applied, as shown in the following image. You can also investigate any trace or service on your own by applying various filters.<\/p>\n

\"\"<\/p>\n

Next Steps<\/h2>\n

To try the OpenSearch trace analytics feature, check out the OpenSearch Playground<\/a> or download the latest version of OpenSearch<\/a>. We welcome your feedback on the community forum<\/a>!<\/p>\n<\/body><\/html>\n","protected":false},"excerpt":{"rendered":"

We all know how important observability is. Open source tooling is always a popular option. The complexity of selecting tooling<\/p>\n","protected":false},"author":2404,"featured_media":22707133,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false},"categories":[9986,10059,12743],"tags":[6483],"acf":[],"yoast_head":"\nHow OpenSearch Visualizes Jaeger's Distributed Tracing - The New Stack<\/title>\n<meta name=\"description\" content=\"OpenSearch now provides the option to visualize Jaeger distributed traces within an OpenSearch Dashboard.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How OpenSearch Visualizes Jaeger's Distributed Tracing\" \/>\n<meta property=\"og:description\" content=\"OpenSearch now provides the option to visualize Jaeger distributed traces within an OpenSearch Dashboard.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\" \/>\n<meta property=\"og:site_name\" content=\"The New Stack\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/thenewstack\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-11T17:00:12+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-11T14:54:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cdn.thenewstack.io\/media\/2023\/05\/8907357f-open_search.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"800\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Derek Ho, Jonah Kowall\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@thenewstack\" \/>\n<meta name=\"twitter:site\" content=\"@thenewstack\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Derek Ho\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\"},\"author\":{\"name\":\"Derek Ho\",\"@id\":\"https:\/\/thenewstack.io\/#\/schema\/person\/313aec938907f1e49246219ced220452\"},\"headline\":\"How OpenSearch Visualizes Jaeger’s Distributed Tracing\",\"datePublished\":\"2023-05-11T17:00:12+00:00\",\"dateModified\":\"2023-05-11T14:54:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\"},\"wordCount\":606,\"publisher\":{\"@id\":\"https:\/\/thenewstack.io\/#organization\"},\"keywords\":[\"Contributed\"],\"articleSection\":[\"Microservices\",\"Observability\",\"Operations\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\",\"url\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\",\"name\":\"How OpenSearch Visualizes Jaeger's Distributed Tracing - The New Stack\",\"isPartOf\":{\"@id\":\"https:\/\/thenewstack.io\/#website\"},\"datePublished\":\"2023-05-11T17:00:12+00:00\",\"dateModified\":\"2023-05-11T14:54:22+00:00\",\"description\":\"OpenSearch now provides the option to visualize Jaeger distributed traces within an OpenSearch Dashboard.\",\"breadcrumb\":{\"@id\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/thenewstack.io\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How OpenSearch Visualizes Jaeger’s Distributed Tracing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/thenewstack.io\/#website\",\"url\":\"https:\/\/thenewstack.io\/\",\"name\":\"The New Stack\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/thenewstack.io\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/thenewstack.io\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/thenewstack.io\/#organization\",\"name\":\"The New Stack\",\"url\":\"https:\/\/thenewstack.io\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/thenewstack.io\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/cdn.thenewstack.io\/media\/2021\/11\/a9fbec84-the-new-stack-logo-rgb-screen.png\",\"contentUrl\":\"https:\/\/cdn.thenewstack.io\/media\/2021\/11\/a9fbec84-the-new-stack-logo-rgb-screen.png\",\"width\":1032,\"height\":128,\"caption\":\"The New Stack\"},\"image\":{\"@id\":\"https:\/\/thenewstack.io\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/thenewstack\",\"https:\/\/twitter.com\/thenewstack\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/thenewstack.io\/#\/schema\/person\/313aec938907f1e49246219ced220452\",\"name\":\"Derek Ho\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/thenewstack.io\/#\/schema\/person\/image\/163510344abffb8fbcd5c9883d0eb5e7\",\"url\":\"https:\/\/thenewstack.io\/wp-content\/uploads\/2023\/05\/1d782235-img_6086-96x96.png\",\"contentUrl\":\"https:\/\/thenewstack.io\/wp-content\/uploads\/2023\/05\/1d782235-img_6086-96x96.png\",\"caption\":\"Derek Ho\"},\"description\":\"Derek Ho graduated from UC Berkeley in 2020, where he studied computer science and statistics. He began his career at Intuit working on the QuickBooks Audit Log. In 2022, he joined the OpenSearch Project, working on the observability plugin and the trace analytics feature. In his free time he likes to run, read, and play strategy games. Derek wishes to contribute to open-source solutions solving big problems like tracing, observability, and search.\",\"url\":\"https:\/\/thenewstack.io\/author\/derekho\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How OpenSearch Visualizes Jaeger's Distributed Tracing - The New Stack","description":"OpenSearch now provides the option to visualize Jaeger distributed traces within an OpenSearch Dashboard.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/","og_locale":"en_US","og_type":"article","og_title":"How OpenSearch Visualizes Jaeger's Distributed Tracing","og_description":"OpenSearch now provides the option to visualize Jaeger distributed traces within an OpenSearch Dashboard.","og_url":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/","og_site_name":"The New Stack","article_publisher":"https:\/\/www.facebook.com\/thenewstack","article_published_time":"2023-05-11T17:00:12+00:00","article_modified_time":"2023-05-11T14:54:22+00:00","og_image":[{"width":1200,"height":800,"url":"https:\/\/cdn.thenewstack.io\/media\/2023\/05\/8907357f-open_search.png","type":"image\/png"}],"author":"Derek Ho, Jonah Kowall","twitter_card":"summary_large_image","twitter_creator":"@thenewstack","twitter_site":"@thenewstack","twitter_misc":{"Written by":"Derek Ho","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/#article","isPartOf":{"@id":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/"},"author":{"name":"Derek Ho","@id":"https:\/\/thenewstack.io\/#\/schema\/person\/313aec938907f1e49246219ced220452"},"headline":"How OpenSearch Visualizes Jaeger’s Distributed Tracing","datePublished":"2023-05-11T17:00:12+00:00","dateModified":"2023-05-11T14:54:22+00:00","mainEntityOfPage":{"@id":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/"},"wordCount":606,"publisher":{"@id":"https:\/\/thenewstack.io\/#organization"},"keywords":["Contributed"],"articleSection":["Microservices","Observability","Operations"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/","url":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/","name":"How OpenSearch Visualizes Jaeger's Distributed Tracing - The New Stack","isPartOf":{"@id":"https:\/\/thenewstack.io\/#website"},"datePublished":"2023-05-11T17:00:12+00:00","dateModified":"2023-05-11T14:54:22+00:00","description":"OpenSearch now provides the option to visualize Jaeger distributed traces within an OpenSearch Dashboard.","breadcrumb":{"@id":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/thenewstack.io\/how-opensearch-visualizes-jaegars-distributed-tracing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/thenewstack.io\/"},{"@type":"ListItem","position":2,"name":"How OpenSearch Visualizes Jaeger’s Distributed Tracing"}]},{"@type":"WebSite","@id":"https:\/\/thenewstack.io\/#website","url":"https:\/\/thenewstack.io\/","name":"The New Stack","description":"","publisher":{"@id":"https:\/\/thenewstack.io\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/thenewstack.io\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/thenewstack.io\/#organization","name":"The New Stack","url":"https:\/\/thenewstack.io\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thenewstack.io\/#\/schema\/logo\/image\/","url":"https:\/\/cdn.thenewstack.io\/media\/2021\/11\/a9fbec84-the-new-stack-logo-rgb-screen.png","contentUrl":"https:\/\/cdn.thenewstack.io\/media\/2021\/11\/a9fbec84-the-new-stack-logo-rgb-screen.png","width":1032,"height":128,"caption":"The New Stack"},"image":{"@id":"https:\/\/thenewstack.io\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/thenewstack","https:\/\/twitter.com\/thenewstack"]},{"@type":"Person","@id":"https:\/\/thenewstack.io\/#\/schema\/person\/313aec938907f1e49246219ced220452","name":"Derek Ho","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/thenewstack.io\/#\/schema\/person\/image\/163510344abffb8fbcd5c9883d0eb5e7","url":"https:\/\/thenewstack.io\/wp-content\/uploads\/2023\/05\/1d782235-img_6086-96x96.png","contentUrl":"https:\/\/thenewstack.io\/wp-content\/uploads\/2023\/05\/1d782235-img_6086-96x96.png","caption":"Derek Ho"},"description":"Derek Ho graduated from UC Berkeley in 2020, where he studied computer science and statistics. He began his career at Intuit working on the QuickBooks Audit Log. In 2022, he joined the OpenSearch Project, working on the observability plugin and the trace analytics feature. In his free time he likes to run, read, and play strategy games. Derek wishes to contribute to open-source solutions solving big problems like tracing, observability, and search.","url":"https:\/\/thenewstack.io\/author\/derekho\/"}]}},"_links":{"self":[{"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/posts\/22706795"}],"collection":[{"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/users\/2404"}],"replies":[{"embeddable":true,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/comments?post=22706795"}],"version-history":[{"count":8,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/posts\/22706795\/revisions"}],"predecessor-version":[{"id":22707933,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/posts\/22706795\/revisions\/22707933"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/media\/22707133"}],"wp:attachment":[{"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/media?parent=22706795"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/categories?post=22706795"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thenewstack.io\/wp-json\/wp\/v2\/tags?post=22706795"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}