Distributed Tracing / OpenTelemetry: Testing Solace Implementation and trying our own

Options
kilbac
kilbac Member Posts: 6

Hey there,

we are trying to implement Distributed Tracing in our Solace Environment.

We are struggling to get your implementation (https://solace.community/discussion/1553/distributed-tracing-is-now-generally-available#latest) to run correctly. We have some questions:

  1. In your presentation video (https://youtu.be/0uwy26zPc-o?t=1607) you’re showing a Trace, with a Span from LegacyOrderManagementSystem. The trace contains other Spans (i.e. vmr-133-54), which are coming from the Solace Broker. This means a Context Propagation must have happened. Later it is the other way around: There’s a Span created by a solace broker and a custom open telemetry service is writing a span in the same trace. How is this implemented?
  2. We tried to implement Context Propagation on our own: We save the Span Context in the message we send in solace (in the correlationID), so we can propagate the context in a distributed environment. Are you doing it the same way? Is there a better way?
  3. Also we are using Nested Spans (parent<->child relationship) to connect spans. Are you doing the same?

Kind regards,

Kilian

Best Answer

  • marc
    marc Member, Administrator, Moderator, Employee Posts: 920 admin
    #2 Answer ✓
    Options

    Hi @kilbac,

    The currently released version (PubSub+ Event Broker Version 10.2) does not yet include context propagation or the creation of send spans (Broker -> Consumer). I believe those are both coming in the next release, but as @rtomkins said in the post you referenced above keep your eyes open for an EA that includes that functionality.

    I'm a bit confused by your question in (1) as the demo seems to end pretty quickly after the trace you're referring to, but I'd suggest reading through the docs that say what we are currently doing: https://docs.solace.com/Features/Distributed-Tracing/Distributed-Tracing-Overview.htm#Distributed_Tracing_Architecture

    Hope that helps!

    -Marc

Answers

  • marc
    marc Member, Administrator, Moderator, Employee Posts: 920 admin
    #3 Answer ✓
    Options

    Hi @kilbac,

    The currently released version (PubSub+ Event Broker Version 10.2) does not yet include context propagation or the creation of send spans (Broker -> Consumer). I believe those are both coming in the next release, but as @rtomkins said in the post you referenced above keep your eyes open for an EA that includes that functionality.

    I'm a bit confused by your question in (1) as the demo seems to end pretty quickly after the trace you're referring to, but I'd suggest reading through the docs that say what we are currently doing: https://docs.solace.com/Features/Distributed-Tracing/Distributed-Tracing-Overview.htm#Distributed_Tracing_Architecture

    Hope that helps!

    -Marc