Python: setup_observability() doesnt show end-to-end traces in case of multi-agent workflows

[saurabhvartak1982]

Backdrop:

I have the below 2 multi-agent scenarios written using Agent Framework:

1. Workflow (AI) -> AI Agent (over A2A)
2. AI Agent -> AI Agent (over A2A)

Every Workflow/Agent is running as an independent process.

setup_observability() is set in the code for setting up observability

Issue:

Not able to see the complete end-to-end traceability for both the mentioned scenarios in Azure Monitor Application Insights. Say if a calling agent is invoking a called agent, then the spans for both the agents should be visible in the same view in Azure Monitor Application Insights.
Attached images show the Expected and Observed traces.

[TaoChenOSU]

Hi @saurabhvartak1982,

Could you provide more details on how you set up the agents and workflows and how you instrument your code such that I can assist you further?

[saurabhvartak1982]

Hi @TaoChenOSU ,

1. For the scenario which is not working, I am making use of setup_observability() - as I thought it sets up the default params for all the 3 observability signals.
   Imports: from agent_framework.observability import get_tracer, setup_observability

2. For the working scenario, in addition to the setup_observability(), I am doing the below:
   configure_azure_monitor(
   connection_string=os.environ.get("APPLICATIONINSIGHTS_CONNECTION_STRING"),
   resource=Resource.create({"service.name": "client-agent"}), # rename if you want
   )

setup_observability()

instrument httpx globally for this process

HTTPXClientInstrumentor().instrument()

tracer = get_tracer()

Packages:
from azure.monitor.opentelemetry import configure_azure_monitor
from opentelemetry.instrumentation.httpx import HTTPXClientInstrumentor

The steps mentioned in point 2. help me get an end-to-end trace in the Agent-Agent scenario. But in case of Workflow-Agent scenario, it doesnt work.

All the calls are over A2A protocol.

Thank you for helping me and please let me know if any other information is needed.

[TaoChenOSU]

Hi @saurabhvartak1982,

Please call setup_observability with a connection string or make sure the APPLICATIONINSIGHTS_CONNECTION_STRING environment variable is accessible in your script.

If you call setup_observability, you no longer need to call configure_azure_monitor.

Hope this helps.

[saurabhvartak1982]

Hi @TaoChenOSU ,

Thank you for helping me on this.

I am indeed making use of setup_observability() with env variable APPLICATIONINSIGHTS_CONNECTION_STRING properly set.
But this doesnt give me the end-to-end traceability.
Using setup_observability() I am able to see individual traces by all the agents in the chain. But it doesnt show the combined traces.

The same is shown in the diagrams that I had uploaded where the first diagram is what I am expecting (showing end-to-end trace).