Python: Foundry studio doesnt show telemetry details in the "Monitoring -> Application analytics"

[saurabhvartak1982]

Backdrop:

AI Agents are created using the Agent Framework using AzureOpenAI-based Chat/Responses client. Observability is set using setup_observability(). Agent developed in Python

Issue:

Foundry studio doesnt show telemetry details in the "Monitoring -> Application analytics"

[alliscode]

@TaoChenOSU do you know if we should expect the telemetry of an AOAI chat completion agent to show up here?

[TaoChenOSU]

Hi @saurabhvartak1982,

Do you see the traces under the Tracing tab (right above the Monitor tab)?

[saurabhvartak1982]

Hi @TaoChenOSU ,

Yes, I am able to see the traces under the Tracing tab.

I am also able to see the metrics in the tab (next to "Application analytics" tab) -- Monitoring -> Resource usage

[TaoChenOSU]

Hi @saurabhvartak1982,

The traces shown in the trace tab will be the traces produced by your application.

[saurabhvartak1982]

Hi @TaoChenOSU ,

Thank you for helping me on this.
Wanted to know what would be the expected behaviour in the Monitoring tab. Do we expect the telemetry to show up if I am using Agent Framework with AOAI Completion/Responses client? Or is it just for the AzureAIAgent client?

[moonbox3]

Looks like for the Foundry Classic portal, the aka.ms link points to: https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/monitor-applications?view=foundry-classic which contains the steps to setup monitoring for Foundry projects.

[saurabhvartak1982]

Hi @moonbox3 ,

Thank you for helping me on this.
The steps mentioned in the documentation provided have been already carried out. I will need to see if the tab is getting populated if I make use of the AzureAIAgent client. My current try has been with the AOAI Completion/Responses client.

Thank you again.

[TaoChenOSU]

Hi @TaoChenOSU ,

Thank you for helping me on this. Wanted to know what would be the expected behaviour in the Monitoring tab. Do we expect the telemetry to show up if I am using Agent Framework with AOAI Completion/Responses client? Or is it just for the AzureAIAgent client?

The Monitoring tab will be for tracking model performance, such as token consumption, latency, and evaluation (in the future). The data comes from server side.

Tracing is different from these performance data.