Skip to content

Revise Foundry agent creation, permissions, and integration instructions - #249

Open
v-vfarias wants to merge 27 commits into
MicrosoftLearning:mainfrom
v-vfarias:main
Open

Revise Foundry agent creation, permissions, and integration instructions#249
v-vfarias wants to merge 27 commits into
MicrosoftLearning:mainfrom
v-vfarias:main

Conversation

@v-vfarias

Copy link
Copy Markdown
Contributor

This pull request updates the instructions and starter code for the "Observe, evaluate, and secure your agents" lab to streamline agent setup, clarify Application Insights usage, and ensure consistency across all tasks. The changes unify the workflow so that all tasks use the same grounded agent, improve clarity around tracing (distinguishing between server-side and client-side traces), and update code and documentation to match the new approach.

Key changes include:

Unified agent workflow and documentation

  • All tasks now use the same grounded agent (caldova-knowledge-agent), eliminating the creation and deletion of separate test agents in Task 1. Instructions and code have been updated throughout to reflect this unified approach. [1] [2] [3] [4] [5]
  • The "Getting started" instructions now guide users to clone the repo before provisioning with azd and clarify that every task uses the same agent. [1] [2] [3]

Application Insights and tracing clarity

  • Documentation now clearly distinguishes between Foundry's server-side traces (visible in the portal) and custom client-side spans (visible in Application Insights), guiding users on where to view each. [1] [2] [3] [4]
  • The Application Insights connection instructions have been moved to after agent setup to better match the new workflow. [1] [2]

Code and environment changes

  • Task 1 and Task 3 code now looks up the existing agent rather than creating/deleting a new one. The agent_reference object now includes both name and id for trace correlation. [1] [2] [3] [4]
  • Removed references to creating or deleting agents in Task 1 code and instructions. [1] [2] [3]

Evaluation task improvements

  • Updated evaluation instructions and code to use ${target.response} instead of ${outputs.response} for clarity and correctness. [1] [2]
  • Clarified that all tasks require the agent to be set in the environment, not just Tasks 2 and 3. [1] [2]

These updates ensure a smoother, more consistent experience for users and make it easier to understand and correlate tracing data across Foundry and Application Insights.

v-vfarias and others added 26 commits April 27, 2026 12:33
…nt creation exercise

Co-authored-by: Copilot <copilot@github.com>
…port

Co-authored-by: Copilot <copilot@github.com>
Update requirements and improve agent configuration instructions
Revise agent creation and workflow instructions for Foundry
Revise Foundry agent creation and permissions instructions
…plementing a loop for multiple approval requests and updating related documentation.
…les and refine agent integration instructions
- Corrected variable names in evaluation instructions from `outputs` to `target` for consistency.
- Changed output file handling in red team agent script to use a directory for results.
- Updated requirements to specify the correct agent framework version.
@v-vfarias
v-vfarias requested a review from ivorb August 28, 2026 12:58
Add the orchestration package required by the multi-agent lab and align the evaluation solution with target response mappings.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@v-vfarias
v-vfarias marked this pull request as ready for review August 31, 2026 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants