Dynamic mcp handling

[jdecker76]

refs #289

Adds comprehensive MCP server polling and dynamic agent management

• Fast Agent will no longer crash when it tries to load an agent where a dependent MCP Server is not available
• New polling system can poll MCP servers and activate/deactivate agents dynamically based on MCP server availability (polling is off by default)
• Introduces new FastAgent parameter mcp_polling_interval, which defaults to None (I.e. polling disabled by default)
• Implement simple agent status management when polling is enabled:
  • Deactivate agents when their servers go offline during runtime
  • Reactivate agents when their servers come back online
• Updated progress display:
  • Show the MCP Server Polling in the progress display
  • Show "Deactivated" status when polling is disabled
  • Show "Running" during active server health checks
  • Show "Ready" between cycles
• Give users full control over polling frequency vs performance trade-offs - they can set choose whether to enable polling, and use an interval that works best for their situation

This provides comprehensive MCP server monitoring with automatic agent lifecycle
management while maintaining zero performance impact by default.

If this is considered for inclusion in Fast Agent, I will update the docs repo

[jdecker76]

Here you can see that the MCP Server Polling is in Ready state, and the mcp_test agent is disabled (due to the SSE MCP Server not being available)

When the mcp_polling_interval is reached, you can see that the MCP Server Polling status changs to Running.

For this example, I started the SSE server. The next polling interval, the MCP server was able to connect, and the mcp_test agent was reactivated (Loaded state)

If mcp_polling_interval is not set (or 0), then the polling system is disabled (this is the default). The progress display will show Deactivated for the status of MCP Server Polling

Likewise, if an agent is Loaded and an MCP server goes offline, then the next polling interval the agent will be deactivated again.

This change is 100% backwards compatible, as the new mcp_polling_interval parameter defaults to None, and the existing current behavior is the same. The user can choose to give the mcp_polling_interval a value, after which the new polling and agent registration/deregistration takes effect. Additionally, when in polling mode, Fast Agent will not crash on startup if an agent has a broken MCP server connection.

[evalstate]

Hi @jdecker76 this looks good at first pass, and I think intersects with some improvements I think are necessary for any Production level client dealing with Streamable HTTP.

Below is my list of connection "things" that I wanted to get covered somehow:

MCP Server Connection Handling.
 - Configure Client to Server ping interval and timeout handling
 - Show most recent inbound/outbound Server communication (MCP)
 - Show most recent inbound/outbound Server communication (Ping)

STDIO
 - Attempt restart on unexpected termination (one time only) 

Remote (SSE/SHTTP)
 - Identify/Display whether a Streamable HTTP Server is in "Server Push" mode
 - Identify/Display whether a remote Server has assigned a SessionID
 - Session resumption - configure whether 404 on reconnect is a "failure" or attempt new Session
 - Identify HTTP Connection health for "Server Push" connections

Some of this is driven from: https://huggingface.co/blog/building-hf-mcp

Q - What does it mean for an agent to be "Deactivated". It can't meaningfully participate in workflows, so without a queueing/resume system (perhaps A2A participation) I'm not sure what the desired behaviour is?