Skip to content

[Observability 6/10] Integrate Langfuse for MCP tool usage tracking #313

Description

@concaf

Context

Add Langfuse integration to track MCP tool usage from the product/analytics perspective. This enables use cases D1-D8 (which tools are used, by whom, how often, usage patterns across projects).

Langfuse is already used in other team projects (e.g., dataverse-mcp-server) for MCP tool tracking.

Scope (to be detailed)

  • Evaluate Langfuse Go SDK availability (or REST API integration)
  • Track tool calls with: tool name, user identity, parameters, duration, success/failure
  • Track session patterns (how LLM agents chain tool calls)
  • Capture semantic search relevance scores from get_chunks
  • Hash usernames for privacy (same pattern as metrics)

Use cases enabled

D1-D8 (see observability plan)

Depends on

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestobservabilityMetrics, tracing, alerting, and monitoring

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions