Integration with eval-protocol for Improved App Evaluation

[dphuang2]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:)
• Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

When building apps on Dify, it’s best practice to create and run evaluations (evals) for your app—especially when teams with both technical and non-technical members are collaborating to build a high-quality agent.

I am one of the authors of eval-protocol (GitHub, Docs), which provides an easy way to write and run evals in Python.

I’m interested in building an integration with dify.ai and collaborating so that Dify users can develop higher-quality AI applications. I imagine a scenario where developers can author evals for Dify applications and PMs/developers can collaborate on the app itself while ensuring any changes/updates do not hurt the quality of the application. Its also a great opportunity to teach users how to iteratively improve their AI apps on Dify.

I’d love to know how I can get started and what the best way to contribute would be. Thanks, and I’d also like to say that I’m genuinely impressed by the work happening at Dify. The platform’s growth and impact are remarkable.

2. Additional context or comments

No response

3. Can you help us with this feature?

• I am interested in contributing to this feature.