Add UI tests via MCP and Computer Use

[kaspermarstal]

Description

The Cellm.Tests project have the basic infrastructure for running tests against Excel but no tests yet. We want to explore if we can use Anthropic's Computer Use to run automated UI tests.

Tasks

• Create a script (shell/python, whatever you are most comfortable with) that tests sending model requests and different aspects of the Cellm ribbon UI. For example: Select providers, change temperature, enable/disable cache, or enable/disable tools.
• (Optional) Implement tests in Cellm.Tests project. Use the "Sanity Check" tests for information on how to use the ExcelDna framework to check for cell values in a running Excel application.

Acceptance Criteria

None. This is an exploratory task.

Notes

To get something ready for merge will take a lot of work. It is most likely that the outcome of this issue will have to be taken over by maintainers before merge.

[Chubbi-Stephen]

Thanks for the details. I’d love to explore this and will work on a script today to test model requests and UI interactions like provider selection, temperature changes, and cache toggling. I’ll use Python or another suitable tool to automate Excel. If possible, I’ll also stub out relevant test cases in the Cellm.Tests project to guide further development.

Will share my findings within the day!

[kaspermarstal]

Hey @Chubbi-Stephen super cool! Sorry for the late reply just haven't seen your comment before now. Looking forwrad to seeing what you come up with!

Bonus points for adding computer use MCP to Cellm appsettings.json and doing it via Excel 💃

[kaspermarstal]

Hi @Chubbi-Stephen are you still interested in this?