Ongoing feedback when sending message #277
Description
The time taken to get a reply after sending a message can be quite long. To alleviate this, it could be nice to have the backend feedback what is going on to the frontend.
Some things we could tell the frontend:
- Checking the user's message (includes evaluator LLM)
- Calling main LLM
- Calling QA LLM
- Sending email (this will be quick but might still be nice to show)
We might need to switch to using websockets for this, as the backend will be sending stuff to the frontend unsolicited, which it can't currently do.