[Good First Issue]: OV models don't hold context #1013
Description
Context
Hi, maybe it's an issue with my setup, but any OpenVino model I try doesn't hold context. Models fetched from hf
FROM qwen25-coder-7b.tar.gz
ModelType "OpenVINO"
InferDevice "GPU"
❯ ollama run qwen25-coder-7b
>>> my name is Alex
Hello Alex! How can I assist you today?
>>> what's my name
I'm sorry, but I don't have access to your personal information unless you've shared it with me in our conversation.
How can I assist you today?
both Openvino, GenAi and ollama_openvino are built from latest main/master.
Any help appreciated
What needs to be done?
Identify an issue of why context is not held.
Example Pull Requests
No response
Resources
- Contribution guide - start here!
- Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers
- How to link your Pull Request to an issue
Contact points
Ticket
No response