Please provide a way to reduce the page data sent as context to LLMs #38532
brandonzylstra
started this conversation in
LLMs and Zed Agent
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
If you take a look at the screenshot, you'll see the red ❌ next to the top URL that Zed fetched in looking for an answer to my question. One would expect such an ❌ to remove the URL, thus removing the page data to be sent to the LLM, and thus reducing the context sent to the LLM. This does not work, and in fact does nothing at all, so it's apparently some sort of bug, but since there is no red ❌ next to the other URLs, I'm going to guess it's a bug unrelated to my request.
It would be extremely useful to be able to eliminate contextual data sent to LLMs such as the page data from lookups like this. There is apparently no way to do that, however. We would appreciate a way to do this!
(As a second bug, the total context size claimed in the Zed agent UI is 103k, which is obviously less than 128k. So either the second bug is that the display is wrong, or else something else that results in this disparity. However I'll plan to file the bugs separately.)
Beta Was this translation helpful? Give feedback.
All reactions