-
Notifications
You must be signed in to change notification settings - Fork 1
Add langchain standard integration tests #5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
2adca13
to
89fcebc
Compare
0810afa
to
6b2a922
Compare
5edc0b3
to
d865edd
Compare
raise RuntimeError(msg) | ||
|
||
time.sleep(1) | ||
docs = retriever.invoke( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should keep the retries
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The idea is to have the retries in the setup (in the pipeline_id fixture).
Is there a possibility that retrieving docs fails after it has succeeded once ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No, in that case it's a different issue and we should fail
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What issue could arise ?
I find it not stable to have an API succeed on one call, then fail on the next one...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also the goal of this PR is to add the LangChain integration tests and these don't do retries.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The idea is to have the retries in the setup (in the pipeline_id fixture).
Note that the retries in the fixture are not on the pipeline creation request but on a doc retrieval request, similar to the one that will be done in the tests just afterwards.
d865edd
to
26ba852
Compare
26ba852
to
9d22c08
Compare
No description provided.