Skip to content

Add langchain standard integration tests #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Conversation

cbornet
Copy link
Collaborator

@cbornet cbornet commented Aug 4, 2025

No description provided.

@cbornet cbornet force-pushed the standard-tests branch 5 times, most recently from 2adca13 to 89fcebc Compare August 7, 2025 10:07
@cbornet cbornet force-pushed the standard-tests branch 4 times, most recently from 0810afa to 6b2a922 Compare August 14, 2025 17:03
@cbornet cbornet requested a review from nicoloboschi August 14, 2025 17:03
@cbornet cbornet force-pushed the standard-tests branch 2 times, most recently from 5edc0b3 to d865edd Compare August 14, 2025 17:10
raise RuntimeError(msg)

time.sleep(1)
docs = retriever.invoke(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should keep the retries

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to have the retries in the setup (in the pipeline_id fixture).
Is there a possibility that retrieving docs fails after it has succeeded once ?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, in that case it's a different issue and we should fail

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What issue could arise ?
I find it not stable to have an API succeed on one call, then fail on the next one...

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also the goal of this PR is to add the LangChain integration tests and these don't do retries.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is to have the retries in the setup (in the pipeline_id fixture).

Note that the retries in the fixture are not on the pipeline creation request but on a doc retrieval request, similar to the one that will be done in the tests just afterwards.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants