Skip to content

feat(google): Agentic Video Understanding support - #11636

Draft
Allen Firstenberg (afirstenberg) wants to merge 5 commits into
langchain-ai:mainfrom
afirstenberg:agentic-video
Draft

Allen Firstenberg (afirstenberg) wants to merge 5 commits into
langchain-ai:mainfrom
afirstenberg:agentic-video

Conversation

@afirstenberg

Copy link
Copy Markdown
Contributor

Adds support for Agentic Video Understanding (see https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-agentic-video-in-gemini/)

  • Adds support for mediaProcessing parameter in a video content block
  • Changes API version for GCP / GEAP to "v1beta1", which is necessary for mediaProcessing
  • Adds tests for same, specific to models that can accept it
  • Adds gemini-3.8-flash to test suite
  • Updates to latest API
  • Changes how we save the OpenAPI spec for the API (sort parameters alphabetically so future diffs will be useful).

TODO:

  • Check merge conflict
  • Make sure thought signatures that are necessary are sent back
  • Double-check the tests to make sure they are valid

@changeset-bot

changeset-bot Bot commented Sep 14, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 03ea5b1

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

if (
upper === "AGENTIC" ||
upper === "STATIC" ||
upper === "MEDIA_PROCESSING_UNSPECIFIED"

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be removed. Despite being valid in the API, it shouldn't be valid for a user to set it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant