Skip to content

feat(ci): Improve Gradle cache in CI #1928

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

adutra
Copy link
Contributor

@adutra adutra commented Jun 24, 2025

No description provided.

Copy link
Member

@snazy snazy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not a review, as it's a draft)
Thinking a bit ahead, the restored Gradle cache could also be used by the regtests and other workflows to speed those up.

description: 'Java version'
default: '21'
job-id:
description: 'Job name to prefer'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: the description should actually be

Suggested change
description: 'Job name to prefer'
description: 'Job ID to prefer'

@adutra adutra marked this pull request as ready for review July 3, 2025 15:24
@@ -53,9 +61,40 @@ jobs:
:polaris-server:quarkusAppPartsBuild --rerun \
-Dquarkus.container-image.build=true

- name: Save partial Gradle build cache
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should only store the Gradle caches from gradle.yaml, not from other workflows.

It's doesn't make much sense either, because the cache contents are only read, but never modified.

# NOTE: the regression test runs with spark 3.5.5 and scala 2.12 in Java 17. We also have integration
# tests runs with the existing gradle.yml, which only runs on Java 21. Since spark Java compatibility
# for 3.5 is 8, 11, and 17, we should run spark client with those compatible java versions.
# TODO: add separate spark client CI and run with Java 8, 11 and 17.
- name: Regression Test
run: |
docker compose -f plugins/spark/v3.5/regtests/docker-compose.yml up --build --exit-code-from regtest

store-gradle-cache:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here, no need to store

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like we're good if this one is not stored

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants