Skip to content

Conversation

@trxcllnt
Copy link
Collaborator

This PR uses S3 as the location for the preprocessor cache. It also adds devcontainer-utils-sccache-dist-status --watch, which can be used as a handy way to watch the sccache client and build cluster:

$ devcontainer-utils-sccache-dist-status -c8 -w
Every 1.0s: devcontainer-utils-sccache-dist-status -c8 -w             587a5cfdd438: Wed Nov 19 19:55:09 2025

sccache procs: 1
preprocessed tempfiles: 0  (0)
nvcc internal tempfiles: 0 (0)

    time      type        id  servers  cpus    util  jobs  loading  pending  running  max  accepted  finished  seen
07:55...  sched...  https...        4   228  36.02%    92        0        0       92  42s     29201     29109    1s
07:55...    server  i-00a...        -    57  31.39%    20        0        0       20  41s      6000      5980    1s
07:55...    server  i-02a...        -    57  42.31%    26        0        0       26  39s      5896      5870    2s
07:55...    server  i-08a...        -    57  35.98%    24        0        0       24  40s     11468     11444    1s
07:55...    server  i-0b2...        -    57  34.41%    22        0        0       22  38s      5837      5815    2s

Queued compilations                   0
Pending compilations                  0
Pending cache lookups                 0
Active compilations                   0
Compile requests                      0
Compile requests executed             0
Compile request errors                0
Cache hits                            0
Preprocessor cache hits               0
Cache misses                          0
Preprocessor cache misses             0
Cache hits rate                       -
Cache timeouts                        0
Cache read errors                     0
Forced recaches                       0
Cache write errors                    0
Compilations                          0
Compilation failures                  0
Non-cacheable compilations            0
Non-cacheable calls                   0
Non-compilation calls                 0
Unsupported compiler calls            0
Average cache write               0.000 s
Average compiler                  0.000 s
Average cache read hit            0.000 s
Fatal errors                          0
Successful distributed compiles       0
Failed distributed compilations       0
Cache location                  Local disk: "/home/coder/.cache/sccache/"
                                s3, name: rapids-sccache-devs, prefix: /
Use direct/preprocessor mode?   yes
Version (client)                0.12.0-rapids.21
Max cache size                      100 GiB

@trxcllnt trxcllnt requested a review from a team as a code owner November 19, 2025 19:59
Copy link

@rockhowse rockhowse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI changes are consistent with those seen in other repos undergoing sccache-dist work.

One small question about 25.12.1 version bump for devcontainer-utils

@trxcllnt trxcllnt merged commit 0419c5e into rapidsai:release/25.12 Nov 20, 2025
195 checks passed
@trxcllnt trxcllnt deleted the fea/use-s3-for-preprocessor-cache branch November 20, 2025 17:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants