Use sccache-dist build cluster for conda and wheel builds

[trxcllnt]

Description

RAPIDS has deployed an autoscaling cloud build cluster that can be used to accelerate building large RAPIDS projects.

This PR updates the conda and wheel builds to use the build cluster.

This contributes to rapidsai/build-planning#228.

[greptile-apps]

Greptile Overview

Greptile Summary

This PR enables the use of RAPIDS' autoscaling cloud build cluster (sccache-dist) to accelerate conda and wheel builds across all CI workflows.

Key Changes:

• Added sccache-dist-token-secret-name: GIST_REPO_READ_ORG_GITHUB_TOKEN to all conda and wheel build/test jobs in workflows to authenticate with the distributed build cluster
• Added node_type: cpu8 to C++ and wheel build jobs to specify appropriate node types for the build cluster
• Set SCCACHE_NO_DIST_COMPILE=1 in cmake/rapids_config.cmake to disable distributed compilation for CMake's compiler tests (optimization to avoid connection overhead for trivial test compilations)
• Added NVCC_APPEND_FLAGS environment variable with default empty string in conda recipes to prevent build failures when the variable is unset in the build environment

The changes are consistent across all three workflow files (build, PR, test) and align with RAPIDS' broader infrastructure initiative to use GCC 14 and improve build performance.

Confidence Score: 5/5

• This PR is safe to merge with minimal risk
• All changes are configuration-only, following established RAPIDS patterns for sccache-dist integration. The additions are non-breaking: node_type and sccache-dist-token-secret-name are optional parameters handled by shared workflows, SCCACHE_NO_DIST_COMPILE is a standard optimization, and the NVCC_APPEND_FLAGS default value fix prevents potential build failures. No logic changes or new code paths introduced.
• No files require special attention

Important Files Changed

File Analysis

Filename	Score	Overview
.github/workflows/build.yaml	5/5	Added sccache-dist-token-secret-name and node_type: cpu8 to all conda and wheel build jobs for distributed compilation support
.github/workflows/pr.yaml	5/5	Added sccache-dist-token-secret-name and node_type: cpu8 to all build and test jobs for distributed compilation in PR workflows
cmake/rapids_config.cmake	5/5	Set SCCACHE_NO_DIST_COMPILE=1 to disable sccache-dist for CMake compiler tests, preventing connection overhead for simple test compilations
conda/recipes/libwholegraph/recipe.yaml	5/5	Added NVCC_APPEND_FLAGS environment variable with default empty string to prevent build failures when variable is unset

Sequence Diagram

sequenceDiagram
    participant GH as GitHub Actions
    participant Node as Build Node (cpu8)
    participant SCC as sccache-dist Cluster
    participant S3 as S3 Cache
    
    GH->>GH: Authenticate with GIST_REPO_READ_ORG_GITHUB_TOKEN
    GH->>Node: Start build job on cpu8 node
    Node->>Node: Set SCCACHE_NO_DIST_COMPILE=1 (CMake config)
    Node->>Node: Run CMake compiler tests (local only)
    Node->>Node: Unset SCCACHE_NO_DIST_COMPILE
    Node->>SCC: Connect to sccache-dist cluster
    SCC->>S3: Check cache for compiled objects
    alt Cache Hit
        S3-->>SCC: Return cached objects
        SCC-->>Node: Deliver cached compilation results
    else Cache Miss
        Node->>SCC: Submit compilation tasks
        SCC->>SCC: Distribute compilation across cluster
        SCC-->>Node: Return compiled objects
        SCC->>S3: Store results in cache
    end
    Node->>Node: Link final artifacts
    Node-->>GH: Upload build artifacts

Loading

_{6 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{9 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{9 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{9 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{9 files reviewed, 3 comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{9 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{9 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile
React with 👍 or 👎 to share your feedback on this new summary format}

[greptile-apps]

_{9 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile
React with 👍 or 👎 to share your feedback on this new summary format}

[greptile-apps]

_{10 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile
React with 👍 or 👎 to share your feedback on this new summary format}

[rockhowse]

CI changes are consistent with those seen in other repos undergoing sccache-dist work.

CI errors appear unrelated to this PR.

[trxcllnt]

Yeah, @alexbarghi-nv mentioned they're being fixed in another PR and that it's fine to merge this.