Release v1.48.0 · GoogleCloudPlatform cluster-toolkit · Discussion #3864 · GitHub

harshthakkar01
Apr 1, 2025
Maintainer

Highlights

The GKE nodepool module of Toolkit has been updated to support multiple nodepools. (PR#3826)
Automatic Prolog/Epilog Slurm GPU Health Checks
Kueue v0.11.1 manifest support

What's Changed

Key New Features 🎉

Add a4-high-vm blueprint by @samskillman in Add a4-high-vm blueprint #3751
Cloud DNS config addition to GKE Cluster module by @SwarnaBharathiMantena in Cloud DNS config addition to GKE Cluster module #3752
Update Slurm image reference to new family (6-9) by @abbas1902 in Update Slurm image reference to new family (6-9) #3740
Adding Automatic Prolog/Epilog Slurm GPU Health Checks by @RachaelSTamakloe in Adding Automatic Prolog/Epilog Slurm GPU Health Checks #3781
Created GPU Operator Manifest by @ighosh98 in Created GPU Operator Manifest #3814
add kueue v0.11.1 manifest by @ighosh98 in add kueue v0.11.1 manifest #3833
Support resource manager tags on instance template and attached disks by @annuay-google in Support resource manager tags on instance template and attached disks #3829
introduce feature to enable k8s beta apis by @ighosh98 in introduce feature to enable k8s beta apis #3840
Add support for Kueue 0.11.1 by @mwysokin in Add support for Kueue 0.11.1 #3830
Integrate gpu operator in kubectl by @ighosh98 in Integrate gpu operator in kubectl #3838

Module Improvements 🔨

add support for enablePrivateNode at nodepool level by @chengcongdu in add support for enablePrivateNode at nodepool level #3794
Add nodeset name as a label to all nodeset instance templates by @annuay-google in Add nodeset name as a label to all nodeset instance templates #3787
Fix network names backward compatibility for A3 Mega and A3 High by @sharabiani in Fix network names backward compatibility for A3 Mega and A3 High #3811
Support multiple nodepools creation in gke nodepool module by @SwarnaBharathiMantena in Support multiple nodepools creation in gke nodepool module #3826
Enable higher performance self-managed NFS server configurations by @ndebuhr in Enable higher performance self-managed NFS server configurations #3807
add support for resource quota in gpu-operator namespace by @ighosh98 in add support for resource quota in gpu-operator namespace #3855

Improvements 🛠

A4 GKE integration test by @annuay-google in A4 GKE integration test #3718
A3U Slurm: enable nvidia-persistenced daemon by @tpdownes in A3U Slurm: enable nvidia-persistenced daemon #3698
Remove experimental tag from GKE blueprints in readme by @parulbajaj01 in Remove experimental tag from GKE blueprints in readme #3724
NCCL integration tests by @annuay-google in NCCL integration tests #3697
Add NeMo and HPL Slurm GCS System Benchmarks with Ramble by @samskillman in Add NeMo and HPL Slurm GCS System Benchmarks with Ramble #3726
GCS update to GKE A4 High blueprint by @SwarnaBharathiMantena in GCS update to GKE A4 High blueprint #3749
Update Kueue documentation by @ighosh98 in Update Kueue documentation #3786
Add comment descriptions for a3U vars by @parulbajaj01 in Add comment descriptions for a3U vars #3783
Improve job template naming by @ighosh98 in Improve job template naming #3816
Update GPU Operator manifest definition by @ighosh98 in Update GPU Operator manifest definition #3820
Unify gke a3 ultra blueprints by @ighosh98 in Unify gke a3 ultra blueprints #3835
Advanced network configuration support on notebook instance community module by @caetano-colin in Advanced network configuration support on notebook instance community module #3671
updating defaults for slurm chs prolog by @RachaelSTamakloe in updating defaults for slurm chs prolog #3843
Add disk size vars in deployment file for a3U by @parulbajaj01 in Add disk size vars in deployment file for a3U #3812
Update A3U slurm threads configuration by @ighosh98 in Update A3U slurm threads configuration #3853

Deprecations 💤

Reduce number of startup scripts. by @mr0re1 in Reduce number of startup scripts. #3770
Add omnia deprecation warning and update A3U and A4 blueprints threads configurations by @ighosh98 in Add omnia deprecation warning and update A3U and A4 blueprints threads configurations #3837

Version Updates ⏫

Bump NCCL/gIB version to 1.0.5 by @sheepx86 in Bump NCCL/gIB version to 1.0.5 #3832

Bug fixes 🐞

Fix issue 3748 (Error with stateful_ips iteration in MIG) by @rbekhtaoui in Fix issue 3748 (Error with stateful_ips iteration in MIG) #3765
Update urls to point to toolkit main by @ighosh98 in Update urls to point to toolkit main #3793
Rollback name injection change in job template by @ighosh98 in Rollback name injection change in job template #3821
Add Rocky 9 compatibility for NFS by @samskillman in Add Rocky 9 compatibility for NFS #3813
fix gke a3-ultra blueprint by @ighosh98 in fix gke a3-ultra blueprint #3845
Force retry use of gce service account by @samskillman in Force retry use of gce service account #3854

New Contributors

@yuryu made their first contribution in Remove yuryu from CODEOWNERS #3728
@DavidToneian-Google made their first contribution in Rename obsolete mentions of "resource" to "module" #3766
@rbekhtaoui made their first contribution in Fix issue 3748 (Error with stateful_ips iteration in MIG) #3765
@Shuang-cnt made their first contribution in update HPC reservation name #3799
@sheepx86 made their first contribution in Bump NCCL/gIB version to 1.0.5 #3832
@caetano-colin made their first contribution in Advanced network configuration support on notebook instance community module #3671
@ndebuhr made their first contribution in Enable higher performance self-managed NFS server configurations #3807
@mwysokin made their first contribution in Add support for Kueue 0.11.1 #3830

Full Changelog: v1.47.0...v1.48.0

What’s changed gets added automatically by GitHub.

This discussion was created from the release Release v1.48.0.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment