[Feature]: Implement All Gather + GEMM Fused Kernels #74
Description
Suggestion Description
Implement one kernel that fuses the all gather and the GEMM computation or fused MLP, collective use-case.
Operating System
No response
GPU
No response
ROCm Component
No response