Will this repo be maintained anymore?

[MrPowers]

First off, thank you for building this important library for the Spark Community!

I see that the last commit for this repo was two years ago and there are open issues to add support for Spark 3.4 and Spark 3.5.

Is there a project maintainer that would be willing to merge PRs and make releases for new Spark versions?

[banker]

@MrPowers Of course! And yes, we'd be happy to look over PRs and release a new version. What's your biggest need right now?

[MrPowers]

Thanks @banker! Would you be willing to push up artifacts that are Spark 3.4 & Spark 3.5 compatible? Would you be willing to refactor to make spark-redis Spark Connect compatible?

[mpasa]

Also, as Spark 4.0 is dropping support for Scala 2.12, it would be great to see it cross-compiled for both 2.12 and 2.13. This is currently blocking our version upgrade and we'd need to drop the library if not possible.

[newfront]

I added a branch for 4.0 (#394). @banker there is one open question regarding expected behavior for the RedisNode.idx index. With the modifications to Jedis they deprecated conn.clusterSlots in favor of conn.clusterShards which provides different behavior. All cluster slots per Node are returned - so this might change the way things work. If you have a chance to look things over I'd be more than happy to change the logic.

[ialarmedalien]

@banker @newfront what is the status of the migration to spark 4.0? Is this project still active? There doesn't seem to have been any change of consequence since late 2024.