This file provides context and guidelines for AI coding assistants working with the Apache Spark codebase.
Prefer building in sbt over maven:
-
Building Spark: docs/building-spark.md
- SBT build instructions: See the "Building with SBT" section
- SBT testing: See the "Testing with SBT" section
- Running individual tests: See the "Running Individual Tests" section
-
PySpark Testing: python/docs/source/development/testing.rst