[AURON #1769][AIP-3]: Introduce auron-it for Enhanced CI Integration Testing

[yew1eb]

Which issue does this PR close?

Closes #1769

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

How was this patch tested?

[yew1eb]

@cxzl25 When you have a moment, please help review as well.
Design doc:
https://docs.google.com/document/d/1jR5VZ_uBd6Oe2x2UT_wGFzdX_xVLhORl6ghDs4f3FIw/edit?tab=t.0

Summary of changes:
Add a standalone auron-it module.
Update the Assembly module to produce a fat (uber) jar for auron-it.
auron-it entry script run-it.sh supports the follew three commands, with corresponding output reports:

1. result check

============================================================
TPC-DS Result Consistency (Vanilla Spark vs Auron) (spark-3.5)
------------------------------------------------------------
Query  Result   Vanilla(s) Auron(s) Speedup(x)
------------------------------------------------------------
q1     PASS         2.57     1.90     1.36
q2     PASS         2.93     1.43     2.05
q3     PASS         2.31     0.44     5.28
------------------------------------------------------------
Passed: 3/3

TPC-DS Test PASSED (All 3 queries succeeded)

2. plan check

============================================================
Auron Plan Stability (spark-3.5)
−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−
Query  Stable 
------------------------------------------------------------
q1     PASS   
q2     PASS   
q3     PASS   
------------------------------------------------------------
Passed: 3/3

3. regenerate golden files

============================================================
Auron Golden Files (spark-3.5)
−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−
Updated queries: 3
- q1, q2, q3
Output directory: /var/folders/89/1t9sctl10zx91__nj2wg3f1h0000gp/T/tpcds-plan-stability/spark-3.5

[Copilot]

Pull request overview

This PR introduces the auron-it module to enhance CI integration testing capabilities for the Auron project. It establishes infrastructure for TPC-DS benchmark testing and query plan validation.

Key changes:

• New auron-it module with TPC-DS query plan stability testing framework
• Added comprehensive shell scripts for running integration tests locally
• Modified build process to use install instead of package for better dependency management

Reviewed changes

Copilot reviewed 29 out of 226 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
dev/auron-it/src/main/resources/tpcds-plan-stability/spark-3.5/*.txt	Golden files containing expected query execution plans for TPC-DS queries (q22, q24b, q25, q26, q27, q28)
dev/auron-it/src/main/resources/log4j*.properties	Logging configuration files for integration testing
dev/auron-it/run-it.sh	Main script to execute integration tests with Spark
dev/auron-it/local-run-tpcds.sh	Helper script demonstrating TPC-DS benchmark execution
auron-build.sh	Updated Maven goals from package to install
.rat-excludes	Excluded TPC-DS test resources from Apache RAT license checks

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.