[SPARK-54122] [WIP] Implement TwsTester#53159

Draft

fedimser wants to merge 46 commits intoapache:masterfrom

fedimser:tws-tester-3

Commits on Nov 21, 2025

Add TwsTester framework and processors
Dmytro Fedoriaka
committed
remove timer functionality
Dmytro Fedoriaka
committed
Add tests for all state methods
Dmytro Fedoriaka
committed
Add fuzz test for all state methods
Dmytro Fedoriaka
committed
Remove redundant public methods
Dmytro Fedoriaka
committed

Commits on Nov 22, 2025

rename InMemoryStatefulProcessorHandle
Dmytro Fedoriaka
committed
documentation
Dmytro Fedoriaka
committed
Implement basic TwsTester in PySpark
Dmytro Fedoriaka
committed

Commits on Nov 24, 2025

integration test for twsTester
Dmytro Fedoriaka
committed
move RunningCountStatefulProcessor
Dmytro Fedoriaka
committed
add unit test for value state
Dmytro Fedoriaka
committed
simplify inmemory state
Dmytro Fedoriaka
committed

Commits on Nov 25, 2025

implement basic liststate
Dmytro Fedoriaka
committed
add tests for ListState
Dmytro Fedoriaka
committed
fuzz test for topk
Dmytro Fedoriaka
committed
implement map state
Dmytro Fedoriaka
committed
fuzz test for map state
Dmytro Fedoriaka
committed
initial state
Dmytro Fedoriaka
committed
row-by-row test
Dmytro Fedoriaka
committed
row-by-row test
Dmytro Fedoriaka
committed
add method coverage tests
Dmytro Fedoriaka
committed
add test
Dmytro Fedoriaka
committed
style
Dmytro Fedoriaka
committed
style
Dmytro Fedoriaka
committed
add docs
Dmytro Fedoriaka
committed
add more unit tests
Dmytro Fedoriaka
committed
fix tests
Dmytro Fedoriaka
committed
remove skip
Dmytro Fedoriaka
committed
bug fix
Dmytro Fedoriaka
committed
Add assertions for state initialization
Dmytro Fedoriaka
committed
clarify doc
Dmytro Fedoriaka
committed
add check for initial state
Dmytro Fedoriaka
committed
fix scala style
Dmytro Fedoriaka
committed
fix annotations
Dmytro Fedoriaka
committed
Merge branch 'apache:master' into tws-tester-3
fedimser
authored

Commits on Dec 1, 2025

Merge branch 'apache:master' into tws-tester-3
fedimser
authored
change versionadded
Dmytro Fedoriaka
committed
Add MiMa exceptions.
Dmytro Fedoriaka
committed
some fixes
Dmytro Fedoriaka
committed
reformat python
Dmytro Fedoriaka
committed
fix custom python lint checks
Dmytro Fedoriaka
committed
undo bad AI suggestion
Dmytro Fedoriaka
committed
Merge branch 'apache:master' into tws-tester-3
fedimser
authored
reformat python
Dmytro Fedoriaka
committed

Commits on Dec 2, 2025

mypy fixes
Dmytro Fedoriaka
committed
fix mypy errors
Dmytro Fedoriaka
committed