Skip to content

Commit a57b39b

Browse files
author
eastgate
committed
S143: 5 novel composition experiments (Exp 097–101) + doc sweep + V96 handoff
Axis 2 "Novel Compositions (No New Math)" complete: - Exp 097: Digester×Anderson coupling (ESN + Anderson localization) - Exp 098: Isomorphic reservoir ensemble (ESN + LSTM glucose + LSTM weather) - Exp 099: WDM ensemble QS (surrogates + game theory + Anderson) - Exp 100: HMM introgression on NN layers (PhyloNet-HMM + weight statistics) - Exp 101: Attention Anderson spectral (attention + eigh + Anderson IPR) 5 Python controls (66 checks), 5 Rust modules, 10 validation binaries (220 CPU + 54 GPU checks). 1085 lib tests, 245 binaries, 46 modules, 0 clippy. Doc updates: README, CONTROL_EXPERIMENT_STATUS, EVOLUTION_READINESS, EXTENSION_PLAN, BARRACUDA_USAGE, PAPER_REVIEW_QUEUE, experiments journal. V96 ToadStool/BarraCUDA handoff. V94/V95 handoffs archived. 4 orphan binaries restored to Cargo.toml (nucleus_pcie, toadstool_s94b, live_dashboard, ecosystem_dashboard). Made-with: Cursor
1 parent 1ad3058 commit a57b39b

44 files changed

Lines changed: 595108 additions & 46 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

CONTROL_EXPERIMENT_STATUS.md

Lines changed: 55 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,11 @@
11
# neuralSpring — Control Experiment Status
22

3-
**Last updated**: March 10, 2026 (Session 142Upstream Rewire + `enable f64;` PTXAS Fix + Cross-Spring Evolution. Sprint 2 absorption. `enable f64;` regression diagnosed and fixed: 5 fused f64 ops restored, dispatch parity 48/55 → 55/55. HMM fused path workaround. DF64 tolerance characterization. V95 toadStool/barraCuda + coralReef handoffs. barraCuda `83aa08a`, toadStool S142 (`a86bc546`), coralReef Iter 29 (`2779c88`). 1048 lib + 71 forge + 9 integration tests. 0 clippy. 233 binaries)
3+
**Last updated**: March 10, 2026 (Session 143Extension Phase: 5 Novel Composition Experiments. Exp 096 Digester×Anderson coupling, Exp 097 Isomorphic reservoir ensemble, Exp 098 WDM ensemble QS, Exp 099 HMM introgression on NN layers, Exp 100 Attention Anderson spectral. 5 new Rust modules, 10 new validation binaries, 5 Python controls. 1085 lib + 71 forge + 9 integration tests. 0 clippy. 245 binaries)
44
**Gate**: Eastgate (i9-12900K, 32 GB DDR5, RTX 4070 12 GB + TITAN V 12 GB NVK, Pop!_OS 22.04)
55
**Python**: 3.10.12, PyTorch 2.9.0+cu128, NumPy 2.2.6, SciPy 1.15.3
66
**Rust**: Edition 2021, clippy pedantic + nursery, unsafe_code=forbid
7-
**Grand Total**: 331/331 Python PASS + 3400+ Rust+GPU validation PASS = **4100+ total validation checks**
8-
**Library**: 1048 lib tests + 9 integration tests + 71 forge tests | 41 modules + config + streaming/ + search/ + visualization/ + gpu_ops/ + gpu_dispatch | 233 validation/bench binaries
7+
**Grand Total**: 397/397 Python PASS + 3600+ Rust+GPU validation PASS = **4500+ total validation checks**
8+
**Library**: 1085 lib tests + 9 integration tests + 71 forge tests | 46 modules + config + streaming/ + search/ + visualization/ + gpu_ops/ + gpu_dispatch | 245 validation/bench binaries
99
**CPU↔Python Parity**: 41/41 PASS — `validate_cpu_math_parity` (9 primitives + 10 paper kernels + 6 Dispatcher cpu_only checks, all within 1e-10)
1010
**Dispatch Overhead**: `bench_dispatch_tiers` — 9/10 ops ≤1.04× overhead (CPU dispatch is transparent), per-call GPU driver-bound for small workloads (motivates pipeline batching)
1111
**baseCamp**: 6 biophysical AI modules + 11 validators (162/162 CPU + 14/14 GPU + 19/19 dispatch + GPU pure 6/6 sub-theses PASS) — Sessions 50, 54, 56, 77, 104b, 107
@@ -14,7 +14,7 @@
1414
**GPU Promotion**: 47 CPU→GPU ops via `gpu_dispatch::Dispatcher` (~97% of production math, +3: hill_gate, multi_obj_fitness, swarm_nn_forward)
1515
**Pure GPU All-Domains**: 11/11 PASS — `validate_gpu_pure_workload_all` (13 GPU domains across all Phase 0++ papers + Paper 026 LSTM + determinism check, scalar-only readback). **WDM+coralForge Pure GPU**: 24/24 PASS — `validate_gpu_pure_wdm_coral` (nW-01 MLP, nW-02 EOS, nW-03 LSTM, nW-05 ESN, coralForge attention, TriMul, AF3 pLDDT, AF3 PAE, AF3 diffusion forward, PF FFN, PF TriMul + determinism)
1616
**WDM Surrogates**: 5 Python baselines (33/33 PASS) + 7 Rust validators (160/160 PASS incl. GPU) + 4 GPU Tensor validators (nW-01 transport, nW-02 EOS, nW-03 S(q,ω), nW-04 transfer, nW-05 ESN) — `wdm_surrogate.rs`, `wdm_transport.rs`, `wdm_sqw.rs`, `wdm_esn.rs` modules
17-
**Publication Experiments (S88+)**: Exp-050 (Py 11/11, Rs 12/12, GPU 9/9), Exp-052 (Py 8/8, Rs 14/14, GPU 10/10), Exp-053 (Py 11/11, Rs 18/18, GPU 11/11). Pure GPU pipeline + metalForge cross-system: 13/13. Mixed-hardware NUCLEUS: 43/43. Phase 4 shader validation: 22/22. Streaming spectral pipeline: 28/28. **Dispatch parity: 53/53 (S115). ComputeDispatch bridge: 14/14. NUCLEUS PCIe bypass: 38/38. Mixed-hardware dispatch: 47/47. WDM+AlphaFold3 dispatch: 57/57. coralForge Evoformer dispatch: 47/47.** **232 binaries, 220/220 validate\_all**
17+
**Publication Experiments (S88+)**: Exp-050 (Py 11/11, Rs 12/12, GPU 9/9), Exp-052 (Py 8/8, Rs 14/14, GPU 10/10), Exp-053 (Py 11/11, Rs 18/18, GPU 11/11). Pure GPU pipeline + metalForge cross-system: 13/13. Mixed-hardware NUCLEUS: 43/43. Phase 4 shader validation: 22/22. Streaming spectral pipeline: 28/28. **Dispatch parity: 53/53 (S115). ComputeDispatch bridge: 14/14. NUCLEUS PCIe bypass: 38/38. Mixed-hardware dispatch: 47/47. WDM+AlphaFold3 dispatch: 57/57. coralForge Evoformer dispatch: 47/47.** **245 binaries**
1818
**NUCLEUS Compute Dispatch**: Tower discovery + Node eigensolve/Anderson/Hessian + Nest provenance + mixed atomic coordination + PCIe bypass: **43/43 PASS**. `validate_nucleus_compute_dispatch`. **NUCLEUS PCIe mixed pipeline**: Tower→Node→Nest chain + GPU↔NPU bypass + biomeOS graph coordination: **38/38 PASS** (S115). `validate_nucleus_pcie_mixed_pipeline`. **NUCLEUS Tower Mode**: JSON-RPC folding + GPU dispatch + cross-primal forwarding + concurrent: **22/22 PASS** (S133). `validate_nucleus_tower`
1919
**ToadStool Absorption Readiness**: CPU correctness (eigh/Anderson/Hamiltonian) + GPU parity (3 matrix sizes) + batch scaling + mixed substrate: **294/294 PASS**. `validate_toadstool_spectral_absorption`
2020
**biomeOS Integration**: neuralSpring registered as science primal. 7 capabilities (spectral\_analysis, anderson\_localization, hessian\_eigen, agent\_coordination, ipr, disorder\_sweep, training\_trajectory). `neuralspring_primal` JSON-RPC server. `validate_biomeos_spectral`: **29/29 PASS**. **biomeOS graph coordination**: DAG pipeline engine (`graph.rs`) with topological execution, 3 canonical pipelines (spectral, popgen, folding). `validate_biomeos_graph`: **32/32 PASS** (S133). NUCLEUS ready (all plasmidBin primals built)
@@ -338,7 +338,7 @@ Target progression (following hotSpring): **Python < CPU < GPU**
338338
| 0 | Synthetic baselines (48 checks) | **COMPLETE** |
339339
| 0+ | Scholarly reproductions (31 checks) | **COMPLETE** |
340340
| 0++ | Paper reproductions (127 checks) | **COMPLETE** |
341-
| 1a | neuralSpring Rust validation (1048 lib + 9 integration + 71 forge tests, 233 binaries, 41+ modules + gpu_ops/ + gpu_dispatch/) | **COMPLETE** |
341+
| 1a | neuralSpring Rust validation (1085 lib + 9 integration + 71 forge tests, 245 binaries, 46 modules + gpu_ops/ + gpu_dispatch/) | **COMPLETE** |
342342
| 1b | BarraCUDA validation (272 checks) | **COMPLETE** |
343343
| 1c | Fused ToadStool pipeline (46–78×) | **COMPLETE** |
344344
| 1d | 3-way benchmark + double-buffered shaders | **COMPLETE** |
@@ -1187,3 +1187,53 @@ Closed the GPU Tensor validation tier for AlphaFold3 diffusion and Pairformer pr
11871187
- nS-01 weight spectral CPU benchmarks: eigh\_f64 on 64×64, 128×128, 256×256 Hamiltonians
11881188

11891189
**Re-validated**: `validate_weight_spectral_real` **12/12 PASS**. `validate_all` **200/200** (198 PASS + 2 pre-existing wright\_fisher WGSL parse). 216 binaries, 3500+ total checks.
1190+
1191+
---
1192+
1193+
## Session 143 — Extension Phase: 5 Novel Composition Experiments (Experiments 097–101)
1194+
1195+
**Scope**: Axis 2 "Novel Compositions (No New Math)" — compose existing validated modules into new scientific applications. Each experiment has Python control baseline, Rust module with unit tests, CPU-only validator, and BarraCUDA CPU+GPU validator.
1196+
1197+
**New modules**:
1198+
1199+
| Module | Experiment | Composes |
1200+
|--------|-----------|----------|
1201+
| `digester_anderson.rs` | 097 — Digester×Anderson coupling | ESN (Paper 027) + Anderson (Paper 023) |
1202+
| `isomorphic_reservoir.rs` | 098 — Isomorphic reservoir ensemble | ESN + LSTM glucose + LSTM weather |
1203+
| `wdm_ensemble_qs.rs` | 099 — WDM ensemble QS | game theory + WDM surrogates + Anderson |
1204+
| `introgression_nn.rs` | 100 — HMM introgression on NN | HMM (Paper 018) + weight statistics |
1205+
| `attention_anderson.rs` | 101 — Attention Anderson spectral | attention + eigh + Anderson IPR |
1206+
1207+
**New binaries** (10):
1208+
1209+
| Binary | Type | Checks |
1210+
|--------|------|--------|
1211+
| `validate_digester_anderson` | CPU | 55/55 PASS |
1212+
| `validate_barracuda_digester_anderson` | GPU | 22/22 PASS |
1213+
| `validate_isomorphic_reservoir` | CPU | 35/35 PASS |
1214+
| `validate_barracuda_isomorphic_reservoir` | GPU | 13/13 PASS |
1215+
| `validate_wdm_ensemble_qs` | CPU | 81/81 PASS |
1216+
| `validate_barracuda_wdm_ensemble_qs` | GPU | 7/7 PASS |
1217+
| `validate_introgression_nn` | CPU | 15/15 PASS |
1218+
| `validate_barracuda_introgression_nn` | GPU | 6/6 PASS |
1219+
| `validate_attention_anderson` | CPU | 34/34 PASS |
1220+
| `validate_barracuda_attention_anderson` | GPU | 6/6 PASS |
1221+
1222+
**Python baselines** (5):
1223+
1224+
| Control | Checks |
1225+
|---------|--------|
1226+
| `control/digester_anderson/digester_anderson.py` | 17/17 PASS |
1227+
| `control/isomorphic_reservoir/isomorphic_reservoir.py` | 17/17 PASS |
1228+
| `control/wdm_ensemble_qs/wdm_ensemble_qs.py` | 11/11 PASS |
1229+
| `control/introgression_nn/introgression_nn.py` | 11/11 PASS |
1230+
| `control/attention_anderson/attention_anderson.py` | 10/10 PASS |
1231+
1232+
**Key findings**:
1233+
1234+
- **Spectral universality**: ESN/LSTM ensembles from 3 domains produce identical spectral profiles (eff\_dim CV = 0.003)
1235+
- **Disagreement = disorder**: Surrogate ensemble variance maps to Anderson localization parameter
1236+
- **Algorithm isomorphism**: PhyloNet-HMM (genomics) detects anomalous NN layers (TPR = 0.97, FPR = 0)
1237+
- **GPU↔CPU parity**: All 5 experiments ≤ 2.5e-4 max diff (f32 vs f64)
1238+
1239+
**Totals**: 1085 lib tests + 9 integration + 71 forge tests. 245 binaries. 46 modules. 0 clippy. 0 unsafe. 4500+ total checks.

Cargo.toml

Lines changed: 73 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -752,6 +752,61 @@ path = "src/bin/validate_glucose_prediction.rs"
752752
name = "validate_wdm_esn"
753753
path = "src/bin/validate_wdm_esn.rs"
754754

755+
# ── Paper 027: Digestion prediction (Wang/Liao 2020) ─────────────
756+
757+
[[bin]]
758+
name = "validate_digestion_prediction"
759+
path = "src/bin/validate_digestion_prediction.rs"
760+
761+
[[bin]]
762+
name = "validate_barracuda_digestion"
763+
path = "src/bin/validate_barracuda_digestion.rs"
764+
765+
# ── Experiment 096: Digester-Anderson coupling ────────────────────
766+
[[bin]]
767+
name = "validate_digester_anderson"
768+
path = "src/bin/validate_digester_anderson.rs"
769+
770+
[[bin]]
771+
name = "validate_barracuda_digester_anderson"
772+
path = "src/bin/validate_barracuda_digester_anderson.rs"
773+
774+
# ── Experiment 097: Isomorphic reservoir ensemble ─────────────────
775+
[[bin]]
776+
name = "validate_isomorphic_reservoir"
777+
path = "src/bin/validate_isomorphic_reservoir.rs"
778+
779+
[[bin]]
780+
name = "validate_barracuda_isomorphic_reservoir"
781+
path = "src/bin/validate_barracuda_isomorphic_reservoir.rs"
782+
783+
# ── Experiment 098: WDM surrogate ensemble QS ─────────────────────
784+
[[bin]]
785+
name = "validate_wdm_ensemble_qs"
786+
path = "src/bin/validate_wdm_ensemble_qs.rs"
787+
788+
[[bin]]
789+
name = "validate_barracuda_wdm_ensemble_qs"
790+
path = "src/bin/validate_barracuda_wdm_ensemble_qs.rs"
791+
792+
# ── Experiment 099: HMM introgression on NN layers ────────────────
793+
[[bin]]
794+
name = "validate_introgression_nn"
795+
path = "src/bin/validate_introgression_nn.rs"
796+
797+
[[bin]]
798+
name = "validate_barracuda_introgression_nn"
799+
path = "src/bin/validate_barracuda_introgression_nn.rs"
800+
801+
# ── Experiment 100: Attention Anderson spectral ───────────────────
802+
[[bin]]
803+
name = "validate_attention_anderson"
804+
path = "src/bin/validate_attention_anderson.rs"
805+
806+
[[bin]]
807+
name = "validate_barracuda_attention_anderson"
808+
path = "src/bin/validate_barracuda_attention_anderson.rs"
809+
755810
# ── baseCamp Sub-thesis validators ────────────────────────────────
756811
[[bin]]
757812
name = "validate_weight_spectral"
@@ -1066,6 +1121,24 @@ path = "src/bin/validate_barracuda_basecamp.rs"
10661121
name = "diagnose_f64_regression"
10671122
path = "src/bin/diagnose_f64_regression.rs"
10681123

1124+
# ── Orphan binaries restored (cleanup S143)
1125+
1126+
[[bin]]
1127+
name = "validate_nucleus_pcie_mixed_pipeline"
1128+
path = "src/bin/validate_nucleus_pcie_mixed_pipeline.rs"
1129+
1130+
[[bin]]
1131+
name = "validate_toadstool_s94b_wgpu28"
1132+
path = "src/bin/validate_toadstool_s94b_wgpu28.rs"
1133+
1134+
[[bin]]
1135+
name = "neuralspring_live_dashboard"
1136+
path = "src/bin/neuralspring_live_dashboard.rs"
1137+
1138+
[[bin]]
1139+
name = "neuralspring_ecosystem_dashboard"
1140+
path = "src/bin/neuralspring_ecosystem_dashboard.rs"
1141+
10691142
[lints.rust]
10701143
unsafe_code = "forbid"
10711144

EVOLUTION_READINESS.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,11 @@
11
# neuralSpring — Evolution Readiness
22

3-
**Date**: March 10, 2026 (Session 142Upstream Rewire + `enable f64;` Fix + Cross-Spring Evolution)
3+
**Date**: March 10, 2026 (Session 143Axis 2 Novel Compositions + Extension Phase)
44
**barraCuda**: v0.3.3 at `83aa08a` (`../barraCuda/crates/barracuda`). 719 WGSL shaders, wgpu 28, Sprint 2 APIs (activations, rng, tridiagonal_ql), healthSpring domain, batched logsumexp, CoralReefDevice. `PrecisionRoutingAdvice` with `F64NativeNoSharedMem` Ada Lovelace reclassification, `WORKGROUP_SIZE_1D` constant, cross-spring provenance registry, `BatchedOdeRK45F64`, `mean_variance_to_buffer`, coralReef Phase 10 IPC. Three-tier precision: F32/F64/Df64 (lean 3-tier model, F16+templates removed). Deep debt: typed errors, named constants, `Arc<str>` hot-path, `RwLock` compiler, ring buffer back-off, streaming pipeline completion. **Known issue**: `enable f64;` in WGSL triggers PTXAS silent-zero regression on Ada Lovelace — fix implemented locally in `pipeline_cache.rs`, pending upstream absorption.
55
**ToadStool**: S142 at `a86bc546`. Hardware testing, PCIe transport, ResourceOrchestrator, 19,900+ tests. Absorbed neuralSpring `pipeline_graph` DAG + hotSpring `streaming_dispatch`. Dual-write discovery (canonical + coralReef-compatible). `GpuDevice` enrichment (render_node, driver, arch). `gpu.dispatch` + `shader.compile` + `orchestration` capabilities. Compute triangle unblocked. Deep debt, zero-copy.
66
**coralReef**: Iteration 29 at `2779c88`. NVIDIA last mile pipeline, SSA repair, multi-GPU sovereignty, 1200+ tests. Sovereign shader compiler (WGSL → native GPU binary). NVIDIA SM70-SM89, AMD RDNA2+ (E2E GPU dispatch verified on RDNA2). Three-tier precision architecture: f32 native, f64 DFMA+polynomial lowering, df64 preamble auto-prepend. `Fp64Strategy` in `CompileOptions`. Built-in `df64_preamble.wgsl`. 8 neuralSpring shaders in corpus.
7-
**neuralSpring**: 1048 lib + 71 forge + 9 integration tests, 233 binaries, 0 clippy warnings (pedantic+nursery), 0 doc warnings. All files ≤1000 LOC. AGPL-3.0-or-later. Pure Rust deps (ecoBin compliant).
8-
**S142**: Upstream rewire + `enable f64;` fix + cross-spring evolution. Sprint 2 API absorption (activations, fused\_ops\_healthy). `Precision::F16` removed. coralReef bridge aligned. 54 binaries with provenance blocks. `enable f64;` PTXAS regression diagnosed and fixed locally (5 fused ops restored). HMM fused path workaround (0.0 detection → per-step fallback). Glucose pearson tolerance adjusted for DF64. Dispatch parity: 48/55 → **55/55 PASS**. V95 toadStool/barraCuda + coralReef handoffs written.
7+
**neuralSpring**: 1085 lib + 71 forge + 9 integration tests, 245 binaries, 46 modules, 0 clippy warnings (pedantic+nursery), 0 doc warnings. All files ≤1000 LOC. AGPL-3.0-or-later. Pure Rust deps (ecoBin compliant).
8+
**S143**: 5 novel composition experiments (Exp 097–101): digester×Anderson, isomorphic reservoir ensemble, WDM ensemble QS, HMM introgression NN, attention Anderson spectral. Axis 2 complete. 209 files with barracuda imports. V96 handoff. Ready for Axis 1 (real data) and ToadStool pipeline graph absorption.
99
**S138**: Industry gap closure — streaming FASTA parser (16 tests), CPU-reference BLAST pipeline (`search/kmer_index`, `search/seed_extend`, 19 tests), `bench_kokkos_parity` GPU benchmark harness (9 ops × production scale). `INDUSTRY_TOOL_GAP_ANALYSIS.md`, `BLAST_LIKE_SEARCH_SCOPE.md`, `MSA_PIPELINE_SCOPE.md`. V92 handoff written.
1010
**S137**: Upstream rewire + deep debt execution. Reviewed 27+ Mar 8–9 wateringHole handoffs (ToadStool S139, barraCuda Sprint 2 + deep debt + concurrency, coralReef precision architecture, groundSpring V98/V100 sovereign rewire). **Rewires**: hardcoded `256``WORKGROUP_SIZE_1D` (library+forge, 15 sites). **Absorption docs**: 7 WGSL shaders updated to "absorbed upstream" status. toadStool S139 `pipeline_graph` absorption acknowledged. **Deep debt**: `gpu_or_exit()` async helper eliminates 5-line GPU init boilerplate (~75 binaries); duplicate `max_abs_diff` in `validate_gpu_promotion` eliminated; 2 largest GPU binaries refactored to use `gpu_or_exit()`. **Full audit**: zero unsafe, zero TODOs, zero mocks in production, zero hardcoded paths, zero non-Rust deps (wgpu is the GPU bridge), all library files < 800 LOC. V92 handoff written. 968 lib + 71 forge tests PASS.
1111
**S136**: Deep audit + evolution — `PetalTonguePushClient::headless()` (socket hardcoding eliminated), `Gpu::read_buffer_u32` (upstream parity), `validate_gpu_pure_workload_all` refactored (976→940 LOC, raw wgpu eliminated), industry GPU parity gap documented (`specs/BENCHMARK_ANALYSIS.md`), Kokkos/Polybench/cuBLAS gap formally requested in V92 handoff. 968 lib tests (+2 headless client). All casts audited (f64→f32 for GPU, usize→f64 no From impl — legitimate).
@@ -26,8 +26,8 @@ Mixed-hardware (mH), and Multi-GPU (mG).
2626

2727
| Category | Count | Status |
2828
|----------|-------|--------|
29-
| Python baselines | 331/331 | **COMPLETE** |
30-
| Rust native validation | 1048 lib + 9 integration + 71 forge tests, 41+ modules, 233 binaries | **COMPLETE** |
29+
| Python baselines | 397/397 | **COMPLETE** |
30+
| Rust native validation | 1085 lib + 9 integration + 71 forge tests, 46 modules, 245 binaries | **COMPLETE** |
3131
| BarraCUDA primitives | 272/272 | **COMPLETE** |
3232
| BarraCUDA CPU (bC) | **24/25** papers (96%) | **ALL GREEN** |
3333
| BarraCUDA GPU Tensor (gT) | **23/25** papers (92%) | **ALL GREEN** |

0 commit comments

Comments
 (0)