FSD Simulation

FSD cosmic simulation

Cosmic ray simulation for the FSD based on CORSIKA generated air showers.

FSD_CosmicRun1 (charge-only)

Web link: https://portal.nersc.gov/project/dune/data/FSD/simulation/FSD_CosmicRun1/

NERSC dir: /global/cfs/projectdirs/dune/www/data/FSD/simulation/FSD_CosmicRun1/

This run is a charge-only simulation sample (light simulation to follow) up to and including the ndlar-flow stage. A total of 468 flow files are available after a ~10% failure rate in the edep-sim and larnd-sim processing.

Software versions/commits

• 2x2_sim: a9d8f281
• larndsim: 8d498768
• ndlar_flow: 4cce7505

Known issues and crashes

• Segfault in edep-sim simulation for ~30 files. Most likely related to something in the geometry description.
• CUDA segfault (?) in larnd-sim. Fails at the following line but at a different point each time:

  File "/pscratch/sd/c/cuddandr/fsd_sim/run-larnd-sim/larnd-sim/cli/simulate_pixels.py", line 1091, in run_simulation
    pixels_tracks_signals = cp.zeros(len(detector.TIME_TICKS) * int(num_backtrack.sum()))
                                                                ^^^^^^^^^^^^^^^^^^^^^^^^

FSD_CosmicRun2 (charge-only)

Web link: https://portal.nersc.gov/project/dune/data/FSD/simulation/FSD_CosmicRun2/

NERSC dir: /global/cfs/projectdirs/dune/www/data/FSD/simulation/FSD_CosmicRun2/

This simulation sample is charge-only and includes several updates to the simulation to fix several bugs and better reflect data-taking conditions. All 512 files completed without issue, and the total sample size is approximately the same as CosmicRun1. Notable changes/fixes include: corrected drift distance, channel-by-channel thresholds, larnd-sim file compression.

Software versions/commits

• 2x2_sim: c589d95e
• larndsim: cff76999
• ndlar_flow: 625d7a33

FSD_CosmicRun3 Beta (charge+light)

Web link: https://portal.nersc.gov/project/dune/data/FSD/simulation/FSD_CosmicRun2/

NERSC dir: /global/cfs/projectdirs/dune/www/data/FSD/simulation/FSD_CosmicRun3/

This simulation sample includes charge and light data, however the light data should still be considered in beta-testing (it still needs some additional validation). The files now include SPINE output files along with every preceding step of the simulation chain. Both larnd-sim and nd-flow were updated very close to or at the head of development at the time of production.

The total size is 256 files assuming no failures, which was chosen to produce the sample quickly. There were about 12 job failures during the production across different parts of the simulation chain. A couple larnd-sim crashes, a flow2supera crash, and about 8 SPINE crashes. Log files for these crashes can be found in failed_logs in the above directory.

Software versions/commits

• 2x2_sim:
• larndsim: 511fabb8 (on fsd_cosmic_sim branch)
• ndlar_flow: f200798a (on fsd_cosmic_sim branch)