Skip to content

memory error on NIRD when processing daily data for NorESM #66

Description

@mvertens

I am using the validation-script branch on nird.

Monthly processing using the following worked
./cmor_driver.py --realm atmos --tsdir ~/test_cmor/n1850.ne16pg3_tn14.noresm3_0_beta17.Run12-1.restartfromold.2026-05-21/atm/timeseries --outdir ~/test_cmor/n1850.ne16pg3_tn14.noresm3_0_beta17.Run12-1.restartfromold.2026-05-21/cmor --workers 1 --resolution ne16 --model noresm

However, following gives rise to a memory error
./cmor_driver.py --realm atmos --tsdir ~/test_cmor/n1850.ne16pg3_tn14.noresm3_0_beta17.Run12-1.restartfromold.2026-05-21/atm/timeseries --outdir ~/test_cmor/n1850.ne16pg3_tn14.noresm3_0_beta17.Run12-1.restartfromold.2026-05-21/cmor --workers 1 --resolution ne16 --model noresm --frequency day

ERROR:cmip7_prep.cmor_driver:Exception while processing zg_tavg-p39-hy-air with dims ['time', 'plev', 'lat']: MemoryError((58, 12, 96, 144), dtype('float64'))

zg is the last field to be processed - but there is a vertical interpolation that is being done.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions