Skip to content

Updating to SCORPIO v2.0.1#8465

Open
jayeshkrishna wants to merge 5 commits into
masterfrom
jayeshkrishna/externals/scorpio_v2.0.0
Open

Updating to SCORPIO v2.0.1#8465
jayeshkrishna wants to merge 5 commits into
masterfrom
jayeshkrishna/externals/scorpio_v2.0.0

Conversation

@jayeshkrishna

@jayeshkrishna jayeshkrishna commented Jun 8, 2026

Copy link
Copy Markdown
Contributor

Upgrading SCORPIO to version 2.0.1

SCORPIO version 2.0.0 includes,

  • Asynchronous I/O support (for HDF5 iotypes)
  • New Data rearranger (PIO_REARR_CONTIG)
  • New I/O decomposition logger
  • Moving to C++ data structures (lists etc)
  • Major code refactoring (source/headers are refactored and moved)
  • Bug fixes from maint/v1.9 branch
  • Misc enhancements - datatype converter, capture stack trace,
    GPTL timers, more tests, C++ unit testing framework
  • Configure settings for data compression and chunking
  • Misc bug fixes

SCORPIO version 2.0.1 includes the following fixes,

  • Turn bget off by default in configure
  • In PIOc_initdecomp() allow compmap to be NULL when length is 0

The PR also includes some minor changes to eamxx,

  • Turn off bget for eamxx standalone tests
  • Add paths to HDF5 libs for ANL compute nodes (for eamxx standalone tests)
  • Ensure that eamxx output writes are done after ending define mode

[BFB]

Upgrading SCORPIO to version 2.0.0

SCORPIO version 2.0.0 includes,

* Asynchronous I/O support (for HDF5 iotypes)
* New Data rearranger (PIO_REARR_CONTIG)
* New I/O decomposition logger
* Moving to C++ data structures (lists etc)
* Major code refactoring (source/headers are refactored and moved)
* Bug fixes from maint/v1.9 branch
* Misc enhancements - datatype converter, capture stack trace,
  GPTL timers, more tests, C++ unit testing framework
* Configure settings for data compression and chunking
* Misc bug fixes
@jayeshkrishna jayeshkrishna self-assigned this Jun 8, 2026
@jayeshkrishna jayeshkrishna added BFB PR leaves answers BFB SCORPIO The E3SM I/O library (derived from PIO) labels Jun 8, 2026
@bartgol bartgol added the CI: approved Allow gh actions PR testing on ghci-snl-* machines label Jun 10, 2026
@bartgol bartgol marked this pull request as ready for review June 10, 2026 14:39
@bartgol bartgol marked this pull request as draft June 10, 2026 14:39
Disable bget in SCORPIO for EAMXX standalone tests (to be in sync
with how SCORPIO is built/used in E3SM builds)
@bartgol bartgol added CI: approved Allow gh actions PR testing on ghci-snl-* machines and removed CI: approved Allow gh actions PR testing on ghci-snl-* machines labels Jun 11, 2026
@bartgol bartgol marked this pull request as ready for review June 11, 2026 14:07
@bartgol bartgol marked this pull request as draft June 11, 2026 14:07
Adding path to HDF5 library for the anl gce compute nodes in eamxx
standalone test machine configuration
When writing eamxx output ensure that variables (constants) are
written out after ending the define mode
SCORPIO v2.0.1 includes the following fixes,

* Turn bget off by default in configure
* In PIOc_initdecomp() allow compmap to be NULL when length is 0
@jayeshkrishna jayeshkrishna changed the title Updating to SCORPIO v2.0.0 Updating to SCORPIO v2.0.1 Jun 24, 2026
@jayeshkrishna jayeshkrishna marked this pull request as ready for review June 25, 2026 15:09
@jayeshkrishna

Copy link
Copy Markdown
Contributor Author

Only the zm_conv_omp tests in eamxx standalone tests fail (and this failure does not seem to be related to this PR)

jayeshkrishna added a commit that referenced this pull request Jul 10, 2026
…8465)

Upgrading SCORPIO to version 2.0.1

SCORPIO version 2.0.0 includes,

* Asynchronous I/O support (for HDF5 iotypes)
* New Data rearranger (PIO_REARR_CONTIG)
* New I/O decomposition logger
* Moving to C++ data structures (lists etc)
* Major code refactoring (source/headers are refactored and moved)
* Bug fixes from maint/v1.9 branch
* Misc enhancements - datatype converter, capture stack trace,
  GPTL timers, more tests, C++ unit testing framework
* Configure settings for data compression and chunking
* Misc bug fixes

SCORPIO version 2.0.1 includes the following fixes,

* Turn bget off by default in configure
* In PIOc_initdecomp() allow compmap to be NULL when length is 0

The PR also includes some minor changes to eamxx,
* Turn off bget for eamxx standalone tests
* Add paths to HDF5 libs for ANL compute nodes (for eamxx standalone tests)
* Ensure that eamxx output writes are done after ending define mode

[BFB]

* jayeshkrishna/externals/scorpio_v2.0.0:
  Updating to SCORPIO v2.0.1
  Write vars after ending define mode
  Adding HDF5 path for anlgce in eamxx mach specs
  Disable bget in SCORPIO
  Updating to SCORPIO v2.0.0
@jayeshkrishna

Copy link
Copy Markdown
Contributor Author

The E3SM nightly builds on Aurora (Intel oneapi) failed due to missing references to pthread functions/library. A fix for this issue will be available soon (The fix is available in E3SM-Project/scorpio#703).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

BFB PR leaves answers BFB CI: approved Allow gh actions PR testing on ghci-snl-* machines SCORPIO The E3SM I/O library (derived from PIO)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants