Define variables, frequencies and realms for data expected over next months

[durack1]

We'll need to define the expected variables, frequencies, and realms for data appearing in the next months. Once this list is defined, tables meeting these needs can be finalized for inclusion and use in demos.

We have a NCA6 planning spreadsheet - would that be linkable to this issue?

@gleckler1 @paullric

[paullric]

For the time being we'll only be managing daily tasmin, tasmax and pr. The list of data products for NCA6 isn't public yet, nor fully decided upon.

[durack1]

Changes implemented in #28 create a file following the spec below. The DRS has been reformulated to keep consistency between directory and filenames - downscaling information precedes the input/driving/CMIP6 inputs that are being downscaled

The current working prototype creates the following templated file:

// global attributes:
:Conventions = "CF-1.7 CMIP-6.5" ;
:activity_id = "DRCDP" ;
:contact = "Daniel Feldman; DRFeldman AT lbl DOT gov" ;
:creation_date = "2025-02-17T00:17:59Z" ;
:data_specs_version = "6.5.0.0; mip-cmor-tables; f42386929a0057ed15e66a3bac045b8c00d33c0f" ;
:driving_activity_id = "CMIP" ;
:driving_experiment_id = "historical" ;
:driving_mip_era = "CMIP6" ;
:driving_source_id = "ACCESS-CM2" ;
:driving_variant_label = "r1i1p1f1" ;
:external_variables = "areacella" ;
:frequency = "day" ;
:further_info_url = "https://loca.ucsd.edu/" ;
:grid = "5 x 5 km latitude x longitude" ;
:grid_label = "gn" ;
:history = "2025-02-17T00:17:59Z; CMOR rewrote data to be consistent with DRCDP, CMIP6, CMIP6Plus and CF-1.7 CMIP-6.5 standards" ;
:institution_id = "UCSD-SIO" ;
:license_id = "Creative Commons Attribution 4.0 International" ;
:license_url = "https://creativecommons.org/licenses/by/4.0/" ;
:nominal_resolution = "5 km" ;
:product = "downscaled-statistical" ;
:realm = "atmos" ;
:reference = "Pierce, David W., Daniel R. Cayan, and Bridget L. Thrasher (2014) Statistical downscaling using Localized Constructed Analogs (LOCA). Journal of Hydrometeorology, 15 (6), pp 2558-2585. https://doi.org/10.1175/JHM-D-14-0082.1" ;
:region = "north_america" ;
:region_id = "NAM" ;
:source = "LOCA 2.1: Statistically-downscaled climate model projections based on CMIP6" ;
:source_id = "LOCA2-1" ;
:source_name = "LOCA" ;
:source_version_number = "2.1" ;
:table_id = "APday" ;
:table_info = "Creation Date:(2025-02-15) MD5:8761bc8bd1c21085d34b5374c7e646c5" ;
:title = "LOCA 2.1 dataset prepared for DRCDP" ;
:tracking_id = "hdl:21.14100/31fd4281-b141-4f38-9ad7-4883a1ab5f91" ;
:variable_id = "tasmax" ;
:variant_info = "DRCDP-compliant dataset prepared by PCMDI" ;
:variant_label = "PCMDI" ;
:license = "CC BY 4.0" ;
:cmor_version = "3.9.0" ;
}
$ ncdump -h demo/DRCDP/NAM/UCSD-SIO/LOCA2-1/CMIP6/CMIP/historical/ACCESS-CM2/r1i1p1f1/day/tasmax/v20250216/
tasmax_NAM_UCSD-SIO_LOCA2-1_PCMDI_CMIP6_historical_ACCESS-CM2_r1i1p1f1_day_19500102-19500131.nc

[durack1]

@gleckler1 @paullric will need to circle on the above info to make sure these changes sit well with you both. The logic of DRS (dir template) and filenames now follow one another far more logically, and will allow for a directory tree to be built which facilitates data discovery with wildcards toggling either downscale method/source_id or the CMIP6 (currently) data being used to drive the downscaling method

[gleckler1]

@durack1 @paullric PD proposed changes to fnm and dir templates now included in DRCDP draft data specs linked to in this repo.

[durack1]

Discussion with @gleckler1 suggests nixing variant_info and variant_label, simplifying DRCDP-LOCA2-1-demo_user_input.json and DRCDP_required_global_attributes.json

[durack1]

@gleckler1 new simple templates implemented, as noted above (variant_* entries removed):

// global attributes:
:Conventions = "CF-1.7 CMIP-6.5" ;
:activity_id = "DRCDP" ;
:contact = "Daniel Feldman; DRFeldman@lbl.gov" ;
:creation_date = "2025-02-18T23:57:14Z" ;
:data_specs_version = "6.5.0.0; mip-cmor-tables; f42386929a0057ed15e66a3bac045b8c00d33c0f" ;
:driving_activity_id = "CMIP" ;
:driving_experiment_id = "historical" ;
:driving_mip_era = "CMIP6" ;
:driving_source_id = "ACCESS-CM2" ;
:driving_variant_label = "r1i1p1f1" ;
:external_variables = "areacella" ;
:frequency = "day" ;
:further_info_url = "https://loca.ucsd.edu/" ;
:grid = "5 x 5 km latitude x longitude" ;
:grid_label = "gn" ;
:history = "2025-02-18T23:57:14Z; CMOR rewrote data to be consistent with DRCDP, CMIP6, CMIP6Plus and CF-1.7 CMIP-6.5 standards" ;
:institution_id = "UCSD-SIO" ;
:license_id = "Creative Commons Attribution 4.0 International" ;
:license_url = "https://creativecommons.org/licenses/by/4.0/" ;
:nominal_resolution = "5 km" ;
:product = "downscaled-statistical" ;
:realm = "atmos" ;
:reference = "Pierce, David W., Daniel R. Cayan, and Bridget L. Thrasher (2014) Statistical downscaling using Localized Constructed Analogs (LOCA). Journal of Hydrometeorology, 15 (6), pp 2558-2585. https://doi.org/10.1175/JHM-D-14-0082.1" ;
:region = "north_america" ;
:region_id = "NAM" ;
:source = "LOCA 2.1: Statistically-downscaled climate model projections based on CMIP6" ;
:source_id = "LOCA2-1" ;
:source_name = "LOCA" ;
:source_version_number = "2.1" ;
:table_id = "APday" ;
:table_info = "Creation Date:(2025-02-15) MD5:0d9a95eeda6ac99015db0a40b7419a80" ;
:title = "LOCA 2.1 dataset prepared for DRCDP" ;
:tracking_id = "hdl:21.14100/7ff0382e-1ef0-44b9-bb1d-1b0a20731efb" ;
:variable_id = "tasmax" ;
:license = "CC BY 4.0" ;
:cmor_version = "3.9.0" ;
}

Changes are now in main branch for testing

[durack1]

@gleckler1 the <variant_label> was still included in the DRCDP_DRS.json, have now removed that - see latest main

[gleckler1]

@durack1 are you ready for me to take the updated demo input json and adopt it to LOCA2 and STAR-ESDM?

[durack1]

@gleckler1 did you want that additional layer of abstraction, removing the below from the user_input.json file?

DRCDP/DataPreparationExamples/DEMO/DRCDP-LOCA2-1-demo_user_input.json

Lines 11 to 20 in 736b7c2

	"#comment": "The following are DRCDP project specific settings and should not be user edited",
	"tracking_prefix": "hdl:21.14100",
	"output_file_template": "<variable_id><region_id><institution_id><source_id><driving_mip_era><driving_experiment_id><driving_source_id><driving_variant_label><frequency>",
	"output_path_template": "<activity_id><region_id><institution_id><source_id><driving_mip_era><driving_activity_id><driving_experiment_id><driving_source_id><driving_variant_label><frequency><variable_id><version>",
	"#comment": "The following are CMOR internal settings and should not be user edited",
	"_history_template": "%s; CMOR rewrote data to be consistent with <activity_id>, CMIP6, CMIP6Plus and <Conventions> standards",
	"_AXIS_ENTRY_FILE": "DRCDP_coordinate.json",
	"_FORMULA_VAR_FILE": "DRCDP_formula_terms.json",
	"_controlled_vocabulary_file": "DRCDP_CV.json"