BC-ERDDAP

---

To run 'package' from terminal

$ python3 -m bcedd

To get help/usage message

$ python3 -m bcedd --help

To run bcedd inside a wrapper

$ python3 wrapper.py

Configuration file

This file contains configuration parameters

NOTE: arguments overwrite value in configuration file.

Put your own configuration file in ~/.config/bcedd/config.yaml

# This is the default config file for bcedd

paths:
    # erddap: path of the main ERDDAP repository [tomcat]
    erddap: '/home/jpa029/Code/apache-tomcat-8.5.57'
    # dataset: path where store file from each dataset
    dataset:
        # path where store xml file from ICOS CP for each dataset
        xml: '/home/jpa029/Data/BC-ERDDAP/dataset/xml'
    # log: path where store output log file
    log: '/home/jpa029/Data/BC-ERDDAP/log'

# log:
log:
    # filename: logger filename [default 'debug.log']
    filename:
    # below, apply only on standard output log
    # verbose: activate verbose mode [True|False]
    verbose: False
    # level: log level [DEBUG, INFO, WARN, ERROR, CRITICAL]
    level: 'INFO'

authorised:
    # eddtype: list of authorised eddtype
    eddtype: ['table', 'grid']
    # frequency: list of authorised frequency
    frequency: ['weekly', 'monthly']

# update:
update:
    # freq: update frequency to be applied ['weekly', 'monthly']
    freq: 'monthly'

extra:
    # parameters: extra parameters configuration file for bcedd
    parameters: 'parameters.yaml'

Parameters files

This file contains parameters to run

# This is the parameters file for bcedd

# sever: list of remote ERDDAP server to be check
server:
  # erddap server's name:
  #   url: 'https://template'
  #   type:           # ['table', 'grid']
  #     - 'table'
  #     - 'grid'
  #   freq: 'weekly'  # ['weekly', 'monthly']
  emodnet:
    url: 'https://erddap.emodnet-physics.eu/erddap'
    type:
      - 'grid'
      - 'table'
    freq: 'monthly'

# keep: list of datasetID to keep, whatever the remote ERDDAP server
keep:
  #  - datasetid1
  #  - datasetid2
  - EP_ERD_INT_PHPH_AL_PR_NRT
  - EP_ERD_INT_PHPH_AL_TS_NRT

To run tests

see HERE

To install set up/update package library

see PACKAGE.md

Use cron to schedule job

$ crontab -e

# crontab -e
SHELL=/bin/bash
MAILTO=jpa029@uib.no

# Example of job definition:
# m h dom mon dow   command

# * * * * *  command to execute
# ┬ ┬ ┬ ┬ ┬
# │ │ │ │ │
# │ │ │ │ │
# │ │ │ │ └───── day of week (0 - 6) (Sunday=0 or 7) OR sun,mon,tue,wed,thu,fri,sat
# │ │ │ └────────── month (1 - 12)
# │ │ └─────────────── day of month (1 - 31)
# │ └──────────────────── hour (0 - 23)
# └───────────────────────── min (0 - 59)

# For details see man 4 crontabs

# weekly update (monday at 01:30) of ERDDAP server
30 01 * * 1 python3 -m bcedd -f 'weekly' --log_filename 'debug.weekly.log'

# monthly update (first day of each month at 02:30) of ERDDAP server
30 02 1 * * python3 -m bcedd -f 'monthly' --log_filename 'debug.monthly.log'