PBSscheduler not working on ANL Polaris

[minxu74]

The problem

The PBS scheduler in the REF did not work with the PBSpro used by the ANL Polaris HPC:

• no jobfs and storage options for the Polaris PBSpro and current implementation set them required.
• the test of select did not work

            result = subprocess.run(  # noqa: S603
                [qsub_path, "-l", "wd,select=1:ncpus=1", "--version"],
                capture_output=True,
                timeout=5,
                check=False,
            )

with error "sub: invalid option -- '-'"

Definition of "done"

Additional context

[minxu74]

@rbeucher Could you take a look it if you have time?