Skip to content

Releases: broadinstitute/sparklespray

Release 5.8.0

13 Nov 13:59
@pgm pgm

Choose a tag to compare

Release 5.8.0 Pre-release
Pre-release

This release adds support for mounting Google Cloud Storage buckets as directories. To do so specify the disk type as gcs and the name as some google bucket path like gs://mybucket/folder in your .sparkles config.

For example:

mount_count=2
mount_2_path=/mnt/disks/bucket
mount_2_type=gcs
mount_2_name=gs://sparkles-bucket/sparkles-testing

Upon the start of the job, the files in gs://sparkles-bucket/sparkles-testing will be accessible as read-only files at the path /mnt/disks/bucket

v5.7.0

23 Oct 14:10
@pgm pgm

Choose a tag to compare

This version includes:

  • in sparkles sub ... job name ( -n ) is required because not providing it was causing it to generate a job name which was was used in a Batch API call, but the Batch API has constraints on the format of the ID and the default job ID violates those constraints.
  • in sparkles setup it will now automatically apply grants to the service account such that it has access to all docker images residing in artifact registry mentioned in the config
  • in sparkles setup some more retry logic has been added for known spurious failures which occur when an account is first created.

v5.5.0

15 Jul 19:08
@pgm pgm

Choose a tag to compare

Fixes problem where docker images configured to run as non-root users would fail upon startup.

(Specifically they'd report a permissions error when trying to create /mnt/data)

This has been worked around by adding the option "-u 0" to the docker command (and thus forcing the user within the container to be root)

v5.4.1

14 Jun 11:39
@pgm pgm

Choose a tag to compare

Fixed problem which caused too few preemptive nodes from being created

v5.4.0

11 Jun 23:43
@pgm pgm

Choose a tag to compare

v5.4.0 Pre-release
Pre-release

Added back support for healing cluster when nodes are preempted (will provision new nodes as well as mark claimed nodes as pending for re-execution)

v5.3.6

09 Jun 19:53
@pgm pgm

Choose a tag to compare

v5.3.6 Pre-release
Pre-release

Fix for problem with creation of non-preemptable instances

v5.3.5

09 Jun 17:03
@pgm pgm

Choose a tag to compare

v5.3.5 Pre-release
Pre-release

Various bug fixes in running workflows

Download v5.3.5

v5.3.1

03 Jun 02:32
@pgm pgm

Choose a tag to compare

v5.3.1 Pre-release
Pre-release

Various bug fixes to workflow execution and improvements to error messages

Full Changelog: v5.3.0...v5.3.1
sparklespray-5.3.1.tar.gz

v5.3.0

30 May 17:39
@pgm pgm

Choose a tag to compare

v5.3.0 Pre-release
Pre-release

Various bug fixes

sparklespray-5.3.0.tar.gz

v5.2.0

22 May 18:31
@pgm pgm

Choose a tag to compare

v5.2.0 Pre-release
Pre-release

Switched job submission to use google batch API from google life science API.

Added new "workflow" mode for running a sequence of jobs.

Download v5.2.0