Skip to content

publish: should be able to identify removed remote clones and fail informatively #44

Description

@yarikoptic
(git)smaug:…btrfs/datasets/datalad/crawl/labs/poldrack/NP-180740/sourcedata[master]git
$> datalad publish --to=datalad-public -r --missing skip  # just let's do a full sweep
[INFO   ] Publishing <Dataset path=/mnt/btrfs/datasets/datalad/crawl/labs/poldrack/NP-180740/sourcedata> data to datalad-public 
Total (0 ok, 604 failed out of 604):   0%|                                                                                                                                                             | 0.00/10.4G [00:39<?, ?B/s]
[WARNING] Running copy resulted in stderr output: git-annex-shell: expected repository UUID d326b73e-1f9f-4ed0-97cb-1bbfd24f5057 but found UUID b38aead5-b9da-4fac-8588-286990fd2c94
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(235) [sender=3.1.3]
rsync exited 12
git-annex-shell: expected repository UUID d326b73e-1f9f-4ed0-97cb-1bbfd24f5057 but found UUID b38aead5-b9da-4fac-8588-286990fd2c94
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(235) [sender=3.1.3]
rsync exited 12
git-annex-shell: expected repository UUID d326b73e-1f9f-4ed0-97cb-1bbfd24f5057 but found UUID b38aead5-b9da-4fac-8588-286990fd2c94
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(235) [sender=3.1.3]
rsync exited 12
git-annex-shell: expected repository UUID d326b73e-1f9f-4ed0-97cb-1bbfd24f5057 ... 
                                                                                                                                                                                                                                   
datalad publish --to=datalad-public -r --missing skip  12.32s user 5.71s system 44% cpu 40.903 total

$> datalad --version
datalad 0.12.5.dev606

yet to check where it gets ideas about uuid b38aead5-b9da-4fac-8588-286990fd2c94, but the point is that sourcedata isn't published to http://datasets.datalad.org/?dir=/labs/poldrack/NP-180740 . there is only an empty directory (as for any non "fulfilled" git submodule). So some check fails, it tries to copy data there for a while only to fail with various cryptic messages as per above.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions