Skip to content

Commit 688cb2c

Browse files
committed
switch to python-dvuploader package
1 parent cbdffca commit 688cb2c

File tree

5 files changed

+15
-7
lines changed

5 files changed

+15
-7
lines changed

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,2 @@
11
*~
2+
*.egg-info

Dockerfile

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,8 @@
1-
FROM eclipse-temurin:21
2-
ARG VERSION=v1.2.1
1+
FROM python:3.13-slim
32
WORKDIR /opt/app
4-
ADD https://github.com/GlobalDataverseCommunityConsortium/dataverse-uploader/releases/download/$VERSION/DVUploader-$VERSION.jar DVUploader.jar
5-
ENTRYPOINT ["java", "-jar", "DVUploader.jar"]
3+
4+
# Install python-dvuploader dependencies
5+
COPY requirements.txt /tmp
6+
RUN pip install -r /tmp/requirements.txt
7+
8+
ENTRYPOINT [ "dvuploader" ]

README.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,7 @@
11
# DVUploader Docker Wrapper
22

3+
This wraps the Python [dvuploader](https://github.com/gdcc/python-dvuploader/) package that provides parallel direct upload to Dataverse.
4+
35
## Volumes
46

57
The wrapper needs both Digital Assets and the Dataverse Prod volumes mounted at the following locations:
@@ -33,8 +35,8 @@ Defaults!/usr/local/sbin/dvuploader.sh !always_set_home
3335
%dpgdil ALL=(root) NOPASSWD: /usr/local/sbin/dvuploader.sh
3436

3537
# Then members of dpgdil can run your script like so
36-
dvuploader -key=$key -server=$server da/path/to/some/datadir
37-
dvuploader -key=xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxx -server=https://datasets.lib.berkeley.edu -did=doi:10.60503/D3/XXXXX /srv/dataverse/XXXXX
38+
dvuploader da/path/to/some/filepaths --api-token $key --dataverse-url $server
39+
dvuploader /srv/dataverse/XXXXX --api-token xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxx --dataverse-url https://datasets.lib.berkeley.edu --pid doi:10.60503/D3/XXXXX --recurse
3840

3941
# Note that the local directory /srv/dataverse-prod/dvsantee/etl/processing/ is mapped to /srv/dataverse when you run the dvuploader script
4042
```

docker-compose.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,4 @@ services:
66
image: ghcr.io/berkeleylibrary/dvuploader:${USER:-default}-development
77
volumes:
88
- /srv/da:/opt/app/da:ro
9-
- /srv/dataverse-prod/dvsantee/etl/processing:/opt/app/dataverse:ro
9+
- /srv/dataverse-prod/dvsantee/etl/processing:/opt/app/dataverse:ro

requirements.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
# once dvuploader 0.3.0 is out, point this to a proper release spec
2+
dvuploader @ https://github.com/BerkeleyLibrary/python-dvuploader/archive/refs/heads/include-tab-ingest-rebased.zip

0 commit comments

Comments
 (0)