You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently I have an issue with Dagster automation.
I am deploying Dagster using docker compose on a virtual machine.
But now when a scheduled task tries to evaluate I receive the following error:
dagster._core.errors.DagsterInvalidConfigError: Errors whilst loading configuration for {'postgres_url': Field(<dagster._config.source.StringSourceType object at 0x7f631dfdbfb0>, default=@, is_required=False), 'postgres_db': Field(<dagster._config.field_utils.Shape object at 0x7f62fc24c3b0>, default=@, is_required=False), 'should_autocreate_tables': Field(<dagster._config.config_type.Bool object at 0x7f631df89160>, default=True, is_required=False)}.
Error 1: Post processing at path root:postgres_db:username of original value {'env': 'DAGSTER_POSTGRES_USER'} failed:
dagster._config.errors.PostProcessingError: You have attempted to fetch the environment variable "DAGSTER_POSTGRES_USER" which is not set. In order for this execution to succeed it must be set in this environment.
This error appears in the tick evaluation step.
I have set the appropriate environment variables in the docker-compose.yml file:
daemon:
build:
context: .
entrypoint:
- dagster-daemon
- run
container_name: daemon
restart: unless-stopped
environment:
DAGSTER_POSTGRES_USER: dagster
DAGSTER_POSTGRES_PASSWORD: <password>
DAGSTER_POSTGRES_DB: dagster
volumes: # Make docker client accessible so we can launch containers using host docker
- /var/run/docker.sock:/var/run/docker.sock
- /tmp/io_manager_storage:/tmp/io_manager_storage
- ./workspace.yaml:/opt/dagster/dagster_home/workspace.yaml
depends_on:
postgres:
condition: service_healthy
When I'm running a job I receive no error and everything works fine, but this tick evaluation fails every time.
The schedule code does not access those variables.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
Currently I have an issue with Dagster automation.
I am deploying Dagster using docker compose on a virtual machine.
But now when a scheduled task tries to evaluate I receive the following error:
This error appears in the tick evaluation step.
I have set the appropriate environment variables in the
docker-compose.yml
file:Also they are forwarded in the
dagster.yaml
file:When I'm running a job I receive no error and everything works fine, but this tick evaluation fails every time.
The schedule code does not access those variables.
How can I fix that issue?
Thank you!
Beta Was this translation helpful? Give feedback.
All reactions