Skip to content

Spark properties conflict when dynamicAllocation is disabled and the detailed DA attributes are not greyed out #278

@VictorShiAmazingGrace

Description

@VictorShiAmazingGrace
Image

As a general UX fix, please create the dependency that when the dynamicAllocation is disabled, all those detailed dynamicAllocation attributes must be greyed out. Otherwise, the user will get the follwoing error message: "HTTP 400: Bad Request (Error from Gateway: [Bad Request] [400 Bad Request] generic::invalid_argument: com.google.cloud.hadoop.services.common.error.DataprocException: com.google.cloud.hadoop.services.common.error.DataprocException: [spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors, spark.dynamicAllocation.maxExecutors, spark.dynamicAllocation.executorAllocationRatio] properties cannot be set when spark.dynamicAllocation.enabled is disabled (INVALID_ARGUMENT) (CONFIG) (INVALID_ARGUMENT) (CONFIG) . Ensure gateway url is valid and the Gateway instance is running.)"

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions