how do I express passthrough extras?

[graingert]

how do I express:

install_requires = ["kombu ~= 5.1"],
extras_require = {
    "sqs": "kombu[sqs] ~= 5.1",
} 

In poetry?

Another Example in the wild https://github.com/dask/s3fs/pull/362/files#diff-60f61ab7a8d1910d86d9fda2261620314edcae5894d5aaa236b821c7256badd7R26

For full context, I'm trying to port celery from setuptools to poetry https://github.com/celery/celery/pull/6874/files

https://github.com/celery/celery/blob/master/requirements/extras/sqs.txt#L1 that's the current implementation but I'm not sure how to port to poetry

[graingert]

Not an answer:

Seems related #2868

[graingert]

And another #834

[qsineu]

I faced the same challenge and found this (not that intuitive) solution which seems to work:

[tool.poetry.dependencies]
....
kombu = [
    {version = "~5.1", extras = ["sqs"], markers="extra=='sqs'"}, # marker-extra is the extra of your package
    {version = "~5.1", markers="extra!='sqs'"},
]	
...
[tool.poetry.extras]
sqs = [... ] # No need to declare kobu here

I Adapted your example above without testing. But it worked with my similar case.

[DaanRademaker]

I was so excited to try this out, but @philipGaudreau is right. This does not work with poetry install :( I really need this feature. Hope there is some solution to this.

[timelfrink]

I'm also facing this issue right now, did you solve it in the end @DaanRademaker ?

[charleswilmot]

[tool.poetry.dependencies]
python = ">=3.10"
hydra-core=">=1.3"
flax = "^0.9.0"
jax = [
  {version="^0.4.31", markers="extra!='gpu'"},
  {extras=["cuda12"], version="^0.4.31", markers="extra=='gpu'"},
]
tensorflow = "^2.17.0"
wandb = "^0.17.8"
optax = "^0.2.3"
pandas = "^2.2.2"
matplotlib = "^3.9.2"


[tool.poetry.extras]
gpu = ["jax"]

Followed by

poetry install --extras gpu

or

poetry install

Results in the expected behavior for me with poetry v1.8.2

[kikones34]

@charleswilmot This does not work for me, jax doesn't get installed at all without the gpu extra. Poetry 1.8.3.

[amirebrahimi]

What I did to get this to work (using poetry v1.3.2) is:

jax = [
    { version = "^0.5" },
    { version = "^0.5", extras = ["cuda12"], markers = "extra=='gpu'", optional = true }
]

[tool.poetry.extras]
gpu = ["jax"]

If no extras are specified (i.e. poetry install), then jax will install as expected:

If I install with poetry install --extras=gpu:

And if I run poetry install again you'll see it removes the gpu extras:

[amirebrahimi]

I'm stuck with the same problem and specifically for jax. I wish there was a workaround.

[kikones34]

They tried to implement a workaround in 2.0.0 but it only half-works, see #10120