-
Notifications
You must be signed in to change notification settings - Fork 102
Open
Description
I had a code which ran a delayed function as a task. I would run this task with different inputs various times. For this reason i included gc.collects inside the function. When running, i could see in the dask dashboard that every task was taking progressively longer for no apparent reason. When i returned to the old version 23.8, everything worked normally. Even without the cg.collects inside the code, the running tasks showed some tasks (probably i assume when gc.collect ran by itself automatically) tasks would take a lot longer. Even thkugh most were taking the expected time, every 20 tasks there was one much longer, and also progressively longer
Metadata
Metadata
Assignees
Labels
No labels