dealbot should initiate transactions according to the upper and lower file size limits of the PDP node.

[beck-8]

StorageContext upload failed: Data size 1142800473 bytes exceeds maximum allowed size of 1065353216 bytes (1016 MiB)

[BigLep]

2025-12-19 conversation: agreed this should be fixed.

1. We need to make sure Synapse is handling this right
2. We also need to make sure that Kaggle API responses give us data within the size we request

[DarkLord017]

can i take this up

[SgtPooki]

@DarkLord017 yes, please go ahead.

[BigLep]

This can be look at post GA. I have updated the milestone. For GA, we're going to use smaller file sizes (e.g., 1MB), at which point this isn't a concern.

[SgtPooki]

FYI we are using 10MiB files now and is the default config.

However, there is a case where SPs may have smaller/larger limits in filesize in which case we should log some error/warning.