Skip to content

implement mapreduce for SkipMissingVal - #813

Closed
tiemvanderdeure wants to merge 1 commit into
rafaqz:mainfrom
tiemvanderdeure:mapreduce_skipmissingval
Closed

tiemvanderdeure wants to merge 1 commit into
rafaqz:mainfrom
tiemvanderdeure:mapreduce_skipmissingval

Conversation

@tiemvanderdeure

Copy link
Copy Markdown
Collaborator

The implementations is copy-pasted from Base, except that ismissing(ai) is replaced by _missing(ai, itr)

Solves #812

I'm not sure what this means for lazy rasters and chunked data from diskarrays. We might want to overload IndexStyle for those? Let's see if tests pass.

@tiemvanderdeure

Copy link
Copy Markdown
Collaborator Author

ArchGDAL still segfaults on some resample.

There is a PR that will fix this in Julia base and make this unnecessary: JuliaLang/julia#52397. So we can choose to wait it out.

@rafaqz

rafaqz commented Nov 5, 2024

Copy link
Copy Markdown
Owner

Oh maybe we can wait for base iterators to be fixed? This will break DiskArrays.

And yes, it still segfaults.

@rafaqz

rafaqz commented Nov 12, 2024

Copy link
Copy Markdown
Owner

Lets close and wait for Base

@rafaqz rafaqz closed this Nov 12, 2024
@asinghvi17

Copy link
Copy Markdown
Collaborator

Should we recommend some more accurate summation algorithms in the meantime? Maybe in the zonal docs?

@rafaqz

rafaqz commented Nov 12, 2024

Copy link
Copy Markdown
Owner

Yeah possibly. Maybe when we allow online stats we can recommend that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants