Skip to content

Commit fff6358

Browse files
committed
Update Readme
1 parent 64eea5a commit fff6358

File tree

2 files changed

+18
-2
lines changed

2 files changed

+18
-2
lines changed

.github/workflows/CI.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,8 @@ jobs:
4141
- uses: julia-actions/julia-runtest@v1
4242
- uses: julia-actions/julia-processcoverage@v1
4343
- uses: codecov/codecov-action@v3
44+
env:
45+
CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
4446
- uses: coverallsapp/github-action@master
4547
with:
4648
github-token: ${{ secrets.GITHUB_TOKEN }}

README.md

Lines changed: 16 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
[![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](https://github.com/meggart/DiskArrayEngine.jl/blob/main/LICENSE)
44
<!-- [![](https://img.shields.io/badge/docs-stable-blue.svg)](https://meggart.github.io/DiskArrayEngine.jl/stable) -->
55
<!-- [![](https://img.shields.io/badge/docs-dev-blue.svg)](https://meggart.github.io/DiskArrayEngine.jl/dev) -->
6-
[![CI](https://github.com/meggart/DiskArrayEngine.jl/actions/workflows/ci.yml/badge.svg)](https://github.com/meggart/DiskArrayEngine.jl/actions/workflows/ci.yml)
6+
[![CI](https://github.com/meggart/DiskArrayEngine.jl/actions/workflows/CI.yml/badge.svg)](https://github.com/meggart/DiskArrayEngine.jl/actions/workflows/CI.yml)
77
[![Codecov](https://codecov.io/gh/meggart/DiskArrayEngine.jl/branch/main/graph/badge.svg)](https://codecov.io/gh/meggart/DiskArrayEngine.jl)
88
<!-- [![Aqua.jl Quality Assurance](https://img.shields.io/badge/Aquajl-%F0%9F%8C%A2-aqua.svg)](https://github.com/JuliaTesting/Aqua.jl) -->
99
[![Downloads](https://shields.io/endpoint?url=https://pkgs.genieframework.com/api/v1/badge/DiskArrayEngine&label=Downloads)](https://pkgs.genieframework.com?packages=DiskArrayEngine)
@@ -24,4 +24,18 @@ Before starting to jump into this package it is worth checking if it is actually
2424
3. Your data is too large to fit into the memory of all your workers when distributed among them (otherwise try [DistributedArrays.jl](https://github.com/JuliaParallel/DistributedArrays.jl))
2525
4. You want to process *all* or almost all of your data and not just a small subset. Otherwise just read the subset of interest into memory and do your processing based on this one
2626

27-
If you are still here
27+
If you are still here you should also note that this package is not intended to be used by end-users directly, but the plan is to wrap functionality from this package
28+
in other packages, in particular YAXArrays.jl, DimensionalData.jl or PyramidSchemes.jl that provide more user-friendly interfaces for the end users.
29+
30+
## Status of the package
31+
32+
This package is still under active development and should be considered experimental. Expect things to break and to already be broken. In particular, extensive documentation and tests are still missing. However, some core functionality of the package is already used by e.g. [PyramidScheme.jl](https://github.com/JuliaDataCubes/PyramidScheme.jl) which is why we decided to already register this package while still under active development.
33+
34+
## Basic package usage
35+
36+
To be done, describe the generalized moving window concept, how to define user functions, lazy interface and which runner options exist
37+
38+
## EngineArrays
39+
40+
The simplest way to use some the machinery in DiskArrayEngine is to wrap any existing DiskArray into an EngineArray by calling `engine(mydiskarray)`. Afterwards, many operations like mapslices, mapreduce, broadcast and simple statistics like mean, median, max/min etc will be dispatch using DiskArrayEngine instead of the simple
41+
DiskArrays.jl implementation and might give significant speedups. However, currently we still default to using the `LocalRunner`, which will only use a single process, we will experiment with defaulting to `DaggerRunner` as soon as multiple processes are available.

0 commit comments

Comments
 (0)