Skip to content

Commit 29b4369

Browse files
authored
big_data.rst minor fixes and movement
1 parent 90ae4ed commit 29b4369

File tree

1 file changed

+6
-7
lines changed

1 file changed

+6
-7
lines changed

docs/day3/big_data.rst

Lines changed: 6 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -608,7 +608,6 @@ Exercise file formats (10 minutes)
608608
- Start Jupyter or just a Python shell and
609609
- Go though and test the lines at the page at https://docs.scipy.org/doc/scipy-1.13.1/reference/generated/scipy.io.netcdf_file.html
610610

611-
612611
Computing efficiency with Python
613612
--------------------------------
614613

@@ -743,11 +742,6 @@ Polars package
743742

744743
https://pola.rs/
745744

746-
Workflow
747-
--------
748-
749-
Data source → Format choice → Load/Chunk → Process → Write
750-
751745
Exercises
752746
---------
753747

@@ -866,6 +860,9 @@ Exercises
866860
Summary
867861
-------
868862

863+
Workflow
864+
........
865+
869866
.. discussion:: Follow-up discussion
870867

871868
- New learnings?
@@ -879,7 +876,9 @@ Summary
879876
- Load Python modules and activate virtual environments.
880877
- Request appropriate memory and runtime in SLURM.
881878
- Store temporary data in local scratch ($SNIC_TMP).
882-
- Check job memory usage with sacct or sstat.
879+
- Check job memory usage with ``sacct`` or ``sstat``.
880+
881+
Data source → Format choice → Load/Chunk → Process → Write
883882

884883
.. keypoints::
885884

0 commit comments

Comments
 (0)