sample_usability.py script crashes on Windows with conda env

[bhartmoore]

This is not urgent. For creating field test samples, silnlp/common/sample_usability.py consistently crashes before histogram creation in Windows with the conda environment. It creates the usability_sample.tsv file, and then gives an odd file system error that may be related to environment variable setup and/or the way the MinIO bucket is mounted via rclone.

Odd that it appears to be searching for usability_sample_hist.png, which is not saved at the time of the crash.

Traceback (most recent call last):
  File "C:\Users\betha\.conda\envs\silnlp\lib\ntpath.py", line 689, in realpath
    path = _getfinalpathname(path)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'M:\\MT\\experiments\\Nepal\\BahingRai\\2025_10_27\\NLLB.1.3B.npi-NNRV.bhj-BHJB.all\\infer\\5000\\YakNbt_2025_10_27\\usability_sample_hist.png'
.
.
.
OSError: [WinError 1005] The volume does not contain a recognized file system.
Please make sure that all required file system drivers are loaded and that the volume is not corrupted: 'M:\\MT\\experiments\\Nepal\\BahingRai\\2025_10_27\\NLLB.1.3B.npi-NNRV.bhj-BHJB.all\\infer\\5000\\YakNbt_2025_10_27'

Full transcript below:

(silnlp) PS C:\Users\betha\silnlp> poetry run python -m silnlp.common.sample_usability Nepal\BahingRai\2025_10_27\NLLB.1.3B.npi-NNRV.bhj-BHJB.all\infer\5000\YakNbt_2025_10_27\usability_verses.tsv
2025-10-29 13:59:53,338 - silnlp.common.environment - INFO - Using workspace: M:\ as per environment variable SIL_NLP_DATA_PATH.
[nltk_data] Downloading package punkt to
[nltk_data] C:\Users\betha\AppData\Roaming\nltk_data...
[nltk_data] Package punkt is already up-to-date!
{'mu_pop': 0.8890782833769633, 'mu_samp': 0.8874872166666667, 'sd_pop': 0.05343071205988302, 'sd_samp': 0.0690457181048418}
Traceback (most recent call last):
File "C:\Users\betha.conda\envs\silnlp\lib\ntpath.py", line 689, in realpath
path = _getfinalpathname(path)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'M:\MT\experiments\Nepal\BahingRai\2025_10_27\NLLB.1.3B.npi-NNRV.bhj-BHJB.all\infer\5000\YakNbt_2025_10_27\usability_sample_hist.png'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\betha.conda\envs\silnlp\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\betha.conda\envs\silnlp\lib\runpy.py", line 86, in _run_code
exec(code, run_globals)
File "C:\Users\betha\silnlp\silnlp\common\sample_usability.py", line 94, in
main()
File "C:\Users\betha\silnlp\silnlp\common\sample_usability.py", line 90, in main
stratified_sample(usability_verses_file, args.sample_size, args.random_state, args.books)
File "C:\Users\betha\silnlp\silnlp\common\sample_usability.py", line 57, in stratified_sample
plt.savefig(usability_verses_file.parent / "usability_sample_hist.png")
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\pyplot.py", line 1228, in savefig
res = fig.savefig(*args, **kwargs) # type: ignore[func-returns-value]
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\figure.py", line 3395, in savefig
self.canvas.print_figure(fname, **kwargs)
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\backend_bases.py", line 2204, in print_figure
result = print_method(
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\backend_bases.py", line 2054, in
print_method = functools.wraps(meth)(lambda *args, **kwargs: meth(
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\backends\backend_agg.py", line 496, in print_png
self._print_pil(filename_or_obj, "png", pil_kwargs, metadata)
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\backends\backend_agg.py", line 445, in _print_pil
mpl.image.imsave(
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\matplotlib\image.py", line 1676, in imsave
image.save(fname, **pil_kwargs)
File "C:\Users\betha.conda\envs\silnlp\lib\site-packages\PIL\Image.py", line 2553, in save
filename = os.path.realpath(os.fspath(fp))
File "C:\Users\betha.conda\envs\silnlp\lib\ntpath.py", line 695, in realpath
path = _getfinalpathname_nonstrict(path)
File "C:\Users\betha.conda\envs\silnlp\lib\ntpath.py", line 643, in _getfinalpathname_nonstrict
path = _getfinalpathname(path)
OSError: [WinError 1005] The volume does not contain a recognized file system.
Please make sure that all required file system drivers are loaded and that the volume is not corrupted: 'M:\MT\experiments\Nepal\BahingRai\2025_10_27\NLLB.1.3B.npi-NNRV.bhj-BHJB.all\infer\5000\YakNbt_2025_10_27'