New LM-based tagger#13

Merged

cnewman merged 22 commits intomasterfrom

Jun 10, 2025

Commits on Jun 2, 2025

Add new type of tagger
Christian Newman
committed

Commits on Jun 3, 2025

Prepare to re-add kfold
Christian Newman
committed
Load model when server runs, listen for url
cnewman
committed

Commits on Jun 4, 2025

A half vibe coded mess, but I think it works. Needs a ton of clean up.
cnewman
committed
Fix bug with the masking
cnewman
committed
Remove system as a feature
cnewman
committed
Update to pull from huggingface or local based on --local
cnewman
committed
Fix requirements and I dunno how the crf imports are working
Christian Newman
committed
Remove req that won't work on windows
cnewman
committed
Greatly reduce the requirements.txt to just the top level reqs
Christian Newman
committed
Merge branch 'distilbert' of github.com:SCANL/scanl_tagger into distilbert
Christian Newman
committed
Make it so that classification report gets printed to a file
cnewman
committed
Update readme
Christian Newman
committed

Commits on Jun 5, 2025

DRY
Christian Newman
committed

Commits on Jun 8, 2025

Commits on Jun 10, 2025

Tested tree and lm based run and train. Did some thorough documenting on how the nn code works.
Christian Newman
committed
Update readme with new arguments and data
Christian Newman
committed
git workflow
Christian Newman
committed
Starting to see if I can get Doker up again. Update requirements with nltk for tree_based model
Christian Newman
committed
add download_files() to lm execution flow for the way we are currently using cache-- this should probably be fixed
Christian Newman
committed
Forgot to run process in the bg for github actions
Christian Newman
committed