Skip to content

Task-conditioned Helios model #181

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 16 commits into
base: master
Choose a base branch
from
Draft

Task-conditioned Helios model #181

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
65f36b5
Start task config work
ryspark Aug 12, 2025
f96481f
Fix partial checkpointing
ryspark Aug 12, 2025
64729e8
Update checkpointing, task embeds
ryspark Aug 18, 2025
ea6a1e9
Merge branch 'master' into ryanp/task_embed
ryspark Aug 18, 2025
2a0bd33
Update dockerfile for uv, cfgs
ryspark Aug 18, 2025
006504f
Merge branch 'master' into ryanp/task_embed
ryspark Aug 18, 2025
d2ed8de
Config updates
ryspark Aug 21, 2025
038a94d
Merge branch 'master' into ryanp/task_embed
ryspark Aug 21, 2025
b2ca787
Update scripts
ryspark Aug 25, 2025
f08df13
Update experiments
ryspark Aug 26, 2025
e6cdc81
Merge branch 'master' into ryanp/task_embed
ryspark Aug 26, 2025
2618e95
Update scripts
ryspark Aug 27, 2025
c81932b
Update scripts, add save_eval_path
ryspark Aug 28, 2025
132ecb0
Update scripts, move moe to rslp
ryspark Aug 29, 2025
5ef39cc
Update scripts
ryspark Aug 29, 2025
f73152d
Merge branch 'master' into ryanp/task_embed
ryspark Aug 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ rslp/crop_type_mapping/csv/
rslp/crop_type_mapping/geoparquets/
rslp/mangrove/csv/
log*.txt
*.egg-info

# for local finetuning runs
/config.yaml
Expand Down
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_07_31_moe/OUT_classify.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1029,7 +1029,7 @@ model:
class_path: rslearn.models.trunk.DecoderTrunk
init_args:
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
expert_mult: 2
Expand Down
10 changes: 4 additions & 6 deletions one_off_projects/2025_07_joint_finetune/configs/2025_07_31_moe/OUT_detect.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1529,14 +1529,13 @@ model:
class_path: rslearn.models.trunk.DecoderTrunk
init_args:
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
expert_mult: 2
n_heads: 12
n_layers: 2
num_experts: 8
num_slots: 1
n_layers: 1
num_experts: 4
num_slots: 4
task_embedding:
class_path: rslearn.models.task_embedding.TaskChannelEmbedding
init_args:
Expand Down Expand Up @@ -1765,5 +1764,4 @@ trainer:
- 0
unfreeze_at_epoch: 20
unfreeze_lr_factor: 10
limit_val_batches: 1024
max_epochs: 200
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_07_31_moe/OUT_segment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1217,7 +1217,7 @@ model:
class_path: rslearn.models.trunk.DecoderTrunk
init_args:
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
expert_mult: 2
Expand Down
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_07_31_moe/classify.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ global_overrides:
encoder_embedding_size: 768
add_spatial_embed: true
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
n_layers: 2
Expand Down
10 changes: 4 additions & 6 deletions one_off_projects/2025_07_joint_finetune/configs/2025_07_31_moe/detect.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,16 +31,14 @@ global_overrides:
encoder_embedding_size: 768
add_spatial_embed: true
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
n_layers: 2
n_layers: 1
n_heads: 12
num_experts: 8
num_slots: 1
expert_mult: 2
num_experts: 4
num_slots: 4
trainer:
limit_val_batches: 1024
accumulate_grad_batches: 5

merge_options:
Expand Down
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_07_31_moe/segment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ global_overrides:
encoder_embedding_size: 768
add_spatial_embed: true
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
n_layers: 2
Expand Down
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_08_06_isolate_sft/classify.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ global_overrides:
encoder_embedding_size: 768
add_spatial_embed: true
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
n_layers: 1
Expand Down
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_08_06_isolate_sft/detect.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ global_overrides:
encoder_embedding_size: 768
add_spatial_embed: true
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
n_layers: 1
Expand Down
2 changes: 1 addition & 1 deletion one_off_projects/2025_07_joint_finetune/configs/2025_08_06_isolate_sft/segment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ global_overrides:
encoder_embedding_size: 768
add_spatial_embed: true
layers:
- class_path: rslearn.models.trunk.MoETransformer
- class_path: rslp.helios.moe.MoETransformer
init_args:
dim: 768
n_layers: 1
Expand Down
Loading
Loading