Skip to content

Doc tuning parameters - #84

Open
rogerkuou wants to merge 9 commits into
mainfrom
doc_tuning_parameters
Open

Doc tuning parameters#84
rogerkuou wants to merge 9 commits into
mainfrom
doc_tuning_parameters

Conversation

@rogerkuou

@rogerkuou rogerkuou commented Aug 13, 2026

Copy link
Copy Markdown
Collaborator

fix #80

Added a README file documenting the tuning parameters and testing results on the best tuned model.

Tuning testing results are in /work/<account_id>/eso4clima/tune/run_best_model

Testing loss on year 2022 is 0.0367

@rogerkuou
rogerkuou marked this pull request as ready for review August 14, 2026 11:09
@rogerkuou

Copy link
Copy Markdown
Collaborator Author

Hi @SarahAlidoost the best tuning model has ben run against the test dataset. The loss looks okay.

Can you review this? Thanks!

Comment thread scripts/README.md Outdated
Comment thread scripts/README.md Outdated
Comment thread scripts/README.md Outdated
Comment thread scripts/run_best_tuned_model.slurm Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/run_best_tuned_model.py Outdated
Comment thread scripts/README.md
Comment thread scripts/run_best_tuned_model.py

@SarahAlidoost SarahAlidoost left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rogerkuou Thanks! Looks good 👍 I added a few comments. Let me know if something is unclear.

Comment thread scripts/README.md Outdated
@rogerkuou

Copy link
Copy Markdown
Collaborator Author

Hi @SarahAlidoost , I adapted all your suggestions. Do you want to give another look? Thanks!

time_features=time_features,
land_mask=lsm_mask["lsm"],
patch_size=(1, *spatial_patch_size),
stride=stride,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
stride=stride,
stride=None,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't need stride for inference. This argument is mainly for creating more data samples during training.

patch_size[1] * num_patches[0],
patch_size[2] * num_patches[1],
)
stride = (20, 20)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
stride = (20, 20)


dataloader_config = DataLoaderConfig(
batch_size=10,
shuffle=True,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
shuffle=True,
shuffle=False,

batch_size=10,
shuffle=True,
num_workers=0,
pin_memory=False,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
pin_memory=False,
pin_memory=True, # set it to True when device=cuda


source /home/b/b383704/eso4clima/ClimaNet/.venv/bin/activate

python -u /home/b/b383704/eso4clima/run_best_tuned_model/run_best_tuned_model.py \

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
python -u /home/b/b383704/eso4clima/run_best_tuned_model/run_best_tuned_model.py \
python -u ./Climanet/scripts/run_best_tuned_model.py \


python -u /home/b/b383704/eso4clima/run_best_tuned_model/run_best_tuned_model.py \
--experiment-path /work/bd0854/eso4clima/tune/sst_01 \
--test-data-dir /work/bd0854/b380103/eso4clima/output/sst/concatenated/ \

@SarahAlidoost SarahAlidoost Aug 28, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this path point to preprocessed zarr files and not the raw data?

@SarahAlidoost SarahAlidoost left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rogerkuou thanks. A few more comments and then it can be merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Analyze the results of hyper parameter tuning stt

2 participants