Skip to content

Document the September 2026 OM4 data release - #880

Merged
jder merged 3 commits into
mainfrom
docs/september-data-release
Sep 16, 2026
Merged

jder merged 3 commits into
mainfrom
docs/september-data-release

Conversation

@alxmrs

@alxmrs alxmrs commented Sep 10, 2026

Copy link
Copy Markdown
Member

Summary

  • mark v2026-09 as the canonical processed OM4 release and document all 12 averaged, filtered, and snapshot datasets
  • explain freshwater forcing and snapshot timing semantics, plus the intended filtered/unfiltered multi-scale pairing
    • additional human context: The documented note on the intention for what data to use for multi-scale modeling is useful to review (it was a recommendation from Laure and Alistair).
  • update the shipped OM4 demo, generated Colab quickstart, SkyPilot defaults, configuration docs, and normalization example to use the September release
  • point clone_data.py at the canonical Samudra namespace and fix its existing missing .zarr suffix
  • document all filtered preprocessing and normalization commands

Observation data remains pinned to v2026-07/obs; this PR changes the canonical OM4 release only.

Verification

  • confirmed public HTTP 200 access to .zmetadata for all 36 stores (12 datasets × data/means/stds)
  • uvx pre-commit run --all-files
  • python -m pytest tests/test_clone_data.py tests/test_quickstart_config.py -q
  • python scripts/build_quickstart_notebook.py --check

@review-notebook-app

Copy link
Copy Markdown

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e80f3f99c2

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread skypilot/train.sky.yaml
@alxmrs

alxmrs commented Sep 10, 2026

Copy link
Copy Markdown
Member Author

I reran each documented xr.open_zarr(...) call against the live September stores and updated all four displayed Xarray representations verbatim. The refreshed output now shows the current sizes, wfo, 100 data variables, 17 attributes, and current provenance fields. I also verified programmatically that each live repr(ds) appears exactly in docs/data.md. 🤖

@alxmrs alxmrs left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

quick review note.

Comment thread tests/test_clone_data.py Outdated
@@ -0,0 +1,18 @@
# SPDX-FileCopyrightText: 2026 Samudra Authors

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's omit this file.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed in 6673c01. The production path correction remains, and the remaining focused checks and pre-commit suite pass. 🤖

@alxmrs
alxmrs requested a review from jder September 10, 2026 23:08

@jder jder left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks so much for the details docs!

@jder
jder added this pull request to the merge queue Sep 16, 2026
Merged via the queue into main with commit 868dec0 Sep 16, 2026
20 checks passed
@jder
jder deleted the docs/september-data-release branch September 16, 2026 20:32
@github-project-automation github-project-automation Bot moved this from Backlog to Done in Samudra Planning Sep 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants