Skip to content

Report correct runtime commit for SDK measurements - #5290

Merged
matouskozak merged 7 commits into
mainfrom
matouskozak-fix-sdk-runtime-commit
Aug 27, 2026
Merged

Report correct runtime commit for SDK measurements#5290
matouskozak merged 7 commits into
mainfrom
matouskozak-fix-sdk-runtime-commit

Conversation

@matouskozak

Copy link
Copy Markdown
Member

Summary

  • preserve the extracted dotnet/dotnet VMR commit as PERFLAB_DATA_dotnet_commit_hash
  • resolve the corresponding dotnet/runtime commit from the VMR src/source-manifest.json
  • report that value as PERFLAB_DATA_runtime_commit_hash

Validation

Private Android CoreCLR Release sanity build succeeded: build 3055756.

Preserve the dotnet/dotnet VMR commit separately and resolve the corresponding dotnet/runtime commit from the VMR source manifest.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: f1a9ef3e-205a-409a-9aec-5ca6a2dbe255
Run only Android CoreCLR Release on the Pixel configuration for the private sanity build.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: f1a9ef3e-205a-409a-9aec-5ca6a2dbe255
Remove the temporary single-configuration validation override after queuing the targeted build.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: f1a9ef3e-205a-409a-9aec-5ca6a2dbe255
Copilot AI lite review requested due to automatic review settings August 24, 2026 13:14

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates SDK measurement metadata to preserve the VMR commit and report the corresponding dotnet/runtime commit.

Changes:

  • Resolves the runtime commit from source-manifest.json.
  • Records both VMR and runtime commit hashes.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread src/scenarios/shared/versionmanager.py Outdated
Comment thread src/scenarios/shared/versionmanager.py Outdated
Treat runtime commit resolution as best-effort so transient network or malformed manifest failures do not prevent versions.json from being written.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: f1a9ef3e-205a-409a-9aec-5ca6a2dbe255
Copilot AI review requested due to automatic review settings August 24, 2026 13:55

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

Comment thread src/scenarios/shared/versionmanager.py Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings August 24, 2026 17:16

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated no new comments.

Suppressed comments (1)

src/scenarios/shared/versionmanager.py:10

  • URLError is imported here but never referenced; the resolver catches Exception instead. Please remove this dead import (otherwise F401-based Python linting will fail).
from urllib.error import URLError

@DrewScoggins

Copy link
Copy Markdown
Member

I wonder if we should do this in AzDO instead of on the device itself. That should let us only have to do it one time, and cut down on the likelihood of some kind of transient failure on the machine causing us to miss the value for a certain test.

Resolve the dotnet/runtime commit once while generating the AzDO machine setup for mobile jobs, and leave payload preparation responsible for assembly-derived workload metadata.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: f1a9ef3e-205a-409a-9aec-5ca6a2dbe255
Copilot AI review requested due to automatic review settings August 27, 2026 16:17
@matouskozak

matouskozak commented Aug 27, 2026

Copy link
Copy Markdown
Member Author

Good suggestion. I moved the dotnet/dotnet → dotnet/runtime resolution into ci_setup.py, where the installed SDK VMR SHA is already read and machine-setup is generated. I'll run a private build to verify.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.

Comment thread scripts/run_performance_job.py
Comment thread src/scenarios/shared/versionmanager.py Outdated
DrewScoggins
DrewScoggins previously approved these changes Aug 27, 2026

@DrewScoggins DrewScoggins left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, with a response to my one comment.

Runtime repository provenance is now supplied by CI setup, so payload extraction only records Android, iOS, and MAUI workload metadata.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: f1a9ef3e-205a-409a-9aec-5ca6a2dbe255

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.

Comment thread scripts/dotnet.py

@DrewScoggins DrewScoggins left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@matouskozak
matouskozak merged commit 18c564d into main Aug 27, 2026
76 checks passed
@matouskozak
matouskozak deleted the matouskozak-fix-sdk-runtime-commit branch August 27, 2026 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants