Skip to content

active observability templates - #321

Open
max-braintrust wants to merge 4 commits into
mainfrom
max/add-automation-sync-commands
Open

active observability templates#321
max-braintrust wants to merge 4 commits into
mainfrom
max/add-automation-sync-commands

Conversation

@max-braintrust

@max-braintrust max-braintrust commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds a portable JSON template workflow for copying active observability configurations—including Loop automations and facets—between Braintrust projects and organizations.

New commands:

  • bt observability template pull
  • bt observability template push <source>

<source> may be a local path, - for stdin, or a public HTTP(S) URL such as a raw GitHub Gist URL.

Interactive pulls show every facet and Loop automation. Active facets and unpaused Loop automations are selected by default, while inactive resources can be opted in. Non-interactive pulls use those same active defaults so their output can be pushed without unexpectedly activating inactive resources.

When a facet is pushed, the CLI ensures its topic-map classifier exists and adds both functions to the selected Topics automation. Replacing or remapping a facet also reconciles its topic map and removes stale wiring from previous Topics destinations.

Automation destination settings, such as Slack channels and webhook URLs, are excluded from templates. Existing destination settings in the target project are preserved.

Examples

Pull a project's active observability configuration:

bt observability template pull \
  --project source-project \
  --output active-observability-template.json

Push it to another project:

bt observability template push active-observability-template.json \
  --project target-project

Templates can also be shared remotely:

bt observability template push \
  'https://example.com/active-observability-template.json' \
  --project target-project

If the target project has multiple Topics automations, select one by name or ID:

bt observability template push active-observability-template.json \
  --project target-project \
  --topics-automation Topics

Templates can also be piped directly between projects:

bt observability template pull --project source-project |
  bt observability template push - --project target-project

Validation

  • I've been using this to keep topics/automations synced between different agent tracing projects internally.
  • Ran against some common cases:
    • Pushing/pulling empty templates.
    • Trying to push malformed templates.
    • Pushing to projects with conflicting facet/automation names.
    • Pushing to projects with/without topics already configured.
  • Adds unit tests.

@github-actions

github-actions Bot commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Latest downloadable build artifacts for this PR commit 754cfec35122:

Available artifact names
  • artifacts-build-global
  • artifacts-build-local-x86_64-apple-darwin
  • artifacts-build-local-x86_64-pc-windows-msvc
  • artifacts-build-local-aarch64-pc-windows-msvc
  • artifacts-build-local-aarch64-apple-darwin
  • artifacts-build-local-x86_64-unknown-linux-musl
  • artifacts-build-local-aarch64-unknown-linux-gnu
  • artifacts-build-local-x86_64-unknown-linux-gnu
  • artifacts-plan-dist-manifest
  • cargo-dist-cache

@max-braintrust max-braintrust changed the title add portable automation and facet templates active observability templates Aug 25, 2026
@max-braintrust
max-braintrust marked this pull request as ready for review August 25, 2026 21:04

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 49069a34b5

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Comment thread src/active_observability_template/facet.rs Outdated
Comment thread src/active_observability_template/mod.rs Outdated
Comment thread src/active_observability_template/io.rs Outdated
@max-braintrust
max-braintrust force-pushed the max/add-automation-sync-commands branch from 13f28b9 to 35f6c55 Compare August 26, 2026 22:37
@max-braintrust

Copy link
Copy Markdown
Contributor Author

Codex (@codex)

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 35f6c556ff

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Comment thread src/observability/push.rs
Comment thread src/observability/pull.rs
@max-braintrust
max-braintrust force-pushed the max/add-automation-sync-commands branch from 3c46e04 to f0d7652 Compare August 26, 2026 23:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant