Skip to content

Fix telemetry bugs and add chunk_and_submit_genpipes wrapper#76

Merged
MareikeJaniak merged 1 commit into
devfrom
bigbrother/chunk_genpipes
Jun 11, 2026
Merged

Fix telemetry bugs and add chunk_and_submit_genpipes wrapper#76
MareikeJaniak merged 1 commit into
devfrom
bigbrother/chunk_genpipes

Conversation

@paulstretenowich

Copy link
Copy Markdown
Collaborator
  • Fix $LOG_MD5 not expanding in wget call (single vs double quotes in common.py)
  • Fix SUBMIT_RETCODE initialized to 1 causing telemetry skip on re-runs
  • Add chunk_and_submit_genpipes.sh wrapper and register it in tools.py
  • shellcheck and code quality fixes across chunk/submit scripts

- Fix $LOG_MD5 not expanding in wget call (single vs double quotes in common.py)
- Fix SUBMIT_RETCODE initialized to 1 causing telemetry skip on re-runs
- Add chunk_and_submit_genpipes.sh wrapper and register it in tools.py
- shellcheck and code quality fixes across chunk/submit scripts

@MareikeJaniak MareikeJaniak left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can update the cit script to reflect the updates and test more widely.

LOG_MD5=$(echo $USER-'{unique_identifier}' | md5sum | awk '{{ print $1 }}')
if test -t 1; then ncolors=$(tput colors); if test -n "$ncolors" && test $ncolors -ge 8; then bold="$(tput bold)"; normal="$(tput sgr0)"; yellow="$(tput setaf 3)"; fi; fi
wget --quiet '{server}?{request}&md5=$LOG_MD5' -O /dev/null || echo "${{bold}}${{yellow}}Warning:${{normal}}${{yellow}} Genpipes ran successfully but was not send telemetry to https://bigbrother.c3g-app.sd4h.ca. This error will not affect genpipes jobs you have submitted.${{normal}}"
wget --quiet "{server}?{request}&md5=$LOG_MD5" -O /dev/null || echo "${{bold}}${{yellow}}Warning:${{normal}}${{yellow}} Genpipes ran successfully but was not send telemetry to https://bigbrother.c3g-app.sd4h.ca. This error will not affect genpipes jobs you have submitted.${{normal}}"

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor thing, but it should probably say "but has not sent telemetry"

@MareikeJaniak
MareikeJaniak merged commit 0f2cffa into dev Jun 11, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants