Pipeline

• 

  Rui Xue <rx.astro@gmail.com> Yesterday 38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60

  Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
• 

  Rui Xue <rx.astro@gmail.com> Yesterday 6c63b253b72e657075e037da7df85893b797f19e

  PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility

  • pipeline/infrastructure/renderer/htmlrenderer.py (version 6c63b253b72e657075e037da7df85893b797f19e) (diffs)
  • pipeline/infrastructure/timetracker.py (version 6c63b253b72e657075e037da7df85893b797f19e) (diffs)
• 

  Rui Xue Yesterday 261c8820cf8063cfe2473d253e43767b132bbc31 m

  Pull request #1754: PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
  Merge in PIPE/pipeline from sync-bitbucket-github-repos-with-workflow to main
  
  * commit '598ae9e3096c183c8230659aa9a2caeb715ff123':
    PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
• 

  Rui Xue <rx.astro@gmail.com> Yesterday 598ae9e3096c183c8230659aa9a2caeb715ff123 m

  PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket

  • .github/workflows/sync-from-open-bitbucket.yml (version 598ae9e3096c183c8230659aa9a2caeb715ff123) (diffs)
• 

  Rui Xue 2 days ago 5dead9ae807422078ab5ba32dacd80165f625251 m

  Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
  Merge in PIPE/pipeline from unit-test-vlass2026 to main
  
  * commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
    PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
    PIPE-2940: Add Pixi environment definitions for the PL2026 development
    PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
    PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
    Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
• 

  Rui Xue 2 days ago d6e477200df51044506c241e43ea4e03b6b3d1c4

  PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker

  • pipeline/infrastructure/renderer/htmlrenderer.py (version d6e477200df51044506c241e43ea4e03b6b3d1c4) (diffs)
• 

  Rui Xue 2 days ago 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m

  Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
  Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
  
  * commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
    PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
    PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
    PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
    PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
    PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
    PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
    PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
• 

  Rui Xue 2 days ago 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m

  PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version 29110a640d1e0d17d853a7b45d55d91bb63ffa27) (diffs)
  • pipeline/hif/tasks/selfcal/display.py (version 29110a640d1e0d17d853a7b45d55d91bb63ffa27) (diffs)
• 

  Rui Xue 2 days ago d779f7928d0ed958341c2bf25f3b20832f5592b4

  PIPE-2014: Improve task duration formatting in HTML renderer and Mako template

  • pipeline/infrastructure/renderer/htmlrenderer.py (version d779f7928d0ed958341c2bf25f3b20832f5592b4) (diffs)
  • pipeline/infrastructure/renderer/templates/t1-4m.mako (version d779f7928d0ed958341c2bf25f3b20832f5592b4) (diffs)
• 

  Rui Xue 2 days ago 67e48129929d51db51793d7d086597c08294fbbe

  PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page

  • pipeline/infrastructure/basetask.py (version 67e48129929d51db51793d7d086597c08294fbbe) (diffs)
  • pipeline/infrastructure/renderer/htmlrenderer.py (version 67e48129929d51db51793d7d086597c08294fbbe) (diffs)
• 

  Takeshi Nakazato 2 days ago 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m

  Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
  Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
  
  * commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
    move channel axis label upward slightly
    added note to docstring for add_channel_axis
    PIPE-2894 always display channel axis to sparse profile map
• 

  Rui Xue 2 days ago 8e265de65f7535cdf17b1192e9f4fafe325eb87b

  PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`

  • pipeline/infrastructure/renderer/htmlrenderer.py (version 8e265de65f7535cdf17b1192e9f4fafe325eb87b) (diffs)
  • pipeline/infrastructure/timetracker.py (version 8e265de65f7535cdf17b1192e9f4fafe325eb87b) (diffs)
• 

  Rui Xue 2 days ago f69f39c3c4b99ea59d85e8b9da2438a2e56b7b18

  PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4

  • pipeline/infrastructure/renderer/htmlrenderer.py (version f69f39c3c4b99ea59d85e8b9da2438a2e56b7b18) (diffs)
• 

  Rui Xue 05 Feb 2026 d9b21b61a46e2b5984530ce12c589bfcbf4805cd m

  PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository

  • .github/workflows/env-setup-run-template.yml (version d9b21b61a46e2b5984530ce12c589bfcbf4805cd) (diffs)
• 

  Rui Xue 05 Feb 2026 59c8188f469ff3a13e3cf13514ca275405dbc0e4 m

  PIPE-2940: Add Pixi environment definitions for the PL2026 development

  • pyproject.toml (version 59c8188f469ff3a13e3cf13514ca275405dbc0e4) (diffs)
• 

  Rui Xue 03 Feb 2026 ff81a69f88b19bde5acbec5fcc55c199e98bf8fc m

  PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version ff81a69f88b19bde5acbec5fcc55c199e98bf8fc) (diffs)
• 

  Rui Xue 03 Feb 2026 5d766135d6e53fcaf6a8587471448022205f7311 m

  PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images

  • pipeline/h/tasks/common/displays/sky.py (version 5d766135d6e53fcaf6a8587471448022205f7311) (diffs)
  • pipeline/hif/tasks/selfcal/display.py (version 5d766135d6e53fcaf6a8587471448022205f7311) (diffs)
• 

  Rui Xue 30 Jan 2026 31e86a1d7c971cb9da5283a724b8b03d673745d0 m

  PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version 31e86a1d7c971cb9da5283a724b8b03d673745d0) (diffs)
• 

  Rui Xue 30 Jan 2026 448be2c8aed741f59ac62b3667bc83c98fc73c5b m

  PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)

  • pipeline/hif/heuristics/auto_selfcal/auto_selfcal.py (version 448be2c8aed741f59ac62b3667bc83c98fc73c5b) (diffs)
• 

  Rui Xue 30 Jan 2026 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6 m

  PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6) (diffs)
• 

  Rui Xue 29 Jan 2026 8a0f7c3bf61b6a94b352e2d27b5db421574d7add m

  PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
  - Remove temporary file handling.
  - Use `ia.histograms` for histogram calculation.

  • pipeline/hif/tasks/selfcal/display.py (version 8a0f7c3bf61b6a94b352e2d27b5db421574d7add) (diffs)
• 

  Rui Xue 26 Jan 2026 1021a12af545145f4d575bcc69f6f5c524c9318d m

  Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
  - Modify build-gh-pages.yml to trigger on changes to `environment*.yml`
  - Update env-setup-run-template.yml to allow dynamic conda environment file input
  - Adjust test-unit.yml to support multiple conda environments and update artifact naming logic
  - Refine apisummary.rst to correct module references
  - Add `new environment_vlass2026.yml` for specific pipeline dependencies of VLASS-PL2026

  • .github/workflows/build-gh-pages.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • .github/workflows/env-setup-run-template.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • .github/workflows/test-unit.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • docs/source/apisummary.rst (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • environment_vlass2026.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
• 

  Rui Xue 26 Jan 2026 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43 m

  PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`

  • environment_vlass2026.yml (version 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43) (diffs)
• 

  Rui Xue 26 Jan 2026 9ced50c5939dce02f1b0b571ef9ccdcae59533db m

  PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting

  • pyproject.toml (version 9ced50c5939dce02f1b0b571ef9ccdcae59533db) (diffs)
• 

  Takeshi Nakazato 26 Jan 2026 3a599a4f0e1e027e7f556d83ea70f672836bf335 m

  move channel axis label upward slightly

  • pipeline/hsd/tasks/common/display.py (version 3a599a4f0e1e027e7f556d83ea70f672836bf335) (diffs)
• 

  Takeshi Nakazato 26 Jan 2026 f0f64bcdf812d8198d1c62dfe5fd779c245e73c9 m

  added note to docstring for add_channel_axis

  • pipeline/hsd/tasks/common/display.py (version f0f64bcdf812d8198d1c62dfe5fd779c245e73c9) (diffs)
• 

  Takeshi Nakazato 25 Jan 2026 9d26316d3f9be62fb3470dba9aac87e3cb77f95d m

  Merge branch 'main' into PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map
• 

  Takeshi Nakazato 13 Jan 2026 4d26e9806f4963cb529fa490af25b0bcab1be550 m

  PIPE-2894 always display channel axis to sparse profile map

  • pipeline/hsd/tasks/baseline/plotter.py (version 4d26e9806f4963cb529fa490af25b0bcab1be550) (diffs)