Pipeline

• 

  Shawn Booth Yesterday 3f2df6a0d993adac0cfe3cf666ab9905990a10f3

  Merge remote-tracking branch 'origin/main' into PIPE-2903-additional-refactoring-items-after-pr-1452
• 

  Rui Xue 2 days ago 5dead9ae807422078ab5ba32dacd80165f625251 m

  Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
  Merge in PIPE/pipeline from unit-test-vlass2026 to main
  
  * commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
    PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
    PIPE-2940: Add Pixi environment definitions for the PL2026 development
    PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
    PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
    Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
• 

  Rui Xue 2 days ago 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m

  Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
  Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
  
  * commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
    PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
    PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
    PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
    PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
    PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
    PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
    PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
• 

  Rui Xue 2 days ago 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m

  PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version 29110a640d1e0d17d853a7b45d55d91bb63ffa27) (diffs)
  • pipeline/hif/tasks/selfcal/display.py (version 29110a640d1e0d17d853a7b45d55d91bb63ffa27) (diffs)
• 

  Takeshi Nakazato 2 days ago 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m

  Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
  Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
  
  * commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
    move channel axis label upward slightly
    added note to docstring for add_channel_axis
    PIPE-2894 always display channel axis to sparse profile map
• 

  Kristin Berry 5 days ago 465285e01b87f372c957660f993a467c2b67a264 m

  Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
  Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
  
  * commit '84610e456d06c5b0b695a098e974859674ecf063':
    PIPE-2985: Update bullet-points to use - rather than o
    PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
    PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
    PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
• 

  Kristin Berry 10 Feb 2026 84610e456d06c5b0b695a098e974859674ecf063 m

  PIPE-2985: Update bullet-points to use - rather than o

  • pipeline/h/tasks/restoredata/restoredata.py (version 84610e456d06c5b0b695a098e974859674ecf063) (diffs)
• 

  Kristin Berry 06 Feb 2026 bfbbaa0368fe900908701bbb32276f319be535df m

  PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.

  • pipeline/h/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
  • pipeline/h/tasks/flagging/flagdeterbase.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
  • pipeline/h/tasks/restoredata/restoredata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
  • pipeline/hifv/tasks/flagging/flagdetervla.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
  • pipeline/hsd/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
• 

  Rui Xue 05 Feb 2026 d9b21b61a46e2b5984530ce12c589bfcbf4805cd m

  PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository

  • .github/workflows/env-setup-run-template.yml (version d9b21b61a46e2b5984530ce12c589bfcbf4805cd) (diffs)
• 

  Kristin Berry 05 Feb 2026 5129aacd04c5b51be9953b76172fb17ae994225f m

  PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1

  • docs/source/develdocmd/ways_to_run_the_pipeline.md (version 5129aacd04c5b51be9953b76172fb17ae994225f) (diffs)
  • docs/source/notebooks/context.ipynb (version 5129aacd04c5b51be9953b76172fb17ae994225f) (diffs)
• 

  Rui Xue 05 Feb 2026 59c8188f469ff3a13e3cf13514ca275405dbc0e4 m

  PIPE-2940: Add Pixi environment definitions for the PL2026 development

  • pyproject.toml (version 59c8188f469ff3a13e3cf13514ca275405dbc0e4) (diffs)
• 

  Kristin Berry 04 Feb 2026 135cf97804064a13bedd459633f8849061b6ca0a m

  PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects

  • docs/source/develdocmd/DeveloperDocumentation.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • docs/source/develdocmd/ways_to_run_the_pipeline.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • docs/source/notebooks/context.ipynb (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • pipeline/h/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • pipeline/h/tasks/flagging/flagdeterbase.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • pipeline/h/tasks/restoredata/restoredata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • pipeline/hifv/tasks/flagging/flagdetervla.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • pipeline/hsd/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
  • pipeline/infrastructure/new_pipeline_task/verify_new_pipeline_task.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
• 

  Rui Xue 03 Feb 2026 ff81a69f88b19bde5acbec5fcc55c199e98bf8fc m

  PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version ff81a69f88b19bde5acbec5fcc55c199e98bf8fc) (diffs)
• 

  Rui Xue 03 Feb 2026 5d766135d6e53fcaf6a8587471448022205f7311 m

  PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images

  • pipeline/h/tasks/common/displays/sky.py (version 5d766135d6e53fcaf6a8587471448022205f7311) (diffs)
  • pipeline/hif/tasks/selfcal/display.py (version 5d766135d6e53fcaf6a8587471448022205f7311) (diffs)
• 

  Rui Xue 30 Jan 2026 31e86a1d7c971cb9da5283a724b8b03d673745d0 m

  PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version 31e86a1d7c971cb9da5283a724b8b03d673745d0) (diffs)
• 

  Rui Xue 30 Jan 2026 448be2c8aed741f59ac62b3667bc83c98fc73c5b m

  PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)

  • pipeline/hif/heuristics/auto_selfcal/auto_selfcal.py (version 448be2c8aed741f59ac62b3667bc83c98fc73c5b) (diffs)
• 

  Rui Xue 30 Jan 2026 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6 m

  PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage

  • pipeline/hif/heuristics/auto_selfcal/selfcal_helpers.py (version 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6) (diffs)
• 

  Rui Xue 29 Jan 2026 8a0f7c3bf61b6a94b352e2d27b5db421574d7add m

  PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
  - Remove temporary file handling.
  - Use `ia.histograms` for histogram calculation.

  • pipeline/hif/tasks/selfcal/display.py (version 8a0f7c3bf61b6a94b352e2d27b5db421574d7add) (diffs)
• 

  Rui Xue 26 Jan 2026 9ced50c5939dce02f1b0b571ef9ccdcae59533db m

  PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting

  • pyproject.toml (version 9ced50c5939dce02f1b0b571ef9ccdcae59533db) (diffs)
• 

  Rui Xue 26 Jan 2026 1021a12af545145f4d575bcc69f6f5c524c9318d m

  Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
  - Modify build-gh-pages.yml to trigger on changes to `environment*.yml`
  - Update env-setup-run-template.yml to allow dynamic conda environment file input
  - Adjust test-unit.yml to support multiple conda environments and update artifact naming logic
  - Refine apisummary.rst to correct module references
  - Add `new environment_vlass2026.yml` for specific pipeline dependencies of VLASS-PL2026

  • .github/workflows/build-gh-pages.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • .github/workflows/env-setup-run-template.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • .github/workflows/test-unit.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • docs/source/apisummary.rst (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
  • environment_vlass2026.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
• 

  Rui Xue 26 Jan 2026 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43 m

  PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`

  • environment_vlass2026.yml (version 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43) (diffs)
• 

  Takeshi Nakazato 26 Jan 2026 3a599a4f0e1e027e7f556d83ea70f672836bf335 m

  move channel axis label upward slightly

  • pipeline/hsd/tasks/common/display.py (version 3a599a4f0e1e027e7f556d83ea70f672836bf335) (diffs)
• 

  Takeshi Nakazato 26 Jan 2026 f0f64bcdf812d8198d1c62dfe5fd779c245e73c9 m

  added note to docstring for add_channel_axis

  • pipeline/hsd/tasks/common/display.py (version f0f64bcdf812d8198d1c62dfe5fd779c245e73c9) (diffs)
• 

  Takeshi Nakazato 25 Jan 2026 9d26316d3f9be62fb3470dba9aac87e3cb77f95d m

  Merge branch 'main' into PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map
• 

  Takeshi Nakazato 13 Jan 2026 4d26e9806f4963cb529fa490af25b0bcab1be550 m

  PIPE-2894 always display channel axis to sparse profile map

  • pipeline/hsd/tasks/baseline/plotter.py (version 4d26e9806f4963cb529fa490af25b0bcab1be550) (diffs)