Build: #2 failed Changes by Joshua Hoskins
Code commits
Pipeline
-
Joshua Hoskins fe25f1ab2e3c45b2bcd85dbd5b810c576fc910a4
Fix merge issues.
-
Joshua Hoskins 193cf30b020f379720a0000246bfad7af8cbd979
Merge branch 'main' into PIPE-2893-hsd_baseline-enable-sinusoid-option
# Conflicts:
# pipeline/infrastructure/basetask.py -
Rui Xue edfa947e20d405cd2555af1517b94c08b780b9b2 m
Pull request #1756: PIPE-2997/PIPE-2998: expand the gh action unit test matrix
Merge in PIPE/pipeline from PIPE-2997-expand-the-gh-action-unit-test-matrix to main
* commit '233566793c8887be813de84e5000119af22028a8':
PIPE-2997: Additional update/fixes to the workflow template
PIPE-2997: Add Pixi-based GitHub Actions workflows/templates for documentation building and unit testing
PIPE-2998: Recommend `memray` for memory use profiling as `memory_profiler` is no longer maintained.
PIPE-2998: Use `shutil.which` for improved compatibility with Python 3.13
PIPE-2997: Source `CASA6` packages explicitly from the NRAO PyPI index
PIPE-2997: Add new Pixi environments in `pyproject.toml` -
Rui Xue 56e111a89b8e0ad55239ece97777b1dcde7f4823 m
Pull request #1159: PIPE-2014: improve the timing stats in timetracker.json and weblog
Merge in PIPE/pipeline from PIPE-2014-improve-timetracker-and-weblog-timing-stats to main
* commit '38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60':
PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility
PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker
PIPE-2014: Improve task duration formatting in HTML renderer and Mako template
PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page
PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`
PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4
PIPE-2014: Ensure `TaskCompleteEvent` is sent for non-"multi_vis" tasks.
PIPE-2014: add back a code block accidentally removed from the last merge conflict resolution.
PIPE-2014: use the timetracker event stats for task duration calculations.
PIPE-2014: optimize the renderer execution order for more accurate timing stats displayed in the weblog.
PIPE-2014: start the weblog creation timer at the beginning of weblog rendering. -
Rui Xue <rx.astro@gmail.com> 233566793c8887be813de84e5000119af22028a8 m
PIPE-2997: Additional update/fixes to the workflow template
* `shell:` is evaluated at workflow parse time, not at runtime, so `${{ inputs.pixi_env }}` isn't available in the shell: field for reusable workflows.
* Disable caching for Pixi environment to ensure the latest dev snapshots are used
* Fix a bug in the CASA config stage of the Pixi template
* Remove unnecessary solve-group entries
* Update `protobuf` version specification in `environment.yml` to ensure compatibility with `casaplotms` -
Rui Xue <rx.astro@gmail.com> 789f75259e531c95b496974fb171ebf570a958f9 m
PIPE-2997: Add Pixi-based GitHub Actions workflows/templates for documentation building and unit testing
- .github/workflows/build-gh-pages-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
- .github/workflows/env-setup-run-template-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
- .github/workflows/test-unit-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
-
Rui Xue <rx.astro@gmail.com> 13dd7f53ef6b406f978e3563ef1817a607ba1218 m
PIPE-2998: Recommend `memray` for memory use profiling as `memory_profiler` is no longer maintained.
-
Rui Xue <rx.astro@gmail.com> 2ea804b5013f7e6ff2678b2f192bc5c5b39ea3db m
PIPE-2998: Use `shutil.which` for improved compatibility with Python 3.13
-
Rui Xue <rx.astro@gmail.com> 24162d0b26513b076ae54beee69386dfbf517700 m
PIPE-2997: Source `CASA6` packages explicitly from the NRAO PyPI index
To reduce the load on the NRAO PyPI index caused by uv's aggressive
parallel resolution strategy, we explicitly declare which packages must
be sourced from casa-pip.nrao.edu using per-dependency `index` fields:
- casashell, casatools, casatasks, casampi, casaplotms, casaplotserver
All other dependencies (numpy, scipy, grpcio, protobuf, etc.) resolve
from the default PyPI index only, avoiding unnecessary queries to the
NRAO server during environment solving. -
Rui Xue <rx.astro@gmail.com> 590fa43489a85d49ca3dbbd88730b31a682bcc45 m
PIPE-2997: Add new Pixi environments in `pyproject.toml`
-
Rui Xue 85cf92dc6fba8e3c2521cb90ad7c29f23121b5d2 m
Pull request #1755: PIPE-2996: Cache casarundata in env setup template
Merge in PIPE/pipeline from cache-casarundata-in-env-setup-template to main
* commit '32e17ed444ada97e6cbdf56cfc826e63d8473113':
Remove the redundant `casaconfig` setup again in `test-unit.yml`
Improve `casaconfig/casarundata` setup in the template with GH action caching -
Rui Xue <rx.astro@gmail.com> 38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60 m
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
-
Rui Xue <rx.astro@gmail.com> 6c63b253b72e657075e037da7df85893b797f19e m
PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility
-
Rui Xue 261c8820cf8063cfe2473d253e43767b132bbc31 m
Pull request #1754: PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
Merge in PIPE/pipeline from sync-bitbucket-github-repos-with-workflow to main
* commit '598ae9e3096c183c8230659aa9a2caeb715ff123':
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket -
Rui Xue <rx.astro@gmail.com> 598ae9e3096c183c8230659aa9a2caeb715ff123 m
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
-
Rui Xue 5dead9ae807422078ab5ba32dacd80165f625251 m
Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
Merge in PIPE/pipeline from unit-test-vlass2026 to main
* commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
PIPE-2940: Add Pixi environment definitions for the PL2026 development
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026. -
Rui Xue d6e477200df51044506c241e43ea4e03b6b3d1c4 m
PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker
-
Rui Xue 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m
Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
* commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability: -
Rui Xue 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
-
Rui Xue d779f7928d0ed958341c2bf25f3b20832f5592b4 m
PIPE-2014: Improve task duration formatting in HTML renderer and Mako template
-
Rui Xue 67e48129929d51db51793d7d086597c08294fbbe m
PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page
-
Takeshi Nakazato 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m
Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
* commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
move channel axis label upward slightly
added note to docstring for add_channel_axis
PIPE-2894 always display channel axis to sparse profile map -
Rui Xue 8e265de65f7535cdf17b1192e9f4fafe325eb87b m
PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`
-
Rui Xue f69f39c3c4b99ea59d85e8b9da2438a2e56b7b18 m
PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4
-
Rui Xue 73998b946595418d179ed619454b197430a0ab5c m
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
Resolved conflicts:
- `pipeline/infrastructure/basetask.py`
- `pipeline/infrastructure/renderer/htmlrenderer.py` -
Kristin Berry 465285e01b87f372c957660f993a467c2b67a264 m
Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
* commit '84610e456d06c5b0b695a098e974859674ecf063':
PIPE-2985: Update bullet-points to use - rather than o
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects -
Kristin Berry 84610e456d06c5b0b695a098e974859674ecf063 m
PIPE-2985: Update bullet-points to use - rather than o
-
Rui Xue 86fc31bbafba3c8bef51d393fa16ca193a2a57f2 m
Pull request #1744: PIPE-2916/PIPE-2986: Fix the offset search limit by using half of the cutout image size; improve observing_run handling in hif_transformimagedata
Merge in PIPE/pipeline from PIPE-2916-fix-field-selection-limit to main
* commit '42735b2555f8e61818dca1abd0914d087009175a':
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
PIPE-2916: Fix the offset search limit by using half of the cutout image size. -
Rui Xue 42735b2555f8e61818dca1abd0914d087009175a m
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
-
Vincent Geers 94268aa24af2f9c7d36c4f45214750b9f14ae682 m
Pull request #1660: PIPE-2689: add new residual phase offset QA scores to hifa_diffgaincal
Merge in PIPE/pipeline from PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals to main
* commit '26306aec824fa25e46796a8667050d46ab51879f':
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
PIPE-2689: Update scores for poor and elevated cases to lower severity
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
PIPE-2689: Fix to take the max of the absolute value rather than abs val of the max and incorporate B2B offset solution diferences into score.
PIPE-2689: Fix loop over all antennas per timestamp to instead loop over a list of unique antennas
PIPE-2689: update hifa_diffgaincal QA to refactor step that generates a consolidated QA message.
PIPE-2689: update hifa_diffgaincal QA to add new score for residual diffgain phase offsets. -
Kristin Berry bfbbaa0368fe900908701bbb32276f319be535df m
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
- pipeline/h/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
-
Rui Xue c803738bb10600e6c981f04299977d89b71acdb9 m
Pull request #1747: PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
Merge in PIPE/pipeline from PIPE-2947-restrict-scipy-versions to main
* commit '0d175efa4b8737eb989c29f85733e0c8d38bc953':
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+ -
Ajay Vibhute 10433a340af5e4fa2481a549357eb38720420103 m
Pull request #1746: PIPE-2987: changing log level of message to 'info'
Merge in PIPE/pipeline from PIPE-2987-set-log-level-to-info-for-message-in-phasecenter_to_skycoord to main
* commit '0af3f3f8f1ef7bae96e03951988831d580ff1d44':
PIPE-2987: changing log level of message to 'info' -
Rui Xue 0d4b78ef40cd78e712540ef858a07e5c821a9c4b m
Pull request #1739: PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
Merge in PIPE/pipeline from PIPE-2980-save-context-snapshot-before-weblog-rendering-for-loglevel-debug-model to main
* commit 'f4c6fb9eb954108ac509c86af0d1d8791bce9645':
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug -
Rui Xue d9b21b61a46e2b5984530ce12c589bfcbf4805cd m
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
-
Rui Xue 0d175efa4b8737eb989c29f85733e0c8d38bc953 m
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
-
Kristin Berry 5129aacd04c5b51be9953b76172fb17ae994225f m
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
-
Ajay Vibhute 0af3f3f8f1ef7bae96e03951988831d580ff1d44 m
PIPE-2987: changing log level of message to 'info'
-
Rui Xue 59c8188f469ff3a13e3cf13514ca275405dbc0e4 m
PIPE-2940: Add Pixi environment definitions for the PL2026 development
-
Rui Xue 14c61f65845bec6b84e4aa229f8adadce7dfed1f m
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
-
Kristin Berry 135cf97804064a13bedd459633f8849061b6ca0a m
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
- docs/source/develdocmd/DeveloperDocumentation.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/develdocmd/ways_to_run_the_pipeline.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/notebooks/context.ipynb (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/infrastructure/new_pipeline_task/verify_new_pipeline_task.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
-
Rui Xue 1d80cb40e721b7ec87c4ee7faa63260e0f4a79c9 m
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
-
Rui Xue 7be8cb4542002e053347059bf832b9641c32ddf1 m
PIPE-2916: Fix the offset search limit by using half of the cutout image size.
-
Rui Xue ff81a69f88b19bde5acbec5fcc55c199e98bf8fc m
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
-
Rui Xue 5d766135d6e53fcaf6a8587471448022205f7311 m
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
-
Kristin Berry 26306aec824fa25e46796a8667050d46ab51879f m
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
-
Ajay Vibhute 1fc30b1c7ac18ecd77610ee3ccc15b190fcba272 m
Pull request #1705: PIPE-2580: QA score for hifv_testBPdcals
Merge in PIPE/pipeline from PIPE-2580-hifv_testbpdcals-qa-criteria to main
* commit '218b1b17a9dfa015c33d1ea932d343cdaa7ab02a':
PIPE-2580: included bad refant/s in the weblog message
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
PIPE-2580: added applies_to to the QA scores
PIPE-2580: returning score 1.0 when everything is fine, renamed ref_ant to refant, and used SCORE_THRESHOLD_ERROR instead of hardcoded 0.3
PIPE-2580: QA score for hifv_testBPdcals -
Luke Maud 0db75813d36a22ccde45d9ae528f82bc1dca112b m
Pull request #1723: PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic
Merge in PIPE/pipeline from PIPE-2915-stop-hifa_diffgaincal-crashing-if-the-first-diffgain-scan-group-set-is-fully-flagged to main
* commit 'ebfc12707e30e2ab90b53f0e6464d67912cf99bd':
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic -
Rui Xue f4c6fb9eb954108ac509c86af0d1d8791bce9645 m
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
-
Rui Xue 31e86a1d7c971cb9da5283a724b8b03d673745d0 m
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
-
Rui Xue 448be2c8aed741f59ac62b3667bc83c98fc73c5b m
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
-
Ajay Vibhute 60282b613ca7ba9625a300f1a4e25433803d6a0d m
Pull request #1713: PIPE-2166: potentially switch to doquantiles=False in visstat in hifa_polcal
Merge in PIPE/pipeline from PIPE-2166-potentially-switch-to-doquantiles-false-in-visstat-in-hifa_polcal to main
* commit '85d71ca40e6beb946daa6d00d757782c79edca31':
PIPE-2166: removed continue
PIPE-2166: removed extra whitespace
PIPE-2166: code cleanup
PIPE-2166: setting doquantiles= False in visstat cal in imageparams_vla
PIPE-2166: setting doquantiles to False in visstat -
Rui Xue 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6 m
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
-
Rui Xue 8a0f7c3bf61b6a94b352e2d27b5db421574d7add m
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
- Remove temporary file handling.
- Use `ia.histograms` for histogram calculation. -
Rui Xue 32e17ed444ada97e6cbdf56cfc826e63d8473113 m
Remove the redundant `casaconfig` setup again in `test-unit.yml`
-
Rui Xue 7140e2bf7b9a2d1c71e9358681d5e1e1d531a5cf m
Improve `casaconfig/casarundata` setup in the template with GH action caching
-
Ajay Vibhute ab0dadfb1323e2029711307cbd0f0163aea0ba5f m
Pull request #1728: PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
Merge in PIPE/pipeline from PIPE-2881-vlass-phasecenter-in-parameter-list-format-flexibility to main
* commit '13743f4c6175651be5e562d7b23bb078c6d69d67':
PIPE-2881: adding unit tests for phasecenter_to_skycoord
PIPE-2881: moved angle units to the top of module
PIPE-2881:Fix dd.mm.ss Dec parsing
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing -
Shawn Booth 197e7c19f83ffb1ba9b1dbd7c6e80ebe07a97858 m
Pull request #1735: PIPE-2142: Turn back on skipped test
Merge in PIPE/pipeline from pipe-2142-turn-on-selfcal-test to main
* commit '05b8cc54d4747ea1828827faf3dca5fa478f90ac':
PIPE-2142: removed redundant test and switched new test to use previous results file
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge -
Shawn Booth 05b8cc54d4747ea1828827faf3dca5fa478f90ac m
PIPE-2142: removed redundant test and switched new test to use previous results file
-
Shawn Booth f6fde5f01f168ff49193277bc45624a9c5d816e6 m
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge
-
Rui Xue 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43 m
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
-
Rui Xue 9ced50c5939dce02f1b0b571ef9ccdcae59533db m
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
-
Rui Xue 1021a12af545145f4d575bcc69f6f5c524c9318d m
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
- Modify build-gh-pages.yml to trigger on changes to `environment*.yml`
- Update env-setup-run-template.yml to allow dynamic conda environment file input
- Adjust test-unit.yml to support multiple conda environments and update artifact naming logic
- Refine apisummary.rst to correct module references
- Add `new environment_vlass2026.yml` for specific pipeline dependencies of VLASS-PL2026- .github/workflows/build-gh-pages.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/env-setup-run-template.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/test-unit.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- docs/source/apisummary.rst (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- environment_vlass2026.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
-
Rui Xue 515cc8fead5706b41830d6faae65ababe418a545 m
Pull request #1734: PIPE-2738: reverse the broken change made in ca3e7a
Merge in PIPE/pipeline from PIPE-2738-hotpatch-for-state-classes to main
* commit '7d5d223acafa8e4278783226adbf21dbf4568913':
PIPE-2738: reverse the broken change made in ca3e7a -
Rui Xue 7d5d223acafa8e4278783226adbf21dbf4568913 m
PIPE-2738: reverse the broken change made in ca3e7a
-
Takeshi Nakazato 3a599a4f0e1e027e7f556d83ea70f672836bf335 m
move channel axis label upward slightly
-
Takeshi Nakazato f0f64bcdf812d8198d1c62dfe5fd779c245e73c9 m
added note to docstring for add_channel_axis
-
Hajime Ezawa 6ad5949781a7b027ba60466ac9c2ea714caca04f m
Pull request #1731: PIPE-2491 skip manipulating ms weight column
Merge in PIPE/pipeline from PIPE-2491-skip-manipulating-ms-weight-column to main
* commit '2629116b177f236e2e9ae2652632e49b5ccd3b46':
PIPE-2491: add 'updateweight=True' to sdbaseline call in baseline/worker.py
PIPE-2491: remove weighting.py and related codes -
Takeshi Nakazato 9d26316d3f9be62fb3470dba9aac87e3cb77f95d m
Merge branch 'main' into PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map
-
Rui Xue ff4645b0f586a177f12bacff5c759c9c830fa9a0 m
Pull request #1714: PIPE-2738: Additional Documentation Improvements
Merge in PIPE/pipeline from docs-additional-improvements to main
* commit 'a746207f192669f3b9d78e47b4e952b11f8bbc17':
PIPE-1883: Refactor CSS and update documentation for improved clarity and consistency
PIPE-1883: Update descriptions and styling in `modular.rst` and `custom_theme.css` for improved readability and consistency.
PIPE-1883: Improve `Conda` environment setup documentation with detailed installation steps and usage patterns for `Pipeline`.
PIPE-1883: Improve documentation for the `launcher` module and `Context` class
PIPE-1883: Add interface overview section with input/output diagram
PIPE-1883: Refactor class docstrings for consistency and clarity across multiple domain classes
PIPE-1883/PIPE-2292: Remove temporary hard-coded release version string for the PL2025 release prep from `conf.py`
PIPE-1793: Update pipeline_tests.md to clarify regression tests and add instructions for running tests in an mpicasa session -
Rui Xue a746207f192669f3b9d78e47b4e952b11f8bbc17 m
Merge remote-tracking branch 'origin/main' into docs-additional-improvements
Resolve conflicts in:
- `docs/source/develdocmd/pipeline_tests.md` -
Kristin Berry 17413edf54594d80572f508ffd183efc5fa76fa5 m
PIPE-2689: Update scores for poor and elevated cases to lower severity
-
Shawn Booth 1bd603f02b7ec81b6349411fdf74b0633d927082 m
Pull request #1696: PIPE-2127: Exit pipeline when both primary and backup flux service queries fail in hifa_importdata
Merge in PIPE/pipeline from PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the to main
* commit 'e9a2fcd7945a3af6708b1a220d1b53158d22e3f7':
PIPE-2127: changed test_get_fluxes_both_fail_fallbacks to look for warning logs instead of error logs
PIPE-2127: modified fail message for score_fluxservice to indicate the PL exited
PIPE-2127: removed the sys.exit call in the task in favor of the results.tb traceback error handling method; created almaimportdata_test.py for unit tests to exercise flux retrieval use cases
PIPE-2127: changed behavior when both primary and backup test flux queries fail to exit the pipeline -
Joshua Hoskins 58d8102b96d38d9635faf49e9c5ec3eb5965b836 m
Pull request #1726: Make change to fix log message error.
Merge in PIPE/pipeline from PIPE-2920-wrong-unit-in-the-log-message-reporting-max-separation-of-pointing-outlier to main
* commit 'e32bd5023c14c5a9cd139f7d0d55680ffa555bd3':
Make change to fix log message error. -
Joshua Hoskins 6de114add3b8b59e3b4af833b72805b0230585a6 m
Pull request #1715: PIPE-1781 tier 0 parallelization of hsd atmcor
Merge in PIPE/pipeline from PIPE-1781-tier-0-parallelization-of-hsd_atmcor to main
* commit 'e70da25205a3b4f7c4e74657ddfaf162c37121b1':
Remove cli code that is no longer needed.
Remove comment at the request of Takeshi.
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
Make .mailmap, .gitignore, and .dockerignore match main
Revert .mailmap, .gitignore, .dockerignore
Small syntax change to trigger push.
Add parallel input to the hsd_atmcor(...) task
Removed commented out code that I missed.
Bring testing repo up to date.
Change default class call for hsd_atmcor to HpcSDATMCorrection(...) -
Shawn Booth e9a2fcd7945a3af6708b1a220d1b53158d22e3f7 m
Merge remote-tracking branch 'origin/main' into PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the
-
Shawn Booth c76b657b6c2c3fba6a30f13990b6e35936b38932 m
Pull request #1684: PIPE-1840/PIPE-2142/PIPE-2503/PIPE-2778/PIPE-2875: Refactor of Pipeline Test Suite
Merge in PIPE/pipeline from test-suite-refactor to main
* commit 'ed893888cdcd425710540706bda323bcf477c4d3': (34 commits)
fixed indentation issue in docstring
improved tests/testing_utils.py file per CoPilot code review, including adding type hints, error handling, and string formatting
skipped additional test requiring test repo update
added skip markers to tests using new data that is not yet merged into test repo
added unhandled exceptions in recipereducer.py:run_named_tasks; added initialization of public attributes for PipelineTester
implemented improvements per CoPilot code review, including docstring fixes, consolidation of duplicated code, better error handling, and more robust string matching
PIPE-2778: removed defunct OphA missing spws tests; added marks to spw_mapping_missing_spws test
PIPE-2778: added new test spw_mapping_missing_spws to test mixed spw names and missing spws between datasets
PIPE-2875: reverted configuration functions to conftest.py and removed now defunct plugins file
PIPE-2503: changed dataset and recipe used for B2B test, requiring change to test name to test_2023_1_00228_S__uid___A002_X1199f9e_X7c24__procedure_hifa_calimage_diffgain__regression
PIPE-2503: add fast ALMA IF test test_2022_1_000017_CSV__uid___A002_Xff99e1_X15e4f__procedure_hifa_cal_diffgain__regression for B2B testing
PIPE-2875: updated pyproject.toml to be consistent with documentation
PIPE-2778: removed unnecessary information from docstring and updated code to more modern standards
PIPE-2778: added _execute_task helper to unify task execution (logging, exception handling, traceback check); added run_named_tasks public helper to execute an ordered list of tasks (initializes context, runs tasks, saves context); refactored reduce to use _execute_task, eliminating duplicated try/except + traceback logic; preserves early return on unhandled exceptions and stage exit semantics
PIPE-2503: added fast alma test for polcal+imaging
PIPE-2875: added line separation in _auto_mark function for clarity and changed conditionals to prevent double marks
PIPE-2875: fixed inline documentation to remove reference to now deleted regression_tester.py
PIPE-2875: Removed marks automatically added with pytest_plugins.py; updated inline documentation and improved code consistency and naming conventions; moved Nobeyama tests to separate test file
PIPE-2875: moved pytest configuration functions from conftest.py to pipeline/pytest_plugins.py to allow for importing from CASA
PIPE-2778: updated pipeline_tests.md documentation to include component tests
... -
Shawn Booth ed893888cdcd425710540706bda323bcf477c4d3 m
fixed indentation issue in docstring
-
Ajay Vibhute 2f2683c339095b33b25a2eb8a43c05f361d64bb0 m
Pull request #1730: PIPE-2934: Remove duplicate code and code cleanup
Merge in PIPE/pipeline from PIPE-2934-remove-the-seemingly-redundant-helper-functions-in-htmlrrenderer.py-after-pipe-2307 to main
* commit 'e4fd72e6a2138b07d841b0f3de23cf11f190268e':
PIPE-2934: Remove duplicate code and code cleanup -
Shawn Booth 6d6eae206995598e211d4690036fe6fa1e688c79 m
improved tests/testing_utils.py file per CoPilot code review, including adding type hints, error handling, and string formatting
-
Shawn Booth 3f484808d7653c8549ea07d2ddff738f55dd5882 m
skipped additional test requiring test repo update
-
Shawn Booth c992b9855fe6390c08710a78321da32c7b598a6d m
PIPE-2127: changed test_get_fluxes_both_fail_fallbacks to look for warning logs instead of error logs
-
Ajay Vibhute 13743f4c6175651be5e562d7b23bb078c6d69d67 m
PIPE-2881: adding unit tests for phasecenter_to_skycoord
-
Ajay Vibhute 0f9d16ac253918947417a122057f29b8ec0051cb m
PIPE-2881: moved angle units to the top of module
-
Shawn Booth 76d9cf5dd43452712dbd90fde41c7ac8bc520f3e m
Merge remote-tracking branch 'origin/main' into PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the
-
Ajay Vibhute 218b1b17a9dfa015c33d1ea932d343cdaa7ab02a m
PIPE-2580: included bad refant/s in the weblog message
-
Joshua Hoskins e70da25205a3b4f7c4e74657ddfaf162c37121b1 m
Remove cli code that is no longer needed.
-
Joshua Hoskins 9c5dd54b746a0074fc62d493087967ff8ced6e0d m
Remove comment at the request of Takeshi.
-
Joshua Hoskins 3ad65e68e4d8985515bbdc70d2c84930eb5c6590 m
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
-
Joshua Hoskins c81d89c3a3af03d43b4637e88e943a0c941092e4 m
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
-
Joshua Hoskins 3f7ca1cd94bfadf4d69011be779dcf4819f4b88b m
Make .mailmap, .gitignore, and .dockerignore match main
-
Joshua Hoskins 4b993582ca0aef7810ffc2e7ee05a61bdb282dd4 m
Revert .mailmap, .gitignore, .dockerignore
-
Ajay Vibhute e4fd72e6a2138b07d841b0f3de23cf11f190268e m
PIPE-2934: Remove duplicate code and code cleanup
-
Kristin Berry 4239a5f7ddad996c33ef10cd107a9c7454e40e38 m
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
-
Kristin Berry 2111b7a919fc24bd9fe02c1f2448ccbab1f94c39 m
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
-
Shawn Booth c03987165109bd02a9d30954b9972f788938184f m
added skip markers to tests using new data that is not yet merged into test repo
-
Shawn Booth d6dcbcdc5732a090c094af580bb8544ca882589a m
Merge remote-tracking branch 'origin/main' into test-suite-refactor
-
Ajay Vibhute 40fe06c3ef18abd6a9b2ab5481498f7e1faa12a6 m
PIPE-2881:Fix dd.mm.ss Dec parsing
-
Ajay Vibhute 386bd5480dc36495baccb07e649a9b0d0922b72a m
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
-
Hajime Ezawa 2629116b177f236e2e9ae2652632e49b5ccd3b46 m
PIPE-2491: add 'updateweight=True' to sdbaseline call in baseline/worker.py