Code commits
Pipeline
-
Rui Xue 87a907891eeeb43a89934efed8e0cc0f0fc98afe
Merge remote-tracking branch 'origin/release/2026.1.0' into PIPE-2461-vlass-keywords-in-fits-file
-
Rui Xue 5f73f8ce047cc9d78f02675f1755fa8bb243e808 m
Pull request #1752: PIPE-1677: multiple mses in vlass imaging pipeline
Merge in PIPE/pipeline from PIPE-1677-multiple-mses-in-vlass-imaging-pipeline to main
* commit '4fa7558f183f744ef44c52687ea70abdbe63022b':
PIPE-1677: Refactor `get_sourcename` method in `ImageParamsHeuristics` for improved readability
PIPE-1677: Refactor logging statements in `ImageParamsHeuristics` and `ImageParamsHeuristicsVlassQl`
PIPE-1677: Update `is_eph_obj` method in VLASS heuristics to include type hints and detailed docstrings
PIPE-1677: Remove the `spwsel_lsrk` specification workaround for multi-MS case.
PIPE-1667: Override `is_eph_obj` in `ImageParamsHeuristicsVlassQl` to disable ephemeris checks
PIPE-1677: Add multi-MS support for the VLASS imaging pipeline in `hif_editimlist`, `hif_makeimages`/`hif_tclean`, and imaging heuristics classes.
PIPE-1677: Support multiple MSes in `Transformimagedata`
PIPE-1677: Improve `vlass_selfcal.mako` for better multi-vis support
PIPE-1677: Adjust `hifv_checkflag` summary rendering for better multi-vis support
PIPE-1677: Refactor `hifv_statwt` rendering to support multiple MSes for VLASS
PIPE-1677: Convert `hifv_exportvlassdata` to a "multi-vis" task and add support for archiving multiple self-calibration tables and flag versions -
Rui Xue 4fa7558f183f744ef44c52687ea70abdbe63022b m
PIPE-1677: Refactor `get_sourcename` method in `ImageParamsHeuristics` for improved readability
-
Luke Maud 464b85b3f776af89d91eb7e023091e2eee133dde m
Pull request #1740: PIPE-2901 add commentary explanations into hifa heursitics snr code
Merge in PIPE/pipeline from PIPE-2901-add-commentary-explanations-into-hifa-heursitics-snr-code to main
* commit 'd43d5679e37928cbc9f1d50a362290982cb42343':
PIPE-2901: Improve comments and variable naming in SNR calculations for clarity
PIPE-2901: Fix some minor typos with small codestyle updates
PIPE-2901: updated gaincalSNR function in fluxscale/qa.py for compatability with snr.py calculations
PIPE-2901: correct all parameters nbaselines to nEffectiveAntennas
PIPE-2901: edit to n-3 equation and rename nbaselines to nEffectiveAntennas
add PIPE-2901 explination and update hard coded ant numbers to fiducal variable -
Rui Xue d43d5679e37928cbc9f1d50a362290982cb42343 m
PIPE-2901: Improve comments and variable naming in SNR calculations for clarity
-
Rui Xue a8a3f62d8cc3c19a44797d23af0ff9f091b455ed m
Pull request #1763: PIPE-3004: Refactor FieldTable._read_table to optimize scan checks and reduce unnecessary computations
Merge in PIPE/pipeline from PIPE-3004-refactoring-fieldtable._read_table to main
* commit '7f44fe5b8df0412da26d172ccf0a1797cc97efbb':
PIPE-3004: Minor updates to improve readability of scan determination logic
PIPE-3004: Refactor FieldTable._read_table to optimize scan checks and reduce unnecessary computations -
Rui Xue <rx.astro@gmail.com> 7f44fe5b8df0412da26d172ccf0a1797cc97efbb m
PIPE-3004: Minor updates to improve readability of scan determination logic
-
Rui Xue 30e1473dcb3773a1b02c07f4b222313243e30e1d m
PIPE-3004: Refactor FieldTable._read_table to optimize scan checks and reduce unnecessary computations
-
Rui Xue <rx.astro@gmail.com> b9ab438464dd42f47c0b3456c7a24fca7a28bb32 m
PIPE-1677: Refactor logging statements in `ImageParamsHeuristics` and `ImageParamsHeuristicsVlassQl`
-
Rui Xue <rx.astro@gmail.com> f036033eb1e92fd746c033492a0a59b5311c0130 m
PIPE-1677: Update `is_eph_obj` method in VLASS heuristics to include type hints and detailed docstrings
- pipeline/hif/heuristics/imageparams_base.py (version f036033eb1e92fd746c033492a0a59b5311c0130) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_quick_look.py (version f036033eb1e92fd746c033492a0a59b5311c0130) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_single_epoch_continuum.py (version f036033eb1e92fd746c033492a0a59b5311c0130) (diffs)
-
Shawn Booth 7e7c567325cfb66a6ec4fbef286b7e35453bd9d4 m
Pull request #1759: PIPE-2999: auto-cleanup of testing directory from almaimportdata_test.py
Merge in PIPE/pipeline from PIPE-2999-auto-cleanup-of-testing-directory-from-almaimportdata_test.py to main
* commit 'fe959666c96e7b94bd4e02784ba0eebbcdae8aad':
PIPE-2999: added fixture to prevent leftover directory after running recipe_converter_test.py
PIPE-2999: use pytest's tmp_path fixture to clean up temp directories -
Shawn Booth 571d3827104cc21a36f6d92209f12f04f557fd5b m
Pull request #1761: PIPE-2503: add small b2b / polcal tests in the regression test collections
Merge in PIPE/pipeline from PIPE-2503-add-small-b2b-polcal-tests-in-the-regression-test-collections to main
* commit '0b8a3cd5a9b16714a4faa3caf0d82e861a7ca4c3':
PIPE-2503: turned back on polcal and B2B regression tests; updated polcal test to use different dataset -
Shawn Booth fe959666c96e7b94bd4e02784ba0eebbcdae8aad m
PIPE-2999: added fixture to prevent leftover directory after running recipe_converter_test.py
-
Shawn Booth 8791506dff62feb3a95804c61117920eb1cd20e4 m
Pull request #1760: PIPE-1654: Add weblog rendering failure detection to regression tests
Merge in PIPE/pipeline from PIPE-1654-detect-weblog-rendering-failures-in-regression-tester to main
* commit '15b8691d7f4c9da10b6b7f69347c99aa17035891':
PIPE-1654: moved SIMULATE_WEBLOG_FAILURE logic into conftest.py to isolate from production code
PIPE-1654: add weblog rendering failure detection to regression tests -
Shawn Booth 15b8691d7f4c9da10b6b7f69347c99aa17035891 m
PIPE-1654: moved SIMULATE_WEBLOG_FAILURE logic into conftest.py to isolate from production code
-
Shawn Booth 0b8a3cd5a9b16714a4faa3caf0d82e861a7ca4c3 m
PIPE-2503: turned back on polcal and B2B regression tests; updated polcal test to use different dataset
-
Kristin Berry e4672d848e3dc731b02352f8516950a4c511cbc1 m
Pull request #1690: PIPE-2845: PIPE-2103 followup features and bugfixes
Merge in PIPE/pipeline from PIPE-2845-pipe-2103-followup-tasks to main
* commit '09431438bcf5ed154523ddbbb83606b401a4c005':
PIPE-2845: Clean up old comments and update failuretype for spw-wide failures
PIPE-2845: Fix issue with antenna-based failure reporting and plot on/off toggle.
PIPE-2845: Switch issue reporting from aggregated by spw to aggregated by spw and then ant.
PIPE-2845: Turn plotting off by default and only output skip spw message once per spw.
PIPE-2845: Update formatting to add more spaces.
PIPE-2845: Update atmosphere line fitting to map to fit frequencies directly, rather than relying on the frequencies in the spw array in case the fit is outside the array. Prevents an out of bounds error. -
Shawn Booth 5ebece4eb9d0f7def69a3b6e27affdab83531d03 m
PIPE-1654: add weblog rendering failure detection to regression tests
- pipeline/infrastructure/renderer/htmlrenderer.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
- pipeline/infrastructure/renderer/regression.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
- tests/test_pipeline_testing_framework.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
- tests/testing_utils.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
-
Shawn Booth 885fa1cdc0039f090613a54079da47be2c63ed2a m
PIPE-2999: use pytest's tmp_path fixture to clean up temp directories
-
Takeshi Nakazato ef6c047d8e3ce85d18c2c4877aa986729c4f8342 m
Pull request #1748: PIPE-2954 hsd imaging misspelling in the warning message
Merge in PIPE/pipeline from PIPE-2954-hsd_imaging-misspelling-in-the-warning-message to main
* commit '5acbc84cce0f1048a1c7b0b886416dc59e8cbfec':
refactoring warning message
PIPE-2954 fix typo in warning message -
Rui Xue <rx.astro@gmail.com> 5494b0144b4c425948f8e46843df37d645bd2e0b m
Merge remote-tracking branch 'origin/main' into PIPE-1677-multiple-mses-in-vlass-imaging-pipeline
-
Rui Xue edfa947e20d405cd2555af1517b94c08b780b9b2 m
Pull request #1756: PIPE-2997/PIPE-2998: expand the gh action unit test matrix
Merge in PIPE/pipeline from PIPE-2997-expand-the-gh-action-unit-test-matrix to main
* commit '233566793c8887be813de84e5000119af22028a8':
PIPE-2997: Additional update/fixes to the workflow template
PIPE-2997: Add Pixi-based GitHub Actions workflows/templates for documentation building and unit testing
PIPE-2998: Recommend `memray` for memory use profiling as `memory_profiler` is no longer maintained.
PIPE-2998: Use `shutil.which` for improved compatibility with Python 3.13
PIPE-2997: Source `CASA6` packages explicitly from the NRAO PyPI index
PIPE-2997: Add new Pixi environments in `pyproject.toml` -
Rui Xue 56e111a89b8e0ad55239ece97777b1dcde7f4823 m
Pull request #1159: PIPE-2014: improve the timing stats in timetracker.json and weblog
Merge in PIPE/pipeline from PIPE-2014-improve-timetracker-and-weblog-timing-stats to main
* commit '38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60':
PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility
PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker
PIPE-2014: Improve task duration formatting in HTML renderer and Mako template
PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page
PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`
PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4
PIPE-2014: Ensure `TaskCompleteEvent` is sent for non-"multi_vis" tasks.
PIPE-2014: add back a code block accidentally removed from the last merge conflict resolution.
PIPE-2014: use the timetracker event stats for task duration calculations.
PIPE-2014: optimize the renderer execution order for more accurate timing stats displayed in the weblog.
PIPE-2014: start the weblog creation timer at the beginning of weblog rendering. -
Rui Xue <rx.astro@gmail.com> 233566793c8887be813de84e5000119af22028a8 m
PIPE-2997: Additional update/fixes to the workflow template
* `shell:` is evaluated at workflow parse time, not at runtime, so `${{ inputs.pixi_env }}` isn't available in the shell: field for reusable workflows.
* Disable caching for Pixi environment to ensure the latest dev snapshots are used
* Fix a bug in the CASA config stage of the Pixi template
* Remove unnecessary solve-group entries
* Update `protobuf` version specification in `environment.yml` to ensure compatibility with `casaplotms` -
Rui Xue <rx.astro@gmail.com> 789f75259e531c95b496974fb171ebf570a958f9 m
PIPE-2997: Add Pixi-based GitHub Actions workflows/templates for documentation building and unit testing
- .github/workflows/build-gh-pages-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
- .github/workflows/env-setup-run-template-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
- .github/workflows/test-unit-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
-
Rui Xue <rx.astro@gmail.com> 13dd7f53ef6b406f978e3563ef1817a607ba1218 m
PIPE-2998: Recommend `memray` for memory use profiling as `memory_profiler` is no longer maintained.
-
Rui Xue <rx.astro@gmail.com> 2ea804b5013f7e6ff2678b2f192bc5c5b39ea3db m
PIPE-2998: Use `shutil.which` for improved compatibility with Python 3.13
-
Rui Xue <rx.astro@gmail.com> 24162d0b26513b076ae54beee69386dfbf517700 m
PIPE-2997: Source `CASA6` packages explicitly from the NRAO PyPI index
To reduce the load on the NRAO PyPI index caused by uv's aggressive
parallel resolution strategy, we explicitly declare which packages must
be sourced from casa-pip.nrao.edu using per-dependency `index` fields:
- casashell, casatools, casatasks, casampi, casaplotms, casaplotserver
All other dependencies (numpy, scipy, grpcio, protobuf, etc.) resolve
from the default PyPI index only, avoiding unnecessary queries to the
NRAO server during environment solving. -
Rui Xue <rx.astro@gmail.com> 590fa43489a85d49ca3dbbd88730b31a682bcc45 m
PIPE-2997: Add new Pixi environments in `pyproject.toml`
-
Rui Xue 85cf92dc6fba8e3c2521cb90ad7c29f23121b5d2 m
Pull request #1755: PIPE-2996: Cache casarundata in env setup template
Merge in PIPE/pipeline from cache-casarundata-in-env-setup-template to main
* commit '32e17ed444ada97e6cbdf56cfc826e63d8473113':
Remove the redundant `casaconfig` setup again in `test-unit.yml`
Improve `casaconfig/casarundata` setup in the template with GH action caching -
Rui Xue <rx.astro@gmail.com> 38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60 m
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
-
Rui Xue <rx.astro@gmail.com> 6c63b253b72e657075e037da7df85893b797f19e m
PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility
-
Rui Xue 261c8820cf8063cfe2473d253e43767b132bbc31 m
Pull request #1754: PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
Merge in PIPE/pipeline from sync-bitbucket-github-repos-with-workflow to main
* commit '598ae9e3096c183c8230659aa9a2caeb715ff123':
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket -
Rui Xue <rx.astro@gmail.com> 598ae9e3096c183c8230659aa9a2caeb715ff123 m
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
-
Rui Xue c7211e85b28f68948a0c35ff80068ba5d45ce051 m
PIPE-2901: Fix some minor typos with small codestyle updates
-
Rui Xue ee58e080236d14cb7c8fa5d57e3258a3d3996131 m
Merge remote-tracking branch 'origin/main' into PIPE-2901-add-commentary-explanations-into-hifa-heursitics-snr-code
-
Rui Xue 5dead9ae807422078ab5ba32dacd80165f625251 m
Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
Merge in PIPE/pipeline from unit-test-vlass2026 to main
* commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
PIPE-2940: Add Pixi environment definitions for the PL2026 development
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026. -
Rui Xue d6e477200df51044506c241e43ea4e03b6b3d1c4 m
PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker
-
Rui Xue 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m
Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
* commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability: -
Rui Xue 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
-
Rui Xue d779f7928d0ed958341c2bf25f3b20832f5592b4 m
PIPE-2014: Improve task duration formatting in HTML renderer and Mako template
-
Rui Xue 67e48129929d51db51793d7d086597c08294fbbe m
PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page
-
Takeshi Nakazato 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m
Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
* commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
move channel axis label upward slightly
added note to docstring for add_channel_axis
PIPE-2894 always display channel axis to sparse profile map -
Rui Xue 8e265de65f7535cdf17b1192e9f4fafe325eb87b m
PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`
-
Rui Xue f69f39c3c4b99ea59d85e8b9da2438a2e56b7b18 m
PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4
-
Rui Xue 73998b946595418d179ed619454b197430a0ab5c m
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
Resolved conflicts:
- `pipeline/infrastructure/basetask.py`
- `pipeline/infrastructure/renderer/htmlrenderer.py` -
Kristin Berry 465285e01b87f372c957660f993a467c2b67a264 m
Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
* commit '84610e456d06c5b0b695a098e974859674ecf063':
PIPE-2985: Update bullet-points to use - rather than o
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects -
Rui Xue 3ae1efb71ad2c049ba34a36d1eb35df736bb8e44 m
PIPE-1677: Remove the `spwsel_lsrk` specification workaround for multi-MS case.
-
Rui Xue dcdf548b5f42fc8351e9e78174cd570642b7c6a7 m
PIPE-1667: Override `is_eph_obj` in `ImageParamsHeuristicsVlassQl` to disable ephemeris checks
-
Rui Xue <rx.astro@gmail.com> ab6b70d7bc2c149393ce9a1d5c48c8cd42d14d78 m
PIPE-1677: Add multi-MS support for the VLASS imaging pipeline in `hif_editimlist`, `hif_makeimages`/`hif_tclean`, and imaging heuristics classes.
- pipeline/hif/heuristics/imageparams_base.py (version ab6b70d7bc2c149393ce9a1d5c48c8cd42d14d78) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_single_epoch_continuum.py (version ab6b70d7bc2c149393ce9a1d5c48c8cd42d14d78) (diffs)
- pipeline/hif/tasks/editimlist/editimlist.py (version ab6b70d7bc2c149393ce9a1d5c48c8cd42d14d78) (diffs)
- pipeline/hif/tasks/tclean/cleanbase.py (version ab6b70d7bc2c149393ce9a1d5c48c8cd42d14d78) (diffs)
- pipeline/hif/templates/editimlist.mako (version ab6b70d7bc2c149393ce9a1d5c48c8cd42d14d78) (diffs)
-
Rui Xue <rx.astro@gmail.com> a1df607cf1a41ace235a461cda5779329080ac57 m
PIPE-1677: Support multiple MSes in `Transformimagedata`
-
Rui Xue <rx.astro@gmail.com> 6a9b8c9599307bf52c631444baa11451b6a08a7b m
PIPE-1677: Improve `vlass_selfcal.mako` for better multi-vis support
-
Rui Xue <rx.astro@gmail.com> 07701b4ccf7c862826a04a83675824958e29040a m
PIPE-1677: Adjust `hifv_checkflag` summary rendering for better multi-vis support
-
Rui Xue <rx.astro@gmail.com> b804f9eb3a0775e9b56c9e4698ead5330376e6b3 m
PIPE-1677: Refactor `hifv_statwt` rendering to support multiple MSes for VLASS
-
Rui Xue <rx.astro@gmail.com> 20e1130e0d7104ef9faff523019a70ba7e964fc7 m
PIPE-1677: Convert `hifv_exportvlassdata` to a "multi-vis" task and add support for archiving multiple self-calibration tables and flag versions
-
Kristin Berry 84610e456d06c5b0b695a098e974859674ecf063 m
PIPE-2985: Update bullet-points to use - rather than o
-
Rui Xue 86fc31bbafba3c8bef51d393fa16ca193a2a57f2 m
Pull request #1744: PIPE-2916/PIPE-2986: Fix the offset search limit by using half of the cutout image size; improve observing_run handling in hif_transformimagedata
Merge in PIPE/pipeline from PIPE-2916-fix-field-selection-limit to main
* commit '42735b2555f8e61818dca1abd0914d087009175a':
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
PIPE-2916: Fix the offset search limit by using half of the cutout image size. -
Rui Xue 42735b2555f8e61818dca1abd0914d087009175a m
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
-
Vincent Geers 94268aa24af2f9c7d36c4f45214750b9f14ae682 m
Pull request #1660: PIPE-2689: add new residual phase offset QA scores to hifa_diffgaincal
Merge in PIPE/pipeline from PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals to main
* commit '26306aec824fa25e46796a8667050d46ab51879f':
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
PIPE-2689: Update scores for poor and elevated cases to lower severity
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
PIPE-2689: Fix to take the max of the absolute value rather than abs val of the max and incorporate B2B offset solution diferences into score.
PIPE-2689: Fix loop over all antennas per timestamp to instead loop over a list of unique antennas
PIPE-2689: update hifa_diffgaincal QA to refactor step that generates a consolidated QA message.
PIPE-2689: update hifa_diffgaincal QA to add new score for residual diffgain phase offsets. -
Kristin Berry bfbbaa0368fe900908701bbb32276f319be535df m
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
- pipeline/h/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
-
Rui Xue c803738bb10600e6c981f04299977d89b71acdb9 m
Pull request #1747: PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
Merge in PIPE/pipeline from PIPE-2947-restrict-scipy-versions to main
* commit '0d175efa4b8737eb989c29f85733e0c8d38bc953':
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+ -
Ajay Vibhute 10433a340af5e4fa2481a549357eb38720420103 m
Pull request #1746: PIPE-2987: changing log level of message to 'info'
Merge in PIPE/pipeline from PIPE-2987-set-log-level-to-info-for-message-in-phasecenter_to_skycoord to main
* commit '0af3f3f8f1ef7bae96e03951988831d580ff1d44':
PIPE-2987: changing log level of message to 'info' -
Rui Xue 0d4b78ef40cd78e712540ef858a07e5c821a9c4b m
Pull request #1739: PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
Merge in PIPE/pipeline from PIPE-2980-save-context-snapshot-before-weblog-rendering-for-loglevel-debug-model to main
* commit 'f4c6fb9eb954108ac509c86af0d1d8791bce9645':
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug -
Rui Xue d9b21b61a46e2b5984530ce12c589bfcbf4805cd m
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
-
Rui Xue 0d175efa4b8737eb989c29f85733e0c8d38bc953 m
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
-
Kristin Berry 5129aacd04c5b51be9953b76172fb17ae994225f m
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
-
Ajay Vibhute 0af3f3f8f1ef7bae96e03951988831d580ff1d44 m
PIPE-2987: changing log level of message to 'info'
-
Rui Xue 59c8188f469ff3a13e3cf13514ca275405dbc0e4 m
PIPE-2940: Add Pixi environment definitions for the PL2026 development
-
Takeshi Nakazato 5acbc84cce0f1048a1c7b0b886416dc59e8cbfec m
refactoring warning message
- use f-string for better readability
- eliminate "line too long" warning from Python linter -
Takeshi Nakazato 82c0d0b1b4273bbf0e82edce041aace09e54ac8e m
PIPE-2954 fix typo in warning message
-
Rui Xue 14c61f65845bec6b84e4aa229f8adadce7dfed1f m
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
-
Kristin Berry 135cf97804064a13bedd459633f8849061b6ca0a m
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
- docs/source/develdocmd/DeveloperDocumentation.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/develdocmd/ways_to_run_the_pipeline.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/notebooks/context.ipynb (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/infrastructure/new_pipeline_task/verify_new_pipeline_task.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
-
Kristin Berry 09431438bcf5ed154523ddbbb83606b401a4c005 m
PIPE-2845: Clean up old comments and update failuretype for spw-wide failures
-
Rui Xue 1d80cb40e721b7ec87c4ee7faa63260e0f4a79c9 m
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
-
Rui Xue 7be8cb4542002e053347059bf832b9641c32ddf1 m
PIPE-2916: Fix the offset search limit by using half of the cutout image size.
-
Rui Xue ff81a69f88b19bde5acbec5fcc55c199e98bf8fc m
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
-
Rui Xue 5d766135d6e53fcaf6a8587471448022205f7311 m
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
-
Kristin Berry 14ce6c4ff5693ef99fde4cff18f2b32b6b5781ec m
Merge branch 'main' of ssh://open-bitbucket.nrao.edu:7999/pipe/pipeline into PIPE-2845-pipe-2103-followup-tasks
-
Kristin Berry 26306aec824fa25e46796a8667050d46ab51879f m
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
-
Ajay Vibhute 1fc30b1c7ac18ecd77610ee3ccc15b190fcba272 m
Pull request #1705: PIPE-2580: QA score for hifv_testBPdcals
Merge in PIPE/pipeline from PIPE-2580-hifv_testbpdcals-qa-criteria to main
* commit '218b1b17a9dfa015c33d1ea932d343cdaa7ab02a':
PIPE-2580: included bad refant/s in the weblog message
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
PIPE-2580: added applies_to to the QA scores
PIPE-2580: returning score 1.0 when everything is fine, renamed ref_ant to refant, and used SCORE_THRESHOLD_ERROR instead of hardcoded 0.3
PIPE-2580: QA score for hifv_testBPdcals -
Luke Maud 0db75813d36a22ccde45d9ae528f82bc1dca112b m
Pull request #1723: PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic
Merge in PIPE/pipeline from PIPE-2915-stop-hifa_diffgaincal-crashing-if-the-first-diffgain-scan-group-set-is-fully-flagged to main
* commit 'ebfc12707e30e2ab90b53f0e6464d67912cf99bd':
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic -
Luke Maud befc8db21581b8af56fb536b9e14ea389b592d94 m
PIPE-2901: updated gaincalSNR function in fluxscale/qa.py for compatability with snr.py calculations
-
Rui Xue f4c6fb9eb954108ac509c86af0d1d8791bce9645 m
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
-
Rui Xue 31e86a1d7c971cb9da5283a724b8b03d673745d0 m
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
-
Rui Xue 448be2c8aed741f59ac62b3667bc83c98fc73c5b m
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
-
Ajay Vibhute 60282b613ca7ba9625a300f1a4e25433803d6a0d m
Pull request #1713: PIPE-2166: potentially switch to doquantiles=False in visstat in hifa_polcal
Merge in PIPE/pipeline from PIPE-2166-potentially-switch-to-doquantiles-false-in-visstat-in-hifa_polcal to main
* commit '85d71ca40e6beb946daa6d00d757782c79edca31':
PIPE-2166: removed continue
PIPE-2166: removed extra whitespace
PIPE-2166: code cleanup
PIPE-2166: setting doquantiles= False in visstat cal in imageparams_vla
PIPE-2166: setting doquantiles to False in visstat -
Rui Xue 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6 m
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
-
Rui Xue 8a0f7c3bf61b6a94b352e2d27b5db421574d7add m
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
- Remove temporary file handling.
- Use `ia.histograms` for histogram calculation. -
Rui Xue 32e17ed444ada97e6cbdf56cfc826e63d8473113 m
Remove the redundant `casaconfig` setup again in `test-unit.yml`
-
Rui Xue 7140e2bf7b9a2d1c71e9358681d5e1e1d531a5cf m
Improve `casaconfig/casarundata` setup in the template with GH action caching
-
Ajay Vibhute ab0dadfb1323e2029711307cbd0f0163aea0ba5f m
Pull request #1728: PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
Merge in PIPE/pipeline from PIPE-2881-vlass-phasecenter-in-parameter-list-format-flexibility to main
* commit '13743f4c6175651be5e562d7b23bb078c6d69d67':
PIPE-2881: adding unit tests for phasecenter_to_skycoord
PIPE-2881: moved angle units to the top of module
PIPE-2881:Fix dd.mm.ss Dec parsing
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing -
Kristin Berry db29155123c590fdd45863b247d52290930ed093 m
Merge branch 'PIPE-2845-pipe-2103-followup-tasks' of ssh://open-bitbucket.nrao.edu:7999/pipe/pipeline into PIPE-2845-pipe-2103-followup-tasks
-
Kristin Berry 7ec2a2c8685a8767929693e312ee058f3e30f4d4 m
PIPE-2845: Fix issue with antenna-based failure reporting and plot on/off toggle.
-
Shawn Booth 197e7c19f83ffb1ba9b1dbd7c6e80ebe07a97858 m
Pull request #1735: PIPE-2142: Turn back on skipped test
Merge in PIPE/pipeline from pipe-2142-turn-on-selfcal-test to main
* commit '05b8cc54d4747ea1828827faf3dca5fa478f90ac':
PIPE-2142: removed redundant test and switched new test to use previous results file
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge -
Shawn Booth 05b8cc54d4747ea1828827faf3dca5fa478f90ac m
PIPE-2142: removed redundant test and switched new test to use previous results file
-
Shawn Booth f6fde5f01f168ff49193277bc45624a9c5d816e6 m
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge
-
Rui Xue 1021a12af545145f4d575bcc69f6f5c524c9318d m
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
- Modify build-gh-pages.yml to trigger on changes to `environment*.yml`
- Update env-setup-run-template.yml to allow dynamic conda environment file input
- Adjust test-unit.yml to support multiple conda environments and update artifact naming logic
- Refine apisummary.rst to correct module references
- Add `new environment_vlass2026.yml` for specific pipeline dependencies of VLASS-PL2026- .github/workflows/build-gh-pages.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/env-setup-run-template.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/test-unit.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- docs/source/apisummary.rst (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- environment_vlass2026.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
-
Rui Xue 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43 m
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
-
Rui Xue 9ced50c5939dce02f1b0b571ef9ccdcae59533db m
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
-
Rui Xue 515cc8fead5706b41830d6faae65ababe418a545 m
Pull request #1734: PIPE-2738: reverse the broken change made in ca3e7a
Merge in PIPE/pipeline from PIPE-2738-hotpatch-for-state-classes to main
* commit '7d5d223acafa8e4278783226adbf21dbf4568913':
PIPE-2738: reverse the broken change made in ca3e7a