Build: #3 was successful Changes by Ajay Vibhute
Code commits
Pipeline
-
Ajay Vibhute 36c9d889fae7a2294fc9198f911da548baa712f8
Merge branch 'main' into PIPE-2952-hif_uvcontsub-runs-for-an-extremely-long-time-during-restore
-
Ajay Vibhute 54657bd8e4893adbad27bb759b91eddbe2d01d7c
PIPE-2952: removed heuristics deepcopy
-
Rui Xue 4b9c547dd168724e257904d81940e90c3f81db36 m
Pull request #1783: PIPE-3051: Add warning for nmajor limit in `CleanBase`
Merge in PIPE/pipeline from PIPE-3051-clone-hif_makeimages-stage-should-issue-warning-if-stopping-criterion-is-nmajor to main
* commit '4766493e7bd8415f96ec18d88a360ea247b71468':
PIPE-3051: Improve logging and error messages in `CleanBase`
PIPE-3051: Add warning for nmajor limit in `CleanBase` -
Rui Xue <rx.astro@gmail.com> 4766493e7bd8415f96ec18d88a360ea247b71468 m
PIPE-3051: Improve logging and error messages in `CleanBase`
-
Ajay Vibhute bc8bd7d374246913a5b0d0428dbf1b2a1db8b69e m
Pull request #1751: PIPE-2990: fixed leading ',' in warning weblog message for ignored antennas
Merge in PIPE/pipeline from PIPE-2990-fix-leading-comma-in-warning-antennas-to-be-ignored-weblog-messages to main
* commit 'deae224f069e5606542fd1f80980c48b3d4c49c8':
PIPE-2990: minor changes suggested during PR review
PIPE-2990: added build_refantignore to build ignore refant and added test for it
PIPE-2990: fix refantignore handling
PIPE-2990: fixed leading ',' in warning weblog message for ignored antennas -
Hajime Ezawa 1663d780bb56c494683e9272d1ad43fd2da66490 m
Pull request #1749: PIPE-2913 sdpl couldn t deal with pointing distribution intersecting ra 12h
Merge in PIPE/pipeline from PIPE-2913-sdpl-couldn-t-deal-with-pointing-distribution-intersecting-ra-12h to main
* commit 'e9f658e8262ee3dcc0358d11199f92b4311bd6a4':
PIPE-2913: additional fix to hsd_baseline stage
PIPE-2913: additional fix to hsd_imaging stage
Revert "PIPE-2491: additional fix to hsd_imaging stage"
Revert "PIPE-2491: additional fix to hsd_baseline stage"
PIPE-2491: additional fix to hsd_baseline stage
PIPE-2491: additional fix to hsd_imaging stage
PIPE-2913: move rewrap_angle() to hsd/tasks/common/utils.py
PIPE-2913: additional fix to rewrap_angle()
PIPE-2913: rewrap AZ related values before pushing into datatable -
Rui Xue 569696f90eeb3328f8bc566803c156ee7b578644 m
PIPE-3051: Add warning for nmajor limit in `CleanBase`
-
Ajay Vibhute ec1ef9503af9617d2b0ac7cfb1a62df76f6278ae m
Pull request #1776: PIPE-3015: ensure file is closed while getting the num rows
Merge in PIPE/pipeline from PIPE-3015-refactor-rendererutils.num_lines to main
* commit 'cc7764ad524660dcd4422eb3f0ed8983a2d24d0e':
opening file with 'utf-8' encoding
PIPE-3015: ensure file is closed while getting the num rows -
Takeshi Nakazato 2de77ead207e8e475103d59b7ce9f69d44a57917 m
Pull request #1773: PIPE-2946 hsd imaging ignore edge channels and channels overlapped with atm lines while examining qa
Merge in PIPE/pipeline from PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa to main
* commit '0fdb5963932f33ee2464003272cceb0652d3cfba':
compliance with PEP 8
Add more explanation on channel_mask parameter
fix too busy xaxis label in contamination plot
indicate edge/ATM region with different color in the plot
Fix for NRO Pipeline error
consistently update the condition to display warning text
PIPE-2946 ignore edge channels and ATM range in contamination analysis -
Ajay Vibhute cc7764ad524660dcd4422eb3f0ed8983a2d24d0e m
opening file with 'utf-8' encoding
-
Ajay Vibhute deae224f069e5606542fd1f80980c48b3d4c49c8 m
PIPE-2990: minor changes suggested during PR review
-
Hajime Ezawa e9f658e8262ee3dcc0358d11199f92b4311bd6a4 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-2913-sdpl-couldn-t-deal-with-pointing-distribution-intersecting-ra-12h
-
Takeshi Nakazato 0fdb5963932f33ee2464003272cceb0652d3cfba m
Merge branch 'main' into PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
Rui Xue 06261ca313d3e55c704716e9e6da34e2bd9ba910 m
Pull request #1672: PIPE-888: replace the use of `list(set(...))` with `utils.deduplicate(..)` to avoid random flagcmd orders.
Merge in PIPE/pipeline from PIPE-888-the-order-of-flagging-statements-in-flagdata-commands-differs-between-pipeline-runs-at to main
* commit '10211fe16b93c4089763a8242cf9250d38a3c94c':
PIPE-888: Refactor condition checks in FluxscaleInputs and SetModelsInputs for clarity; update deduplicate function type hints to accept Iterable
PIPE-1770: remove unnecessary `warnings.catch_warnings()` context manager clause.
PIPE-2865: ensure ordered `vdp` transfer values in `hif/fluxscale` and `hif/setmodel` inputs.
PIPE-1316: preserve the order of phase/target list for `wvrgcal/tie`.
PIPE-888: replace the use of `list(set(...))` with `utils.deduplicate(..)` to avoid random flagcmd orders. -
Rui Xue <rx.astro@gmail.com> 10211fe16b93c4089763a8242cf9250d38a3c94c m
PIPE-888: Refactor condition checks in FluxscaleInputs and SetModelsInputs for clarity; update deduplicate function type hints to accept Iterable
-
Rui Xue <rx.astro@gmail.com> e67a4dbf00b709517eb07779e659756019b228ef m
Merge remote-tracking branch 'origin/main' into PIPE-888-the-order-of-flagging-statements-in-flagdata-commands-differs-between-pipeline-runs-at
-
Takeshi Nakazato 0dae8624162ce754d1dccbfb5c26d71b70e5fe80 m
compliance with PEP 8
-
Takeshi Nakazato 11d9871595a6f22d0befdc5f8068d8cc6a0e1739 m
Merge branch 'main' into PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
Ajay Vibhute e4000b70fcc588a0e70ecec252502bc40cf18c8c m
Pull request #1710: PIPE-1435 hifv testbpdcals should only flag the polarization affected by dts issues
Merge in PIPE/pipeline from PIPE-1435-hifv_testbpdcals-should-only-flag-the-polarization-affected-by-dts-issues to main
* commit '4dca9985aec72d0bb47917773ea11c5a247871c8':
PIPE-1435: minor changes suggested in PR review
PIPE-1435: avoided nested list used for weblogflagdict
PIPE-1435: showing correlation string on weblogs
PIPE-1435: displayed flagged correlation on weblogs
PIPE-1435: flagging only offending correlation per spw
PIPE-1435: flagging only offending correlation -
Ajay Vibhute 3ff4691f92f34997879e49a04e419d39f68f567f m
Pull request #1680: PIPE-2584 hifv fluxboot qa criteria
Merge in PIPE/pipeline from PIPE-2584-hifv_fluxboot-qa-criteria to main
* commit 'e247ba29224f31eb78fd7b8a81994a15b865e755':
PIPE-2584: using spws only in science scan and warning is displayed only if more than 50% science spws are missing
PIPE-2584: checking if spw is missing in all scans rather than each scan
PIPE-2584: updated matric score
PIPE-2584: added QA message when there are no rows for a given scan and spw
PIPE-2584: Checking model_data column is present and calibrator.ms is not empty before running visstat
PIPE-2584: added applies_to to the QA score
PIPE-2584: using visstat to check model column is set to 1 or not
PIPE-2584: minor changes suggested in PR
PIPE-2584: check to ensure flux density is measured
PIPE-2584: Add QA scoring checks for flagged SPWs, calibrator data, and spectral index limits -
Shawn Booth 48f6ccb438ddc048eed491ed1d5a8ab225fd50e3 m
Pull request #1758: PIPE-2320: hifa_flagdata heuristic for determining FDM spws should use msmd.almaspws
Merge in PIPE/pipeline from PIPE-2320-hifa_flagdata-heuristic-for-determining-fdm-spws-should-use-msmd.almaspws to main
* commit '84bbb0b3dd7e0e677537ac0c9a99f796ff390cc4':
PIPE-2320: removed unused import and added _fdm_spws default to class definition
PIPE-2320: added unit tests to exercise heuristics change
PIPE-2320: use CASA metadata for ALMA FDM detection -
Takeshi Nakazato 773c00f1db770de750090d891802c9a573ff870a m
Add more explanation on channel_mask parameter
-
Ajay Vibhute ebcb7dc8832e630bb76f6bcfacb8c43fba3d4b5b m
PIPE-3015: ensure file is closed while getting the num rows
-
Takeshi Nakazato 53b199b8829ffc88ce98f526d45a00a3b282c9e9 m
fix too busy xaxis label in contamination plot
-
Ajay Vibhute e247ba29224f31eb78fd7b8a81994a15b865e755 m
PIPE-2584: using spws only in science scan and warning is displayed only if more than 50% science spws are missing
-
Takeshi Nakazato 49f58bcd5d6eb9431e3e708a6b40a7595eb8415c m
indicate edge/ATM region with different color in the plot
-
Takeshi Nakazato 2a4e146cfc580cac71ba3c5ba8af2888c3e66f05 m
Merge branch 'main' into PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
Takeshi Nakazato 1586870cdc9e7d9aede5b7dd778bb3d14fc57502 m
Fix for NRO Pipeline error
-
Ajay Vibhute 723d091829937fa1e72a62b7477c9e02ff667451 m
PIPE-2584: checking if spw is missing in all scans rather than each scan
-
Luke Maud bb47a3ac56b40d76bf5b29d088ae96b6aecd9f28 m
Pull request #1753: PIPE-2694: add check of candidate fields and return None if not found
Merge in PIPE/pipeline from PIPE-2694-hifa_gfluxscale-qa-undefined-score-due-to-incorrect-field-assessment-min-arg-empty to main
* commit '99b7229a29a2ecfad502e62ab58714b851191497':
PIPE-2694 removed empty spaces
PIPE-2694_correct_return_based_on_PR_text
PIPE-2694_description_edit
PIPE-2694_edits_to_clean_up_logic_after_first_PR
PIPE-2694: add check of candidate fields and return None if not found -
Takeshi Nakazato d140e9d464018097c3c15732a46f214597c1f4fb m
consistently update the condition to display warning text
-
Takeshi Nakazato 59f8cf59629dfb4a60d59c39c62972a56b87367b m
PIPE-2946 ignore edge channels and ATM range in contamination analysis
Logic to determine edge channels and the range of ATM features are
moved/copied from scorecalculator.py -
Shawn Booth ac059c739e7b9d5e3e4900639cb9de77c0a1ebe6 m
Pull request #1738: PIPE-2473: Change hifv_hanning to use new mstransform with pass through
Merge in PIPE/pipeline from PIPE-2473-change-hifv_hanning-to-use-new-mstransform-with-pass-through to main
* commit '61ae98b99f4c16b7da408b5648fc28d92572ee09':
PIPE-2473: fixed docstrings using Return instead of preferred Return; used assigned variable temp_ms instead of hard-coded strings; updated CASA version to 6.7.3 for hanningsmooth parameter exposure
PIPE-2473: added backfill of inputs.spws_to_smooth for automatic detection workflow; added test cases to exercise inputs.spws_to_smooth cases
PIPE-2473: added unit tests to cover the hanning module
PIPE-2473: enabled spw selection for hanningsmooth CASA task and removed use of ms tools; cleaned up some code logic and fixed potential error routes -
Ajay Vibhute 5f9ef099ce477138f13533d4e33175b9bcf1411f m
PIPE-2990: added build_refantignore to build ignore refant and added test for it
- pipeline/hifv/tasks/circfeedpolcal/circfeedpolcal.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/hifv/tasks/finalcals/finalcals.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/hifv/tasks/fluxscale/fluxboot.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/hifv/tasks/fluxscale/solint.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/hifv/tasks/semiFinalBPdcals/semiFinalBPdcals.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/hifv/tasks/testBPdcals/testBPdcals.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/infrastructure/utils/utils.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
- pipeline/infrastructure/utils/utils_test.py (version 5f9ef099ce477138f13533d4e33175b9bcf1411f) (diffs)
-
Shawn Booth 7b4b761df7dc444059837a8201775dbe9b74ec10 m
Pull request #1743: PIPE-1836: Clean Up Deprecation Warnings
Merge in PIPE/pipeline from pipe-1836-clean-up-deprecation-warnings to main
* commit 'bb482b1f169f76d0610ff8b695fafc94f0b37405':
PIPE-2666: fixed indentation issue in mako file
PIPE-2663: added explicit data format 'o' to mimic plot_date default
PIPE-1836: improved numpy code per reviewer comments
PIPE-1836: removed more deprecated newshape keyword arguments
PIPE-1836: remove deprecated newshape keyword argument in np.reshape; added filter argument to tar.extractall calls
PIPE-2665: fixed additional array-to-scalar deprecation warnings; switched deprecated fig.set_constrained_layout_pads call in favor of fig.get_layout_engine().set
PIPE-1836: fixed numpy rename leading to import error
PIPE-2984: fixed pyparsing deprecation warnings in conversion.py
PIPE-1836: changed deprecated interpolation parameter in numpy.percentile to use method name instead
PIPE-2666: replace use of deprecated matplotlib.pyplot.cm.get_cmap
PIPE-2665: fixed numpy scalar conversion warnings when converting an array to a scalar
PIPE-2663: converted all deprecated calls to pyplot.plot_date to pyplot.plot -
Luke Maud c51d15a957cd2cf7aa627407563c3836d2577c2d m
Pull request #1765: PIPE-2932 change fraction flag limit to 0.5 and logics to equal and greater than
Merge in PIPE/pipeline from PIPE-2932-stop-hifa_diffgaincal-from-also-flagging-target-solutions-when-some-scan-groups-are-fully to main
* commit '6357f6a46b48c324e28a1bbec8a4909fa5f7f9db':
PIPE-2932 update comment with comma
PIPE-2932 change fraction flag limit to 0.5 and logics to equal and greater than -
Kristin Berry 6357f6a46b48c324e28a1bbec8a4909fa5f7f9db m
PIPE-2932 update comment with comma
-
Rui Xue 5f73f8ce047cc9d78f02675f1755fa8bb243e808 m
Pull request #1752: PIPE-1677: multiple mses in vlass imaging pipeline
Merge in PIPE/pipeline from PIPE-1677-multiple-mses-in-vlass-imaging-pipeline to main
* commit '4fa7558f183f744ef44c52687ea70abdbe63022b':
PIPE-1677: Refactor `get_sourcename` method in `ImageParamsHeuristics` for improved readability
PIPE-1677: Refactor logging statements in `ImageParamsHeuristics` and `ImageParamsHeuristicsVlassQl`
PIPE-1677: Update `is_eph_obj` method in VLASS heuristics to include type hints and detailed docstrings
PIPE-1677: Remove the `spwsel_lsrk` specification workaround for multi-MS case.
PIPE-1667: Override `is_eph_obj` in `ImageParamsHeuristicsVlassQl` to disable ephemeris checks
PIPE-1677: Add multi-MS support for the VLASS imaging pipeline in `hif_editimlist`, `hif_makeimages`/`hif_tclean`, and imaging heuristics classes.
PIPE-1677: Support multiple MSes in `Transformimagedata`
PIPE-1677: Improve `vlass_selfcal.mako` for better multi-vis support
PIPE-1677: Adjust `hifv_checkflag` summary rendering for better multi-vis support
PIPE-1677: Refactor `hifv_statwt` rendering to support multiple MSes for VLASS
PIPE-1677: Convert `hifv_exportvlassdata` to a "multi-vis" task and add support for archiving multiple self-calibration tables and flag versions -
Rui Xue 4fa7558f183f744ef44c52687ea70abdbe63022b m
PIPE-1677: Refactor `get_sourcename` method in `ImageParamsHeuristics` for improved readability
-
Luke Maud 464b85b3f776af89d91eb7e023091e2eee133dde m
Pull request #1740: PIPE-2901 add commentary explanations into hifa heursitics snr code
Merge in PIPE/pipeline from PIPE-2901-add-commentary-explanations-into-hifa-heursitics-snr-code to main
* commit 'd43d5679e37928cbc9f1d50a362290982cb42343':
PIPE-2901: Improve comments and variable naming in SNR calculations for clarity
PIPE-2901: Fix some minor typos with small codestyle updates
PIPE-2901: updated gaincalSNR function in fluxscale/qa.py for compatability with snr.py calculations
PIPE-2901: correct all parameters nbaselines to nEffectiveAntennas
PIPE-2901: edit to n-3 equation and rename nbaselines to nEffectiveAntennas
add PIPE-2901 explination and update hard coded ant numbers to fiducal variable -
Rui Xue d43d5679e37928cbc9f1d50a362290982cb42343 m
PIPE-2901: Improve comments and variable naming in SNR calculations for clarity
-
Rui Xue a8a3f62d8cc3c19a44797d23af0ff9f091b455ed m
Pull request #1763: PIPE-3004: Refactor FieldTable._read_table to optimize scan checks and reduce unnecessary computations
Merge in PIPE/pipeline from PIPE-3004-refactoring-fieldtable._read_table to main
* commit '7f44fe5b8df0412da26d172ccf0a1797cc97efbb':
PIPE-3004: Minor updates to improve readability of scan determination logic
PIPE-3004: Refactor FieldTable._read_table to optimize scan checks and reduce unnecessary computations -
Rui Xue <rx.astro@gmail.com> 7f44fe5b8df0412da26d172ccf0a1797cc97efbb m
PIPE-3004: Minor updates to improve readability of scan determination logic
-
Luke Maud f13422f29445a6e51af26d2b34aef050f72452f3 m
PIPE-2932 change fraction flag limit to 0.5 and logics to equal and greater than
-
Rui Xue 30e1473dcb3773a1b02c07f4b222313243e30e1d m
PIPE-3004: Refactor FieldTable._read_table to optimize scan checks and reduce unnecessary computations
-
Rui Xue <rx.astro@gmail.com> b9ab438464dd42f47c0b3456c7a24fca7a28bb32 m
PIPE-1677: Refactor logging statements in `ImageParamsHeuristics` and `ImageParamsHeuristicsVlassQl`
-
Rui Xue <rx.astro@gmail.com> f036033eb1e92fd746c033492a0a59b5311c0130 m
PIPE-1677: Update `is_eph_obj` method in VLASS heuristics to include type hints and detailed docstrings
- pipeline/hif/heuristics/imageparams_base.py (version f036033eb1e92fd746c033492a0a59b5311c0130) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_quick_look.py (version f036033eb1e92fd746c033492a0a59b5311c0130) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_single_epoch_continuum.py (version f036033eb1e92fd746c033492a0a59b5311c0130) (diffs)
-
Shawn Booth 7e7c567325cfb66a6ec4fbef286b7e35453bd9d4 m
Pull request #1759: PIPE-2999: auto-cleanup of testing directory from almaimportdata_test.py
Merge in PIPE/pipeline from PIPE-2999-auto-cleanup-of-testing-directory-from-almaimportdata_test.py to main
* commit 'fe959666c96e7b94bd4e02784ba0eebbcdae8aad':
PIPE-2999: added fixture to prevent leftover directory after running recipe_converter_test.py
PIPE-2999: use pytest's tmp_path fixture to clean up temp directories -
Shawn Booth 571d3827104cc21a36f6d92209f12f04f557fd5b m
Pull request #1761: PIPE-2503: add small b2b / polcal tests in the regression test collections
Merge in PIPE/pipeline from PIPE-2503-add-small-b2b-polcal-tests-in-the-regression-test-collections to main
* commit '0b8a3cd5a9b16714a4faa3caf0d82e861a7ca4c3':
PIPE-2503: turned back on polcal and B2B regression tests; updated polcal test to use different dataset -
Shawn Booth fe959666c96e7b94bd4e02784ba0eebbcdae8aad m
PIPE-2999: added fixture to prevent leftover directory after running recipe_converter_test.py
-
Kristin Berry 99b7229a29a2ecfad502e62ab58714b851191497 m
PIPE-2694 removed empty spaces
-
Shawn Booth 84bbb0b3dd7e0e677537ac0c9a99f796ff390cc4 m
PIPE-2320: removed unused import and added _fdm_spws default to class definition
-
Shawn Booth 8791506dff62feb3a95804c61117920eb1cd20e4 m
Pull request #1760: PIPE-1654: Add weblog rendering failure detection to regression tests
Merge in PIPE/pipeline from PIPE-1654-detect-weblog-rendering-failures-in-regression-tester to main
* commit '15b8691d7f4c9da10b6b7f69347c99aa17035891':
PIPE-1654: moved SIMULATE_WEBLOG_FAILURE logic into conftest.py to isolate from production code
PIPE-1654: add weblog rendering failure detection to regression tests -
Shawn Booth 15b8691d7f4c9da10b6b7f69347c99aa17035891 m
PIPE-1654: moved SIMULATE_WEBLOG_FAILURE logic into conftest.py to isolate from production code
-
Shawn Booth 0b8a3cd5a9b16714a4faa3caf0d82e861a7ca4c3 m
PIPE-2503: turned back on polcal and B2B regression tests; updated polcal test to use different dataset
-
Kristin Berry e4672d848e3dc731b02352f8516950a4c511cbc1 m
Pull request #1690: PIPE-2845: PIPE-2103 followup features and bugfixes
Merge in PIPE/pipeline from PIPE-2845-pipe-2103-followup-tasks to main
* commit '09431438bcf5ed154523ddbbb83606b401a4c005':
PIPE-2845: Clean up old comments and update failuretype for spw-wide failures
PIPE-2845: Fix issue with antenna-based failure reporting and plot on/off toggle.
PIPE-2845: Switch issue reporting from aggregated by spw to aggregated by spw and then ant.
PIPE-2845: Turn plotting off by default and only output skip spw message once per spw.
PIPE-2845: Update formatting to add more spaces.
PIPE-2845: Update atmosphere line fitting to map to fit frequencies directly, rather than relying on the frequencies in the spw array in case the fit is outside the array. Prevents an out of bounds error. -
Shawn Booth 5ebece4eb9d0f7def69a3b6e27affdab83531d03 m
PIPE-1654: add weblog rendering failure detection to regression tests
- pipeline/infrastructure/renderer/htmlrenderer.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
- pipeline/infrastructure/renderer/regression.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
- tests/test_pipeline_testing_framework.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
- tests/testing_utils.py (version 5ebece4eb9d0f7def69a3b6e27affdab83531d03) (diffs)
-
Shawn Booth 885fa1cdc0039f090613a54079da47be2c63ed2a m
PIPE-2999: use pytest's tmp_path fixture to clean up temp directories
-
Luke Maud 4e7a4a8fbdeb9a8880167cc91ba0e4d24191a113 m
PIPE-2694_correct_return_based_on_PR_text
-
Luke Maud 03e0f4558ac2b883533923e57cff3c13569f5ac5 m
PIPE-2694_description_edit
-
Luke Maud a70dbeb6edfdd3caedab0030b15cfd6944a18d8b m
PIPE-2694_edits_to_clean_up_logic_after_first_PR
-
Takeshi Nakazato ef6c047d8e3ce85d18c2c4877aa986729c4f8342 m
Pull request #1748: PIPE-2954 hsd imaging misspelling in the warning message
Merge in PIPE/pipeline from PIPE-2954-hsd_imaging-misspelling-in-the-warning-message to main
* commit '5acbc84cce0f1048a1c7b0b886416dc59e8cbfec':
refactoring warning message
PIPE-2954 fix typo in warning message -
Shawn Booth 8ef86ee1a6721bff7dad4638e97e7ccb89485f49 m
PIPE-2320: added unit tests to exercise heuristics change
-
Shawn Booth f825d456eacbd5a5166a835dcb913e8a8e315b79 m
PIPE-2320: use CASA metadata for ALMA FDM detection
-
Ajay Vibhute 3adf08d62a4d215c83db90a54740eb191304f2b1 m
PIPE-2990: fix refantignore handling
- pipeline/hifv/tasks/circfeedpolcal/circfeedpolcal.py (version 3adf08d62a4d215c83db90a54740eb191304f2b1) (diffs)
- pipeline/hifv/tasks/finalcals/finalcals.py (version 3adf08d62a4d215c83db90a54740eb191304f2b1) (diffs)
- pipeline/hifv/tasks/fluxscale/fluxboot.py (version 3adf08d62a4d215c83db90a54740eb191304f2b1) (diffs)
- pipeline/hifv/tasks/fluxscale/solint.py (version 3adf08d62a4d215c83db90a54740eb191304f2b1) (diffs)
- pipeline/hifv/tasks/semiFinalBPdcals/semiFinalBPdcals.py (version 3adf08d62a4d215c83db90a54740eb191304f2b1) (diffs)
- pipeline/hifv/tasks/testBPdcals/testBPdcals.py (version 3adf08d62a4d215c83db90a54740eb191304f2b1) (diffs)
-
Rui Xue <rx.astro@gmail.com> 5494b0144b4c425948f8e46843df37d645bd2e0b m
Merge remote-tracking branch 'origin/main' into PIPE-1677-multiple-mses-in-vlass-imaging-pipeline
-
Rui Xue edfa947e20d405cd2555af1517b94c08b780b9b2 m
Pull request #1756: PIPE-2997/PIPE-2998: expand the gh action unit test matrix
Merge in PIPE/pipeline from PIPE-2997-expand-the-gh-action-unit-test-matrix to main
* commit '233566793c8887be813de84e5000119af22028a8':
PIPE-2997: Additional update/fixes to the workflow template
PIPE-2997: Add Pixi-based GitHub Actions workflows/templates for documentation building and unit testing
PIPE-2998: Recommend `memray` for memory use profiling as `memory_profiler` is no longer maintained.
PIPE-2998: Use `shutil.which` for improved compatibility with Python 3.13
PIPE-2997: Source `CASA6` packages explicitly from the NRAO PyPI index
PIPE-2997: Add new Pixi environments in `pyproject.toml` -
Shawn Booth bb482b1f169f76d0610ff8b695fafc94f0b37405 m
PIPE-2666: fixed indentation issue in mako file
-
Rui Xue 56e111a89b8e0ad55239ece97777b1dcde7f4823 m
Pull request #1159: PIPE-2014: improve the timing stats in timetracker.json and weblog
Merge in PIPE/pipeline from PIPE-2014-improve-timetracker-and-weblog-timing-stats to main
* commit '38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60':
PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility
PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker
PIPE-2014: Improve task duration formatting in HTML renderer and Mako template
PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page
PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`
PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4
PIPE-2014: Ensure `TaskCompleteEvent` is sent for non-"multi_vis" tasks.
PIPE-2014: add back a code block accidentally removed from the last merge conflict resolution.
PIPE-2014: use the timetracker event stats for task duration calculations.
PIPE-2014: optimize the renderer execution order for more accurate timing stats displayed in the weblog.
PIPE-2014: start the weblog creation timer at the beginning of weblog rendering. -
Rui Xue <rx.astro@gmail.com> 233566793c8887be813de84e5000119af22028a8 m
PIPE-2997: Additional update/fixes to the workflow template
* `shell:` is evaluated at workflow parse time, not at runtime, so `${{ inputs.pixi_env }}` isn't available in the shell: field for reusable workflows.
* Disable caching for Pixi environment to ensure the latest dev snapshots are used
* Fix a bug in the CASA config stage of the Pixi template
* Remove unnecessary solve-group entries
* Update `protobuf` version specification in `environment.yml` to ensure compatibility with `casaplotms` -
Rui Xue <rx.astro@gmail.com> 789f75259e531c95b496974fb171ebf570a958f9 m
PIPE-2997: Add Pixi-based GitHub Actions workflows/templates for documentation building and unit testing
- .github/workflows/build-gh-pages-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
- .github/workflows/env-setup-run-template-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
- .github/workflows/test-unit-pixi.yml (version 789f75259e531c95b496974fb171ebf570a958f9) (diffs)
-
Rui Xue <rx.astro@gmail.com> 13dd7f53ef6b406f978e3563ef1817a607ba1218 m
PIPE-2998: Recommend `memray` for memory use profiling as `memory_profiler` is no longer maintained.
-
Rui Xue <rx.astro@gmail.com> 2ea804b5013f7e6ff2678b2f192bc5c5b39ea3db m
PIPE-2998: Use `shutil.which` for improved compatibility with Python 3.13
-
Rui Xue <rx.astro@gmail.com> 24162d0b26513b076ae54beee69386dfbf517700 m
PIPE-2997: Source `CASA6` packages explicitly from the NRAO PyPI index
To reduce the load on the NRAO PyPI index caused by uv's aggressive
parallel resolution strategy, we explicitly declare which packages must
be sourced from casa-pip.nrao.edu using per-dependency `index` fields:
- casashell, casatools, casatasks, casampi, casaplotms, casaplotserver
All other dependencies (numpy, scipy, grpcio, protobuf, etc.) resolve
from the default PyPI index only, avoiding unnecessary queries to the
NRAO server during environment solving. -
Rui Xue <rx.astro@gmail.com> 590fa43489a85d49ca3dbbd88730b31a682bcc45 m
PIPE-2997: Add new Pixi environments in `pyproject.toml`
-
Shawn Booth 834358c74f94f949040517d2af109971693c9df2 m
PIPE-2663: added explicit data format 'o' to mimic plot_date default
-
Shawn Booth 61ae98b99f4c16b7da408b5648fc28d92572ee09 m
PIPE-2473: fixed docstrings using Return instead of preferred Return; used assigned variable temp_ms instead of hard-coded strings; updated CASA version to 6.7.3 for hanningsmooth parameter exposure
-
Rui Xue 85cf92dc6fba8e3c2521cb90ad7c29f23121b5d2 m
Pull request #1755: PIPE-2996: Cache casarundata in env setup template
Merge in PIPE/pipeline from cache-casarundata-in-env-setup-template to main
* commit '32e17ed444ada97e6cbdf56cfc826e63d8473113':
Remove the redundant `casaconfig` setup again in `test-unit.yml`
Improve `casaconfig/casarundata` setup in the template with GH action caching -
Rui Xue <rx.astro@gmail.com> 38d910f91e9b3fbbf159b54bc4a0f0c17e2d4b60 m
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
-
Rui Xue <rx.astro@gmail.com> 6c63b253b72e657075e037da7df85893b797f19e m
PIPE-2014: Use `datetime.timezone.utc` instead of `datetime.UTC` for Python 3.10 compatibility
-
Rui Xue 261c8820cf8063cfe2473d253e43767b132bbc31 m
Pull request #1754: PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
Merge in PIPE/pipeline from sync-bitbucket-github-repos-with-workflow to main
* commit '598ae9e3096c183c8230659aa9a2caeb715ff123':
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket -
Rui Xue <rx.astro@gmail.com> 598ae9e3096c183c8230659aa9a2caeb715ff123 m
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
-
Shawn Booth 1fb676fce43f05a304ce0ed08007bc57496710e3 m
PIPE-1836: improved numpy code per reviewer comments
-
Rui Xue c7211e85b28f68948a0c35ff80068ba5d45ce051 m
PIPE-2901: Fix some minor typos with small codestyle updates
-
Rui Xue ee58e080236d14cb7c8fa5d57e3258a3d3996131 m
Merge remote-tracking branch 'origin/main' into PIPE-2901-add-commentary-explanations-into-hifa-heursitics-snr-code
-
Rui Xue 5dead9ae807422078ab5ba32dacd80165f625251 m
Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
Merge in PIPE/pipeline from unit-test-vlass2026 to main
* commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
PIPE-2940: Add Pixi environment definitions for the PL2026 development
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026. -
Rui Xue d6e477200df51044506c241e43ea4e03b6b3d1c4 m
PIPE-2014: Update task duration mapping to use integer keys for stage numbers in timetracker
-
Rui Xue 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m
Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
* commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability: -
Rui Xue 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
-
Rui Xue d779f7928d0ed958341c2bf25f3b20832f5592b4 m
PIPE-2014: Improve task duration formatting in HTML renderer and Mako template
-
Rui Xue 67e48129929d51db51793d7d086597c08294fbbe m
PIPE-2014: Revert to the old approach of tracking weblog rendering duration - restricted to rendering of per-stage task result page
-
Takeshi Nakazato 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m
Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
* commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
move channel axis label upward slightly
added note to docstring for add_channel_axis
PIPE-2894 always display channel axis to sparse profile map -
Rui Xue 8e265de65f7535cdf17b1192e9f4fafe325eb87b m
PIPE-2014: Switch to timezone-aware `datetime` in UTC for recording timestamps from `timetracker`
-
Rui Xue f69f39c3c4b99ea59d85e8b9da2438a2e56b7b18 m
PIPE-2014: Switch to `shelve.open()` which returns a shelf object that is a context manager since Python 3.4
-
Rui Xue 73998b946595418d179ed619454b197430a0ab5c m
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
Resolved conflicts:
- `pipeline/infrastructure/basetask.py`
- `pipeline/infrastructure/renderer/htmlrenderer.py` -
Shawn Booth 8a304692b6815dd395609e182425116462944e49 m
PIPE-2473: added backfill of inputs.spws_to_smooth for automatic detection workflow; added test cases to exercise inputs.spws_to_smooth cases
-
Kristin Berry 465285e01b87f372c957660f993a467c2b67a264 m
Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
* commit '84610e456d06c5b0b695a098e974859674ecf063':
PIPE-2985: Update bullet-points to use - rather than o
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects -
Rui Xue 3ae1efb71ad2c049ba34a36d1eb35df736bb8e44 m
PIPE-1677: Remove the `spwsel_lsrk` specification workaround for multi-MS case.
-
Rui Xue dcdf548b5f42fc8351e9e78174cd570642b7c6a7 m
PIPE-1667: Override `is_eph_obj` in `ImageParamsHeuristicsVlassQl` to disable ephemeris checks
-
Ajay Vibhute 492a8f21c31a033a5ca0a5bec3b58ef213937573 m
PIPE-2990: fixed leading ',' in warning weblog message for ignored antennas
- pipeline/hifv/tasks/circfeedpolcal/circfeedpolcal.py (version 492a8f21c31a033a5ca0a5bec3b58ef213937573) (diffs)
- pipeline/hifv/tasks/finalcals/finalcals.py (version 492a8f21c31a033a5ca0a5bec3b58ef213937573) (diffs)
- pipeline/hifv/tasks/fluxscale/fluxboot.py (version 492a8f21c31a033a5ca0a5bec3b58ef213937573) (diffs)
- pipeline/hifv/tasks/fluxscale/solint.py (version 492a8f21c31a033a5ca0a5bec3b58ef213937573) (diffs)
- pipeline/hifv/tasks/semiFinalBPdcals/semiFinalBPdcals.py (version 492a8f21c31a033a5ca0a5bec3b58ef213937573) (diffs)
- pipeline/hifv/tasks/testBPdcals/testBPdcals.py (version 492a8f21c31a033a5ca0a5bec3b58ef213937573) (diffs)