Build: #4 was successful Changes by Ajay Vibhute
Code commits
Pipeline
-
Ajay Vibhute 16c4ef174afad9895a9e0efcfced9a3912ee116e
PIPE-3064: resolved merge conflicts in pipeline/hifv/tasks/testBPdcals/qa.py
-
Rui Xue 23668517e8bd08200a5edc8b8d62814a40903d88 m
Pull request #1842: PIPE-3074: Include EB UID in image deduplication key
Merge in PIPE/pipeline from PIPE-3074-in-multi-eb-mouses-for-the-same-check-source-pl2025-exports-imaging-products-for-one-the to main
* commit '3ddc2ef8f573ad41a06945a93436cc97420cb69c':
PIPE-3074: Add `imagename_prefix` to cutout and RMS ImageItems
PIPE-3074: Propagate `imagename_prefix` through `ImageItem` for per-EB products -
Rui Xue d27df87bd0eb34fb3ce71bfbfc8f38a041edf59f m
Pull request #1853: PIPE-3128
Merge in PIPE/pipeline from PIPE-3128-polarization-calibration-imaging-repbw-stokes-iquv-image-not-inheriting-cleanmask-and to main
* commit 'f9ded2cde48b05139f176936511a63f36c8d7a88':
PIPE-3128: Fix CleanTargetInfo specmode key mismatch for repBW imaging
PIPE-3096: Fix the 'field' name value mismatch in `CleanTargetInfo` -
Ilsang Yoon 5d29697925179e03f19005ed5846cfc581075e8e m
Pull request #1847: PIPE-3026: I updated the score/PIPE-3028: I updated the QA message
Merge in PIPE/pipeline from PIPE-3026-update-qa-score-for-phase-offset-outliers-in-unmapped-spws to main
* commit '482b4e46deab5ae30083d567ccd08fae5e6d5c4e':
PIPE-3026/3028: update the code style
PIPE-3026: I updated the score/PIPE-3028: I updated the QA message -
Dirk Muders 0199f3a67825f32f63d28bb09bfaae319dc182b1 m
Pull request #1846: PIPE-3057 / PIPE-3053: Modify uvcontsub and IF imaging for new MS frames
Merge in PIPE/pipeline from PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames to main
* commit '5c610c885dd2b5760246f65f709426e49bce774f':
PIPE-3003: Rolled back VLA flagging template name changes.
PIPE-3003: Added new MS name extensions to sanitize method. Use actual MS name root to get default flagging task templates.
PIPE-3057: Fixed contfilehandler test.
PIPE-3003: Make `MstransformResults.output_data_type` optional for VLA compatibility
PIPE-3057/PIPE-3053: Changed all "_topo" methods and variable names to "_ms_frame". Changed advisechansel calls to use the MS native frequency frame as desired frame to convert to.
PIPE-3003: Removed duplicate lines.
PIPE-3003: Changed 'cont+line' phrasing to 'transformed'.
PIPE-3003: Fixed empty results return use case.
PIPE-3003: Added ephemeris object handling code.
PIPE-3003: Edited doc strings and log messages. Attempt to return more useful empty result (not yet working).
PIPE-3003: Remove inputs parameters that CASA's mstransform does not understand.
PIPE-3003: Added DataType.RAW to 'processing_data_types' to prepare for out-of-sequence call handling.
PIPE-3003: Fixed bug (previous instead of new MS name) in creating '*.flagtargetstemplate.txt' files for new MSes in hif_mstransform and hif_uvcontsub.
PIPE-3003: Implemented new hif_mstransform mode to create imaging MSes with re-gridding to the native frequency frame (SOURCE still to be excluded). Changed 'processing_data_type' to 'processing_data_types' in all pipeline tasks.
PIPE-3003: Added new imaging datatypes.
PIPE-2955: Consolidate parameter cleanup for unsupported inputs to `casatasks/mstransform`
PIPE-2955: Add `per_spw` option to `hif_mstransform` for splitting MSes on each spectral window -
Takeshi Nakazato 520dad92d55b2ef2ce1f415caef9b2f3a9973fdd m
Pull request #1870: PIPE-3146 set status to None if dbservice is False
Merge in PIPE/pipeline from PIPE-3146-hsd_k2jycal-weblog-shows-as-dbaccess-has-been-done-even-when-dbservice-false to main
* commit '8a367a99ebb3444f89b51a0b3a0a51c887fc84f1':
clarify the intention to set status None
PIPE-3146 set status to None if dbservice is False -
Takeshi Nakazato 8a367a99ebb3444f89b51a0b3a0a51c887fc84f1 m
clarify the intention to set status None
-
Takeshi Nakazato 094ee97d2bc458abb274db99e35e30fbd60a5bc8 m
PIPE-3146 set status to None if dbservice is False
-
Dirk Muders 5c610c885dd2b5760246f65f709426e49bce774f m
Merge branch 'PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames
-
Dirk Muders 24896f9a345d22a094663e2f6491a7f0518a1964 m
Merge remote-tracking branch 'origin/main' into PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames
-
ilsangyoon <yoonilsang.umass@gmail.com> 482b4e46deab5ae30083d567ccd08fae5e6d5c4e m
PIPE-3026/3028: update the code style
-
Ilsang Yoon 12cc5686d469e9a3b173a675b6fdec17a3c7f5b3 m
Pull request #1835: PIPE-3042: updating QA score
Merge in PIPE/pipeline from PIPE-3042-change-qa-aggregation-function-for-check-source-fitting-in-hif_makeimages to main
* commit '9b70ce19197e30b21ab5a527cebcc0e221f66e26':
PIPE-3042: second commit after the code reviewer's feedback
PIPE-3042: updating QA score -
Rui Xue 94251550962231da6777ff0f7ad0873e3f33923a m
Pull request #1863: PIPE-3137: Fix FindCont `skip_stage` parameter to prevent blank `cont.dat`
Merge in PIPE/pipeline from PIPE-3137-skip-write-out-empty-cont.dat-from-hif_findcont-if-it-s-skipped-stage-in-vla to main
* commit '8f7e5af8b2b8206db7474e72e6dc0dfbd1788d36':
PIPE-3137: Fix FindCont `skip_stage` parameter to prevent blank `cont.dat` -
Dirk Muders 8170c0a79f794bc8a1a35842cd92799fc5489e14 m
PIPE-3003: Rolled back VLA flagging template name changes.
-
Dirk Muders 51af7c9c184f87f36d299e55bb4fe0f84897514b m
Pull request #1856: PIPE-2766: Updated findContinuum.py to v9.6.
Merge in PIPE/pipeline from PIPE-2766_findContinuum_improvements_for_PL2026 to main
* commit '9d4c2bcbbfd16363f7fe520c40765f502e8cc243':
PIPE-2766: Updated findContinuum.py to v9.6.
PIPE-2766: Updated findContinuum.py to v9.5. -
Rui Xue f49749b20bd11ad4fe67297a8e50ffe5c2805ff5 m
Pull request #1843: PIPE-2883: Improve representative target selection robustness
Merge in PIPE/pipeline from PIPE-2883-hif_checkproductsize-failing-for-vla-spectral-line-data-when-rep-spw-is-fully-flagged to main
* commit '3c80c4335b2b1af4f534e2058217c77c29368a98':
PIPE-2883: Improve the code clarity for the new representative source selection logic
PIPE-2883: Improve representative target selection robustness -
Dirk Muders 433e041161529782c6e105baa2855adfc9969c79 m
Merge remote-tracking branch 'origin/main' into PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames
-
Dirk Muders 90db66902743413a05e9c6675aafc9c55f5420b3 m
PIPE-3003: Added new MS name extensions to sanitize method. Use actual MS name root to get default flagging task templates.
- pipeline/hifa/tasks/flagging/flagtargetsalma.py (version 90db66902743413a05e9c6675aafc9c55f5420b3) (diffs)
- pipeline/hifv/tasks/flagging/flagtargetsdata.py (version 90db66902743413a05e9c6675aafc9c55f5420b3) (diffs)
- pipeline/infrastructure/filenamer.py (version 90db66902743413a05e9c6675aafc9c55f5420b3) (diffs)
-
Luca Di Mascolo d96dab1301621599af12a1be74cee5ca38929d39 m
Pull request #1809: PIPE-2073 add the non pb corrected image peak flux to the aquareport
Merge in PIPE/pipeline from PIPE-2073-add-the-non-pb-corrected-image-peak-flux-to-the-aquareport to main
* commit '8b14dcdd7cf94118957606c9daaf8087b8190687':
PIPE-2073: avoid `eval` for accessing `*_imagename`
PIPE-2073: fix formatting issues [I001]
PIPE-2073: fix formatting issues [E722]
PIPE-2073: fix formatting issues [D*, F541, E741]
PIPE-2073: avoid setting pbcor min/max when image.pbcor does not exist
PIPE-2073: fix clashing quotes in logs
PIPE-2073: fix missing nonpbcor_image_min/max
PIPE-2073: add estimation of min/max on non-pb-corr images
PIPE-2073: add nonpbcor_image_min/max to aqua report
PIPE-2073: fix mismatching variable name
PIPE-2073: homogenize pbcor_* naming -
Rui Xue 8f7e5af8b2b8206db7474e72e6dc0dfbd1788d36 m
PIPE-3137: Fix FindCont `skip_stage` parameter to prevent blank `cont.dat`
Apply `skip_stage=True` to `FindContResult` when skipping the
findcontinuum stage in VLA-PI workflows. This prevents creation of
blank `cont.dat` files as documented in PIPE-2255. -
Takeshi Nakazato 92e181225c1b7727ca6d3b3da81a385f26d93dbc m
Pull request #1852: PIPE-3119 process pointing data from all antennas together to detect pointing outliers
Merge in PIPE/pipeline from PIPE-3119-hsd_flagdata-combine-pointing-data-from-all-antennas-to-perform-pointing-outlier-heuristic to main
* commit '0bdc71f51d201836daadb45d6f86b1c94b819536':
PIPE-3119 update debug log messages to be consistent with other ones
PIPE-3119 process pointing data from all antennas together to detect pointing outliers -
Ilsang Yoon f805956896c40f4645b1a07341b9a705c42f4cff m
Pull request #1838: PIPE-3082: Update remove mom8fc score for repBW
Merge in PIPE/pipeline from PIPE-3082-change-hif_makeimages-qa-for-the-repbw-cube-to-ignore-the-mom8fc-qa-sub-score to main
* commit '85b467f703fbe355926316ab01807e76cb12b70d':
PIPE-3082-third-commit-coding-update
PIPE-3082: second commit with the adjusted score proposal(ticket updated)
PIPE-3082: Update remove mom8fc score for repBW -
Ilsang Yoon 3bb4075efba2b89182e9245c645ec87c94773d05 m
Pull request #1855: PIPE-2716: modify applicalQA_outliers.txt with intent and disable QA_mode switch
Merge in PIPE/pipeline from PIPE-2716-hif_applycal-add-calibration-intent-to-applycalqa_outliers.txt-file to main
* commit '0d3364c4425c4e164b04f524d3b99725ed5abe31':
PIPE-2716: Modify `applicalQA_outliers.txt` with intent and disable the "QA_mode" switch (from Ilsang Y.) -
Rui Xue 0d3364c4425c4e164b04f524d3b99725ed5abe31 m
PIPE-2716: Modify `applicalQA_outliers.txt` with intent and disable the "QA_mode" switch (from Ilsang Y.)
-
Ajay Vibhute 86753a8ad9d3f1ccb6bb96a2e18704387def9c42 m
Pull request #1772: PIPE-2952 hif uvcontsub runs for an extremely long time during restore
Merge in PIPE/pipeline from PIPE-2952-hif_uvcontsub-runs-for-an-extremely-long-time-during-restore to main
* commit '778032458bc43a2699686b1ad5686eda38057a70':
PIPE-2952: add comment explaining why makeimlist_inputs.uvrange is set to '>0.0lambda'
PIPE-2952: setting makeimlist_inputs.uvrange to '>0.0lambda'
PIPE-2952: skipping computing uvrange by passing uvrange='' to makeimlist
PIPE-2952: removed heuristics deepcopy
PIPE-2952: minor changes suggested during PR review
PIPE-2952: minor bugfix
PIPE-2952: moved cont_ranges_spwsel method call outside the loop -
Rui Xue 3a4b3b51d02ae9e099bd351dbca6e7e61d0cac76 m
Pull request #1854: PIPE-2486
Merge in PIPE/pipeline from PIPE-2486-add-parameter-for-pipeline-calibration-tasks-to-ignore-a-cont.dat-file-if-present to main
* commit '6e465f73864d80da1a8ed5bc529b80862a240171':
PIPE-2486: Set `usecontdat` parameter to True by default
PIPE-2486: Add `usecontdat` parameter to control `cont.dat` usage for `hifv_statwt` and `hifv_checkflag`. -
Rui Xue 3c80c4335b2b1af4f534e2058217c77c29368a98 m
PIPE-2883: Improve the code clarity for the new representative source selection logic
-
Takeshi Nakazato 0bdc71f51d201836daadb45d6f86b1c94b819536 m
Merge branch 'main' into PIPE-3119-hsd_flagdata-combine-pointing-data-from-all-antennas-to-perform-pointing-outlier-heuristic
-
ilsangyoon <yoonilsang.umass@gmail.com> 85b467f703fbe355926316ab01807e76cb12b70d m
PIPE-3082-third-commit-coding-update
-
Rui Xue 6e465f73864d80da1a8ed5bc529b80862a240171 m
PIPE-2486: Set `usecontdat` parameter to True by default
- pipeline/hifv/cli/hifv_checkflag.py (version 6e465f73864d80da1a8ed5bc529b80862a240171) (diffs)
- pipeline/hifv/cli/hifv_statwt.py (version 6e465f73864d80da1a8ed5bc529b80862a240171) (diffs)
- pipeline/hifv/tasks/flagging/checkflag.py (version 6e465f73864d80da1a8ed5bc529b80862a240171) (diffs)
- pipeline/hifv/tasks/statwt/statwt.py (version 6e465f73864d80da1a8ed5bc529b80862a240171) (diffs)
-
Dirk Muders 9d4c2bcbbfd16363f7fe520c40765f502e8cc243 m
PIPE-2766: Updated findContinuum.py to v9.6.
-
Rui Xue 3ddc2ef8f573ad41a06945a93436cc97420cb69c m
PIPE-3074: Add `imagename_prefix` to cutout and RMS ImageItems
Extend `imagename_prefix` propagation to derived image products (cutouts and RMS images) for consistency with main imaging products. -
Dirk Muders b9f77ee96b6cd57d959982f32d59cd5369281aeb m
PIPE-2766: Updated findContinuum.py to v9.5.
-
Ajay Vibhute 778032458bc43a2699686b1ad5686eda38057a70 m
PIPE-2952: add comment explaining why makeimlist_inputs.uvrange is set to '>0.0lambda'
-
Takeshi Nakazato 2b8839ce79c3ace89f60b2a714e467caa2c18176 m
PIPE-3119 update debug log messages to be consistent with other ones
-
Rui Xue f9ded2cde48b05139f176936511a63f36c8d7a88 m
PIPE-3128: Fix CleanTargetInfo specmode key mismatch for repBW imaging
Use `hm_specmode` instead of `specmode` when constructing `CleanTargetInfo`
keys in `merge_with_context`. For repBW, `specmode` is converted to 'cube'
internally while makeimlist reads back with the user-facing 'repBW'
value, causing clean masks and thresholds from Stokes I imaging to not
be picked up for subsequent IQUV imaging. -
Rui Xue 70de235e659a80cf9287f38eb797aa8a159ce3cb m
PIPE-3074: Propagate `imagename_prefix` through `ImageItem` for per-EB products
Move EB UID handling from inline extraction to `ImageItem` attribute for
cleaner implementation while still allowing proper deduplication of check sources from
different EBs while maintaining PIPE-2465 Stokes filtering logic.- pipeline/h/tasks/exportdata/exportdata.py (version 70de235e659a80cf9287f38eb797aa8a159ce3cb) (diffs)
- pipeline/hif/tasks/makeimages/resultobjects.py (version 70de235e659a80cf9287f38eb797aa8a159ce3cb) (diffs)
- pipeline/infrastructure/imagelibrary.py (version 70de235e659a80cf9287f38eb797aa8a159ce3cb) (diffs)
-
Rui Xue fd408af753a7b53da9827ca798d31942be878c5a m
Pull request #1807: PIPE-3081: Enhance regression test naming and introduce current test name fixture
Merge in PIPE/pipeline from PIPE-3081-make-the-regression-test-working-directory-names-more-intuitive to main
* commit '2f3b86594125839b0b89dbb25aba5086b7b6f19a':
PIPE-3081: Check in `pixi.lock`
PIPE-3081: Enhance regression test naming and introduce current test name fixture -
Rui Xue c646d930f1892a4317b85c61b5f709c933dd99c7 m
Pull request #1840: PIPE-3116: Fix AttributeError in `_SentinelMap` by calling `super().__init__()`
Merge in PIPE/pipeline from PIPE-3116-compatibility-with-mpl-ver3.11 to main
* commit '50e8573651e38f362b17dbccd7e143895db74cc2':
PIPE-3116: Add unit and regression tests for _SentinelMap and _SentinelNorm
PIPE-3116: Fix AttributeError in `_SentinelMap` by calling `super().__init__()` -
Rui Xue 537546f9804712a4ec65c7b1c59fe8b89fa263b9 m
PIPE-2486: Add `usecontdat` parameter to control `cont.dat` usage for `hifv_statwt` and `hifv_checkflag`.
- pipeline/hifv/cli/hifv_checkflag.py (version 537546f9804712a4ec65c7b1c59fe8b89fa263b9) (diffs)
- pipeline/hifv/cli/hifv_statwt.py (version 537546f9804712a4ec65c7b1c59fe8b89fa263b9) (diffs)
- pipeline/hifv/tasks/flagging/checkflag.py (version 537546f9804712a4ec65c7b1c59fe8b89fa263b9) (diffs)
- pipeline/hifv/tasks/statwt/statwt.py (version 537546f9804712a4ec65c7b1c59fe8b89fa263b9) (diffs)
-
Rui Xue 70fef63292f843a271b70ff16aeaa857b9b00541 m
Merge remote-tracking branch 'origin/main' into PIPE-2952-hif_uvcontsub-runs-for-an-extremely-long-time-during-restore
-
Dirk Muders f96aaf600a7c4b71d168412e650b829c022c945a m
PIPE-3057: Fixed contfilehandler test.
-
Luke Maud 5cd6eaf410c6ed506ae8b0ba094de349868b61e7 m
Pull request #1784: PIPE-2858 correct cases where interpolation should use linearpd
Merge in PIPE/pipeline from PIPE-2858-correct-cases-where-interpolation-should-use-linearpd to main
* commit '2e3e82f9f64f7560373a1066f1265f9e750d0b23':
PIPE-2858 modify calapp for b2b offset in hifa_diffgaincal to use lienarPD when spws are combined
PIPE-2858 add linearPD to almaphcorbandpass apply for combine=spw -
Rui Xue 0bc5f8119341f9fe3f11e87027125abc4421de2a m
PIPE-3096: Fix the 'field' name value mismatch in `CleanTargetInfo`
Add a comment in TcleanResult.__init__ noting that inputs.field (the raw
field name string, potentially with quotation marks) was historically
assigned to self.sourcename instead of the value resolved by
get_sourcename(). Revert cleanbase.py to use inputs.field for
TcleanResult construction, log/error messages, and imageheader metadata
to preserve prior behaviour for the ALMA fullpol imaging workflow. -
Rui Xue 0d3105a4e1fbd578d9c878171bd95229d369d955 m
Pull request #1834: PIPE-3094 new mstransform based hanning smoothing breaks backward compatibility of vla restores
Merge in PIPE/pipeline from PIPE-3094-new-mstransform-based-hanning-smoothing-breaks-backward-compatibility-of-vla-restores to main
* commit '1353b188830624daeab9438c0396c7181c27aad9':
PIPE-3094: Fix hanning_test and remove duplicate test with broken mock setup
PIPE-3094: Minior codestyle updates
PIPE-3094: Replace field NAME with PHASE_DIR matching
PIPE-3094: Bump the minimum pytest version and configure tmp_path retention in `pyproject.toml`
PIPE-3094: fix VLA restore backward compat for mstools->mstransform Hanning switching
PIPE-3094: Add the `transfer_flagversion` utility function for post-mstransform flag version remapping -
Rui Xue 77e56105fe4aa3d98971e2d8513ee71ef35291c5 m
PIPE-3003: Make `MstransformResults.output_data_type` optional for VLA compatibility
Fixes TypeError in VLA mstransform by adding default value (None) to
output_data_type parameter in base class constructor. -
Rui Xue 1353b188830624daeab9438c0396c7181c27aad9 m
PIPE-3094: Fix hanning_test and remove duplicate test with broken mock setup
Two tests (test_file_operation_failure_cleanup,
test_recovery_when_original_ms_removed) were near-identical and both
broken: MagicMock(spec=HanningInputs).keep_original returns a truthy
MagicMock, so the shutil.rmtree branch was never taken and the OSError
never raised, making task_successful always True.
Fix: merge into one test, set keep_original=False explicitly, replace
fragile ordered side_effect list with return_value=True. -
Rui Xue 812d0ab5a63ea8d0dc4fe1d163d3306714b3a06f m
PIPE-3094: Minior codestyle updates
-
Rui Xue 79db364d89faf811d35982cd6b4fd6a5c5e0fe86 m
PIPE-3094: Replace field NAME with PHASE_DIR matching
Use phase centre for field ID remapping to handles duplicate names. -
Rui Xue 6454b16ba3ed77cc45a3579c6384a2fdbd9ed46d m
PIPE-3094: Bump the minimum pytest version and configure tmp_path retention in `pyproject.toml`
-
E. G. Patrick Bos <egpbos@gmail.com> 50e8573651e38f362b17dbccd7e143895db74cc2 m
PIPE-3116: Add unit and regression tests for _SentinelMap and _SentinelNorm
-
Takeshi Nakazato 4db916304dd7520a8d75a228fcbf37a7909106f8 m
PIPE-3119 process pointing data from all antennas together to detect pointing outliers
This is to increase the number of valid data and to support the problem reported to PRTSPR-89889. -
Rui Xue e9057547575e1ffea5fc56ec9b643338fa1f2178 m
Pull request #1844: PIPE-3122: Reorder `hif_checkproductsize` stage in `procedure_hifv_calimage_cont_cube.xml`
Merge in PIPE/pipeline from PIPE-3122-wrong-order-of-the-checkproductsize-stages-in-procedure_hifv_calimage_cont_cube.xml to main
* commit 'c9bb23b77d37d0468a8889c5174bfa12512733d7':
PIPE-3122: Reorder `hif_checkproductsize` stage in `procedure_hifv_calimage_cont_cube.xml` -
ilsangyoon <yoonilsang.umass@gmail.com> b99e63b54e8efbc7494e6ea4e9877d727b5a5058 m
PIPE-3026: I updated the score/PIPE-3028: I updated the QA message
-
ilsangyoon <yoonilsang.umass@gmail.com> 9d7b9bc369e14cc176227506129fb497001a8cb6 m
PIPE-3082: second commit with the adjusted score proposal(ticket updated)
-
ilsangyoon <yoonilsang.umass@gmail.com> 9b70ce19197e30b21ab5a527cebcc0e221f66e26 m
PIPE-3042: second commit after the code reviewer's feedback
-
Dirk Muders 1d84cc3bc4371186195c5eddda8e4b5f48d63c50 m
Merge remote-tracking branch 'origin/main' into PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames
-
Hajime Ezawa f6217dd637ac3b89ca49b7963c0740019dd712ac m
Pull request #1833: PIPE-3104 hsd imaging aggregate qa message from the same metric with the same score
Merge in PIPE/pipeline from PIPE-3104-hsd_imaging-aggregate-qa-message-from-the-same-metric-with-the-same-score to main
* commit '7bb7f1e37c4c35f941f2e200d0629f050a2fb5e6':
PIPE-3104: revert the longmsg-s to orignal
PIPE-3104: introduced groups of QAScores to improve the code
PIPE-3104: fix typos and careless errors
PIPE-3104: correct minor typo found by chance
PIPE-3104: accommodate NRO cases with both I, XXYY images
PIPE-3104: further modification to QA messages of SingleDishImageMaskedPixels
PIPE-3104: rephrase QA messages for ''SingleDishImageMaskedPixels' and add TargetDataSelection for aggregation
PIPE-3104: include 'score_rasterscan_correctness'
PIPE-3104: skip if non of the keys of 'keys_to_aggregate' exist in target_qascore
PIPE-3104: aggregate and format QA messages in hsd_imaging
PIPE-3104: inhibit formatting if everything associated with longmsg_keys are empty
PIPE-3104: show field-name instead of field-id to QA messages -
Rui Xue c9bb23b77d37d0468a8889c5174bfa12512733d7 m
PIPE-3122: Reorder `hif_checkproductsize` stage in `procedure_hifv_calimage_cont_cube.xml`
-
Rui Xue 000e93fae6284893a3191b4c308a398ed2647d64 m
PIPE-2883: Improve representative target selection robustness
Modify `imageparams_vla.py` `representative_target()` method to iterate
through available target sources and select the first one with at
least 5% unflagged data in any spectral window, instead of blindly
using the first source which might be completely flagged.
Add per-source flagdata analysis with logging to track unflagged
fractions by spectral window. Raise exception if no suitable source
meets the minimum threshold, preventing downstream failures. -
Hajime Ezawa 7bb7f1e37c4c35f941f2e200d0629f050a2fb5e6 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3104-hsd_imaging-aggregate-qa-message-from-the-same-metric-with-the-same-score
-
Cristian Marocico cc8888b38f4f5c2a06605d8f17d0dd268353bbf8 m
Pull request #1817: PIPE-2956 add examineCrossPolSum boolean parameter
Merge in PIPE/pipeline from PIPE-2956-add-examineCrossPolSum-boolean-parameter to main
* commit '385dfd47b48a60eeab787055a5aaddcbc90c07b8':
Re-reverted changes to .readthedocs.yaml
Refactored some tests
Reverted changes to .readthedocs.yaml
PIPE-2956: add focused tests for cross-pol opt-in behavior
PIPE-2956: add examineCrossPolSum cross-pol flagging control -
Luke Maud 68b73a438d0491c28627dabe9f820cd1d1d611cc m
Pull request #1750: PIPE-2601 for alma data make hif lowgainflag use hifa bandpass almaphcorbandpass bandpass code
Merge in PIPE/pipeline from PIPE-2601-for-alma-data-make-hif_lowgainflag-use-hifa_bandpass-almaphcorbandpass-bandpass-code to main
* commit '0120946c52d52dd9fa40e464b154c73e44185cac':
PIPE-2601 minor format change in _get_prebandpass_params
PIPE-2601: Fix UnboundLocalError and style issues in lowgainflag
PIPE-2601: Use the domain object to identify the array name and avoid holding `MSMDReader` open while executing long CASA tasks
PIPE-2601: refactor the code to have methods for the bandpass, phaseup and ampcal
PIPE-2601 modification of the bandpass worker task to use SerialALMAPhcorBandpass and to propagate solint and combine into gaincal phaseup -
Rui Xue 068a036c8aed5f0ed09ffaa1ea2af03b0151f8ab m
PIPE-3116: Fix AttributeError in `_SentinelMap` by calling `super().__init__()`
Replace manual attribute assignments (name, N) with a proper
`super().__init__()` call so that Colormap-managed attributes such
as n_variates are initialised correctly for newer matplotlib versions. -
Takeshi Nakazato dda05e52fee65eae040dbe14e615799b70141b12 m
Pull request #1829: PIPE-3092 hsd imaging ignore edge channels and channels overlapped with atm lines while examining qa
Merge in PIPE/pipeline from PIPE-3092-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa to main
* commit '8feba8c2c72a7838a2f2b661d86164b48bc98141':
add supplementary comment
PIPE-3092 define dedicated attributes instead of using results object
PIPE-3092 replace convert_range_list_to_ranges with equivalent manipulation using numpy
PIPE-3092 rename "edge_channels" as "extra_edge_channels"
PIPE-3092 documentation update
PIPE-3092 bug fix on trimming edge channels
PIPE-3092 exclude edge channels and ATM lines from line-free regions in missed line analysis -
Rui Xue 2213c13d4947ae79e03131c60010b9237f855dc4 m
Pull request #1839: PIPE-3115: Fix TsysData regex to support non-uid measurement set names
Merge in PIPE/pipeline from PIPE-3115-hifa_tsysflagcontamination-crashes-if-the-measurement-doesn-t-begin-with-uid to main
* commit '1d3b06ecff87c7b5667a5ddd3a3514bf0cd7d5e9':
PIPE-3115: Fix TsysData regex to support non-uid measurement set names -
Rui Xue 1d3b06ecff87c7b5667a5ddd3a3514bf0cd7d5e9 m
PIPE-3115: Fix TsysData regex to support non-uid measurement set names
-
Ajay Vibhute 3a9cb9c9ee040c44269dc3dfe2c660ef3cf5f22f m
Pull request #1694: PIPE-2512: Enable adaptive bandpass spectral solint for the VLA pipeline
Merge in PIPE/pipeline from PIPE-2512-enable-adaptive-bandpass-spectral-solint-for-the-vla-pipeline to main
* commit 'd6935f7a7f85827be7b35fdf765d9637f342708a':
PIPE-2512: renamed score3 to score4
PIPE-2512: update spw_solint initialization in result class
PIPE-2512: Changes suggested in PR review
PIPE-2512: adding QA score for solint per spw
PIPE-2512: update solint value
PIPE-2512: minor changes suggested in PR review
PIPE-2512: minor bugfix
PIPE-2512: minor changes suggested during PR review
PIPE-2512: using flags while computing the median SNR
PIPE-2512: minor changes suggested in PR review
PIPE-2512: code cleanup
PIPE-2512: backed up caltable with timestamp
PIPE-2512: re-run the low-SNR SPWs individually with smoothing -
Takeshi Nakazato 8feba8c2c72a7838a2f2b661d86164b48bc98141 m
Merge branch 'main' into PIPE-3092-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
ilsangyoon <yoonilsang.umass@gmail.com> 201c11233c9a4baf25915999d84a1c3db5b8bda9 m
PIPE-3082: Update remove mom8fc score for repBW
-
Rui Xue 06b38a34285e2b7e3034285bab927aa85ac2015e m
Pull request #1830: PIPE-3099: Fix MPI race condition in flux.csv concurrent access
Merge in PIPE/pipeline from PIPE-3099-in-rare-condition-open_with_lock-might-release-lock-before-write-actually-flush-to-storage to main
* commit 'f6fa562cca9f96ad98d7e26ac407cdf48eb7eba5':
PIPE-3099: Fix MPI race condition in flux.csv concurrent access -
Hajime Ezawa bb057dfe28d03dcdc6c79737ff31c8bc057dd385 m
PIPE-3104: revert the longmsg-s to orignal
-
Takeshi Nakazato 50a50c8c90687678f5a4b1397f602cd636ab872c m
add supplementary comment
-
Ilsang Yoon c510e2e4f64fde66058cd33bf807f6d536420d11 m
Pull request #1828: PIPE-3037: Changed upper and lower threshold parameter for score
Merge in PIPE/pipeline from PIPE-3037-change-newly-flagged-qa-score-for-hif_applycal to main
* commit '9aa8f21df25a7564190c77409285e2ee6c8b9efa':
PIPE-3037: Changed upper and lower threshold parameter for score -
Ilsang Yoon 7080a548b83c58227dc8259cd9baf54326b86804 m
Pull request #1827: PIPE-3036: Changed upper and lower parameter for score
Merge in PIPE/pipeline from PIPE-3036-change-qa-score-for-flagged-in-hifa_flagdata to main
* commit '4fac328b35448605917831e1733529831f1f1504':
PIPE-3036: Changed upper and lower parameter for score -
ilsangyoon <yoonilsang.umass@gmail.com> 7ae0f9d6baeccd32c2b9321d0fc1e5063cd6cbea m
PIPE-3042: updating QA score
-
Takeshi Nakazato 5990f5505187812a38f0d5417f4adb38f2c6bde8 m
PIPE-3092 define dedicated attributes instead of using results object
-
Takeshi Nakazato 6165d05cab0feb068f9aa9feac447b67754e524e m
PIPE-3092 replace convert_range_list_to_ranges with equivalent manipulation using numpy
-
Hajime Ezawa 882948299a8c14386dff6dcb49984fdc0125fa5a m
PIPE-3104: introduced groups of QAScores to improve the code
-
Hajime Ezawa b8695b2123d1523daeeb356e5b896b577f3766d6 m
PIPE-3104: fix typos and careless errors
-
Hajime Ezawa b86144db2438157591387d847d425f73119cd365 m
PIPE-3104: correct minor typo found by chance
-
Hajime Ezawa 55975d3aeb4ab9e5ade10d93958297fa873ed798 m
PIPE-3104: accommodate NRO cases with both I, XXYY images
-
Hajime Ezawa ff233ce0559eb171897a183c4183b625de3984c5 m
PIPE-3104: further modification to QA messages of SingleDishImageMaskedPixels
-
Hajime Ezawa f50f876d2a25bb62475159eebb5237704464ca43 m
PIPE-3104: rephrase QA messages for ''SingleDishImageMaskedPixels' and add TargetDataSelection for aggregation
-
Hajime Ezawa e01f53fc1278cbf6a4754eee145795fcf2d849f4 m
PIPE-3104: include 'score_rasterscan_correctness'
-
Hajime Ezawa b6ffba94b8be85dad3885a968e4a936293a5bf6a m
PIPE-3104: skip if non of the keys of 'keys_to_aggregate' exist in target_qascore
-
Rui Xue 8bc8738723a1cd03d60829faa6b0e458de0a8918 m
PIPE-3094: fix VLA restore backward compat for mstools->mstransform Hanning switching
Add keep_original parameter to hifv_hanning so the original MS is
preserved (as <vis>.original) when needed by the restore path.
In VLARestoreData.prepare(), detect MSes that were originally
Hanning-smoothed via the deprecated mstools (partial SPW subset,
pipeline ver < 2026.1.1.3); re-smooth them using the Hanning task
(mstransform-based) instead. In _do_restore_flags(), remap the
extracted flagversions from the original row order to the new
mstransform row order before restoring with flagmanager, then clean
up the .original MS and flagversions. -
Rui Xue eda5c66528cf0b0959bf8cc6a79f864b6730d25c m
PIPE-3094: Add the `transfer_flagversion` utility function for post-mstransform flag version remapping
Remaps every flags.* table in source_flagversions so it can be restored
onto a transformed MS (Hanning smoothing, spw/field selection, etc.).
Row matching uses structured-array sort + searchsorted on (DDID, FIELD_ID,
ANTENNA1, ANTENNA2, TIME). remap_ids=True additionally translates
post-mstransform DDIDs and field IDs back to source numbering via
REF_FREQUENCY and field NAME matching. Permutation is applied via
selectrows(perm).copy(), which preserves per-row FLAG shapes and avoids
TiledShapeStMan shape conflicts. Identity permutations use copytree.
Three tests covering identity, row-reorder (VLA Hanning), and
spw+field-selection (remap_ids=True) cases.- pipeline/infrastructure/utils/__init__.py (version eda5c66528cf0b0959bf8cc6a79f864b6730d25c) (diffs)
- pipeline/infrastructure/utils/flagversion_tools.py (version eda5c66528cf0b0959bf8cc6a79f864b6730d25c) (diffs)
- pipeline/infrastructure/utils/flagversion_tools_test.py (version eda5c66528cf0b0959bf8cc6a79f864b6730d25c) (diffs)
-
Hajime Ezawa 70df280fd1b8c720874059d88077e3235ce1fc53 m
PIPE-3104: aggregate and format QA messages in hsd_imaging
-
Hajime Ezawa 190961428d5832acc525cf816861c3c37870c08c m
PIPE-3104: inhibit formatting if everything associated with longmsg_keys are empty
-
Dirk Muders 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651 m
PIPE-3057/PIPE-3053: Changed all "_topo" methods and variable names to "_ms_frame". Changed advisechansel calls to use the MS native frequency frame as desired frame to convert to.
- pipeline/hif/heuristics/imageparams_base.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_single_epoch_continuum.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/hif/tasks/makeimlist/cleantarget.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/hif/tasks/uvcontsub/renderer.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/hif/tasks/uvcontsub/uvcontsub.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/hif/templates/uvcontsub.mako (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/infrastructure/contfilehandler.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
- pipeline/infrastructure/contfilehandler_test.py (version 4bb5f121b78a8dd6d77b7f8be3aaff61bd058651) (diffs)
-
Takeshi Nakazato 7b6ed11fe0d40a1e5a88cbbd8166bccb64cf8e3d m
Pull request #1808: PIPE-2959 / PIPE-2964 hsd_baseline use 75 quantile as a representative line width of the detected cluster & take into account flagged edge channels
Merge in PIPE/pipeline from PIPE-2964-hsd_baseline-use-75-quantile-as-a-representative-line-width-of-the-detected-cluster to main
* commit '2ac046968e0a967aa527bda4a46466a7a310ab24':
PIPE-2959/PIPE-2964 refactoring
PIPE-2959/PIPE-2964 avoid hard-coded value
Inherit function attributes (docstrings, type annotations, etc.) from wrapped function
Improve type annotation
PIPE-2959/PIPE-2964 tweak comments
PIPE-2959/PIPE-2964 remove context from the arg for score_sd_line_detection
PIPE-2959/PIPE-2964 use channelmap_range for wide line/edge line/deviation mask QA evaluation
PIPE-2959/PIPE-2964 Check *actual* flag status to obtain flagged edge channels
import numpy as np
adjust the formatting of log message
improvement of log message
fix bug in resolving conflict
Updated edge channel QA to take into account edge channels flagged by edgespw heuristic in hsd_flagdata stage
additional change for clustering property plot
import numpy as np
replace representative line with 75% percentile
remove set_data method
PIPE-2964 use 75% percentile value as representative line width -
Takeshi Nakazato c13a6419bdb0d5b463020eb1099258af447d3fdc m
Pull request #1785: PIPE-3047 update hsd_imaging weblog around diagnostic plots for missed-lines
Merge in PIPE/pipeline from PIPE-3047-has_imaging-add-explanation-on-the-diagnostic-plots-for-possible-missed-line-channels to main
* commit 'bb060d44cc1015483162882f44f0a83d7056bc97':
PIPE-3047 further refinement of html text
PIPE-3047 update of weblog paragraph
PIPE-3047 update hsd_imaging weblog around diagnostic plots for missed-lines -
Hajime Ezawa c6b952a30d1ee8f2a6f57ba5623399d2387d2224 m
PIPE-3104: show field-name instead of field-id to QA messages
-
Hajime Ezawa 94dfcbc32d7ca19acfa90b0c04ca9786ec6ab1d7 m
Pull request #1803: PIPE-3054 hsd baseline aggregate qa message from the same metric with the same score
Merge in PIPE/pipeline from PIPE-3054-hsd_baseline-aggregate-qa-message-from-the-same-metric-with-the-same-score to main
* commit '7510e8781a4261a2642b2d3a177b20a302e79429':
PIPE-3054: supplement missing type annotation, docstring fix
PIPE-3054: remove an unused line
PIPE-3054: turn off preserve_original for the default behavior of QAScoreAggregator
PIPE-3054: slight change to improve the readability of QAScoreAggregator._aggregate_qascores()
PIPE-3054: improve additional style issues
PIPE-3054: improve style issues
PIPE-3054: correct type annotations
PIPE-3054: typo corrections
PIPE-3054: resolve the conflicts with main
PIPE-3054: added condition (shortmsg) to match QA scores
PIPE-3054: improve aggregation logic to accommodate custom key_list, separate class for formatter, implemented registry to consolidate aggregator/formatter properties
PIPE-3054: limit the aggregation to weblog accordion only
PIPE-3054: added condition to match the metric_unit
PIPE-3054: aggregate QA scores of hsd_baseline stage
PIPE-3054: class to aggregate single-dish QA scores -
Takeshi Nakazato bb060d44cc1015483162882f44f0a83d7056bc97 m
Merge remote-tracking branch 'origin' into PIPE-3047-has_imaging-add-explanation-on-the-diagnostic-plots-for-possible-missed-line-channels
-
Takeshi Nakazato 21ac244ddbbb1f4427d2cabff49f59e4463582a6 m
PIPE-3047 further refinement of html text
-
Ajay Vibhute 9a0b7311f53cdd63b58bda4f75837b66e365970a m
PIPE-2952: setting makeimlist_inputs.uvrange to '>0.0lambda'
-
Rui Xue 2c4f668882b0d30aa77124d4b3da68f29a0a6210 m
Pull request #1799: PIPE-2644: Add Python, library versions, platform tag, and GPU info to weblog environment page
Merge in PIPE/pipeline from PIPE-2644-add-python-3rd-part-library-version-info-into-weblog-environment-splash-page-optionally to main
* commit '00730539a125753e2f2d9fa8fb9419176c928f85':
PIPE-2644: Hide GPU info from weblog when unavailable and optimize GPU detection
PIPE-2644: Fix code review issues in `environment.py` and `htmlrenderer.py`
PIPE-2644: Add pull request template for PR submissions
PIPE-2644: Add GPU information to the weblog environment page
PIPE-2644: Add Python/library versions and platform tag to weblog env page -
Luke Maud 0120946c52d52dd9fa40e464b154c73e44185cac m
PIPE-2601 minor format change in _get_prebandpass_params