Build: #2 was successful
Job: Pipeline PR Test 6.7.4 was successful
Code commits
Pipeline
-
Takeshi Nakazato bb5ad0f55ceccf59a71c502b1bb9986752e75ab6
Merge branch 'main' into PIPE-3092-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
Takeshi Nakazato 7abba55d5e8d8c9eb3b43ca826c1f043be86ada5
PIPE-3092 rename "edge_channels" as "extra_edge_channels"
-
Takeshi Nakazato b69296d978ee1ee78319ebf8fa4e4a084562d8aa
PIPE-3092 documentation update
-
Luca Di Mascolo 9d8c39e305acfb512165e394656644d8ca19d1c5 m
Pull request #1780: PIPE-2274: avoid post-imaging exportdata flag version overwrite
Merge in PIPE/pipeline from PIPE-2274-hifa_exportdata-at-end-of-imaging-is-attempting-to-overwrite-pipeline_final-flag-version to main
* commit '1bc3d0edf3825efa22f11bcea0a500458d391c15':
PIPE-2274: fix missing check on flag dictionary
PIPE-2274: switch to flagmanager(mode='list') to check for pipeline_final flag
PIPE-2274: apply max-*-len formatting + general linting
PIPE-2274: fix linting errors (F841)
PIPE-2274: fix linting errors (E722)
PIPE-2274: fix linting errors (E702)
PIPE-2274: fix linting errors (D1xx/D2xx/D4xx)
PIPE-2274: fix linting errors (I001)
PIPE-2274: apply linting to edited function
PIPE-2274: minor fixes
PIPE-2274: save Pipeline_Final.old.timestamp without raising warning
PIPE-2274: revert inclusion of custom flag_version_name as exportdata argument
PIPE-2274: overwrite final flag and allow for custom flag name
PIPE-2274: add flag_version_name as input parameter
PIPE-2274: directly use any() generator expression
PIPE-2274: use Pipeline_Final_PreImaging for calibration only final flag version -
Ryan Loomis 09195b4d89d69bc366a67a4e26c3cf254711efd9 m
Pull request #1823: PIPE-3090: Fix duplicated virtual SPWs in imageprecheck
Merge in PIPE/pipeline from demo-PIPE-3090-fix-duplicated-spws-for-aggBW-in-imageprecheck to main
* commit 'cc68f2b88490a5b4f2233c45fddded067b7c8a46':
PIPE-3090: Filter intents in imageparams_base SPW checks
PIPE-3090: Precompute virtual spw lookup in imageprecheck
PIPE-3090: Filter target SPWs in imageprecheck
PIPE-3090: Fix duplicated virtual SPWs in imageprecheck -
Cristian Marocico 39725b55d666a5a0a87945f15db3bdec9cf098e3 m
Pull request #1795: PIPE-117 resolution columns
Merge in PIPE/pipeline from PIPE-117-resolution-columns to main
* commit '2c5f4f25862012ba0200152738b2e093dd285771':
Added a "Spectra" meta-column
Changed c from float to int to allow multiplication with Decimal
Removed ALMA-only restrictive condition
Replaced hard-coded value of c with constant
Fixed new column placement in HTML template
PIPE-117: Add C.M, L.D.M, and P.B. to the Contributors list
Make chan_resolutions a public attribute on SpectralWindow
Implemented resolution columns for Spectral Setup Details -
Rui Xue 8d5e59df9e4b3b0ddf0ac690ed8c455bf5c4693d m
Pull request #1825: PIPE-2947: Improve `_savgol_filter_nan` to pad NaNs around masked regions
Merge in PIPE/pipeline from PIPE-2947-savgol-filter-nan-version2 to main
* commit '1364dd8064999cc14aa5c71df7c178e6dc5928a2':
PIPE-2947: Make `_savgol_filter_nan` signature compatible with `savgol_filter`
PIPE-2947: Improve _savgol_filter_nan to pad NaNs around masked regions -
Ajay Vibhute 747bb8a04857939de9920a68106747c212a783c8 m
Pull request #1664: PIPE-2582: updated QA criteria for semiFinalBPdcals
Merge in PIPE/pipeline from PIPE-2582-hifv_semifinalbpdcals-qa-criteria to main
* commit '9b09ac10aa3c105cbc95aee66acc0e6dfab10eaf':
PIPE-2582: Changes suggested in PR review
PIPE-2582: present warning if spw is fully flagged, or mulitple antennas are fully flagged
PIPE-2582: Skipping the spectral line SPW fully flagged warning if the offending antenna is fully flagged
PIPE-2582: passing set(vis) to applies_to
PIPE-2582: added flaggedSolnApplycaldelay dictionary is structured, and other minior changes suggested during the PR review
PIPE-2582: minor changes suggested during PR review
PIPE-2582: minor bugfix
PIPE-2582: updated QA messages
PIPE-2582: maxout delay to 0.3
PIPE-2582: removed join from warning
PIPE-2582: added applies_to to QAScore
PIPE-2582: showing warning for fully flagged spw if it is spectral line spw
PIPE-2582: updated QA criteria -
Rui Xue 058d8aeea34d9aecc6b4a6a172339e1e4dea7d4a m
Pull request #1810: PIPE-3085: reduce MS open calls
Merge in PIPE/pipeline from PIPE-3085-improve-the-freq-frame--chan-conversion-speed-within-fluxcalflag to main
* commit 'ad315c171f1d6b940df0fe50f4c392b23effb04e':
PIPE-3085: Replace singleton ms tool with MSReader; add type hints
PIPE-3085: Extend MS open optimization to `correctedampflag`, `rawflagchans`, `gcorfluxscale`
PIPE-3085: Reduce MS open overhead in `hif_applycal` weblog rendering
PIPE-3085: hifa_fluxcalflag - cache SPW freq grids and use searchsorted in _get_chanrange -
Rui Xue ad315c171f1d6b940df0fe50f4c392b23effb04e m
PIPE-3085: Replace singleton ms tool with MSReader; add type hints
-
ryanaloomis <ryan.a.loomis@gmail.com> cc68f2b88490a5b4f2233c45fddded067b7c8a46 m
PIPE-3090: Filter intents in imageparams_base SPW checks
-
ryanaloomis <ryan.a.loomis@gmail.com> afb4719443fdb4dc52b919aac9f6021cb6490aca m
PIPE-3090: Precompute virtual spw lookup in imageprecheck
-
Rui Xue 1364dd8064999cc14aa5c71df7c178e6dc5928a2 m
PIPE-2947: Make `_savgol_filter_nan` signature compatible with `savgol_filter`
Promote `polyorder` from **kwargs to an explicit parameter, matching
savgol_filter's positional signature. Update call site keyword order
to reflect the new signature. -
Ajay Vibhute 9b09ac10aa3c105cbc95aee66acc0e6dfab10eaf m
PIPE-2582: Changes suggested in PR review
-
Cristian A. Marocico <c.a.marocico@gmail.com> 2c5f4f25862012ba0200152738b2e093dd285771 m
Added a "Spectra" meta-column
-
ryanaloomis <ryan.a.loomis@gmail.com> 51e930b30e083ad2957fed005969abd8dfb29011 m
PIPE-3090: Filter target SPWs in imageprecheck
-
Cristian A. Marocico <c.a.marocico@gmail.com> 7de1c70611fd54f5886f214d20e595b8d2ccc212 m
Changed c from float to int to allow multiplication with Decimal
-
Cristian A. Marocico <c.a.marocico@gmail.com> 506756f7568ff5cf48b3ddb5088a4151fb5352d4 m
Removed ALMA-only restrictive condition
-
Cristian A. Marocico <c.a.marocico@gmail.com> 1f48794c9a00272113abd1dc5ba215ec8325c88f m
Replaced hard-coded value of c with constant
-
Cristian A. Marocico <c.a.marocico@gmail.com> 5265546c06aa37fe4d7d08735f365f4d4f560ff1 m
Fixed new column placement in HTML template
-
Luca Di Mascolo <lucadimascolo@gmail.com> 1bc3d0edf3825efa22f11bcea0a500458d391c15 m
PIPE-2274: fix missing check on flag dictionary
-
Luca Di Mascolo <lucadimascolo@gmail.com> 7855be0690d4cfbc1af9771cd70c091167b1fb3b m
PIPE-2274: switch to flagmanager(mode='list') to check for pipeline_final flag
-
Rui Xue 0b088c3f601e59c0ea90e9ff1b8640b6e4bb00b4 m
PIPE-2947: Improve _savgol_filter_nan to pad NaNs around masked regions
-
Rui Xue 454b91e80c6962a09f89ae57b094da0fbc1bbc61 m
PIPE-3085: Extend MS open optimization to `correctedampflag`, `rawflagchans`, `gcorfluxscale`
Hoist casa_tools.MSReader outside the inner loops in three additional
tasks, following the same pattern established for hif_applycal weblog
rendering:
- hif_correctedampflag: open once for the intent × field × spw loop
in _run_flagging_iteration; thread ms_handle through
_evaluate_heuristic → _evaluate_heuristic_for_baseline_set →
mstools.read_channel_averaged_data_from_ms.
- hif_rawflagchans: open once for the spw loop in
RawflagchansData.prepare; call openms.reset() between iterations
instead of opening a fresh handle per SPW.
- hifa_gfluxscale: open once for the field × spw loop in
_derive_calvis_flux; pass ms_handle to mstools.compute_mean_flux.
Also: bare except: → except Exception:, lazy % log formatting.- pipeline/hif/tasks/correctedampflag/correctedampflag.py (version 454b91e80c6962a09f89ae57b094da0fbc1bbc61) (diffs)
- pipeline/hif/tasks/rawflagchans/rawflagchans.py (version 454b91e80c6962a09f89ae57b094da0fbc1bbc61) (diffs)
- pipeline/hifa/tasks/fluxscale/gcorfluxscale.py (version 454b91e80c6962a09f89ae57b094da0fbc1bbc61) (diffs)
-
ryanaloomis <ryan.a.loomis@gmail.com> 44e11c0ce4cda86edbce46bae52740d4e4648622 m
PIPE-3090: Fix duplicated virtual SPWs in imageprecheck
-
Rui Xue 7673073843ca00326b758194ef083e23c7573149 m
PIPE-3085: Reduce MS open overhead in `hif_applycal` weblog rendering
Reduce the cost of opening measurement sets in get_brightest_field()
by reusing a single MS handle across all (field, spw) iterations instead
of opening and closing the MS once per combination. On lazy-import data
sets, where the DATA column is ASDM-backed, this cuts the applycal
post-processing time significantly (observed ~50 min saving on a
2496-call dataset).
- renderer.py: open MS once with casa_tools.MSReader and pass handle
down to mstools.compute_mean_flux via the new ms_handle kwarg.
- mstools.py: add keyword-only ms_handle parameter to both
read_channel_averaged_data_from_ms and compute_mean_flux; call
openms.reset() before each reuse to clear prior selection state. -
Ajay Vibhute 459606c4ccc5b35ee3efca1182991f72dc41d584 m
PIPE-2582: present warning if spw is fully flagged, or mulitple antennas are fully flagged
-
Rui Xue 50fed352aa45cc77be74ca0dc00d3c028d594bfc m
PIPE-3085: hifa_fluxcalflag - cache SPW freq grids and use searchsorted in _get_chanrange
Open the MS once per prepare() call instead of once per line candidate,
and cache the cvelfreqs result per (vis, fieldid, spwid, refframe) via a
new _get_spw_freqs helper. Replace the O(N) linear channel scan with
np.searchsorted for O(log N) boundary lookup. Also convert %-style LOG
calls to lazy-format style and raise ValueError instead of Exception. -
Ajay Vibhute 84c7162aa601647985e19da0c1ee23fbaf607fcb m
PIPE-2582:resolved conflicts
-
Luca Di Mascolo <lucadimascolo@gmail.com> 6420cd94ae351f72f8af73a0c4d46a6ef1b07791 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-2274-hifa_exportdata-at-end-of-imaging-is-attempting-to-overwrite-pipeline_final-flag-version
-
Luca Di Mascolo <lucadimascolo@gmail.com> d3c7e299c61a2ce8ddb762b7c7cba4142edb2a22 m
PIPE-2274: apply max-*-len formatting + general linting
-
Luca Di Mascolo <lucadimascolo@gmail.com> a5180dce53213a16c84c2a53038af51d1d18b465 m
PIPE-2274: fix linting errors (F841)
-
Luca Di Mascolo <lucadimascolo@gmail.com> abff7bbe2a2508cd0694049c768c8ff83f8501ad m
PIPE-2274: fix linting errors (E722)
-
Luca Di Mascolo <lucadimascolo@gmail.com> db7bae978919f176ef82ff3d0343e36cb9862a18 m
PIPE-2274: fix linting errors (E702)
-
Luca Di Mascolo <lucadimascolo@gmail.com> 897b7fa6053f61b144b8630745fdf41558b50d60 m
PIPE-2274: fix linting errors (D1xx/D2xx/D4xx)
-
Luca Di Mascolo <lucadimascolo@gmail.com> ce97ec509bf7e8d71ef2ba017849f334c0a46dbf m
PIPE-2274: fix linting errors (I001)
-
Luca Di Mascolo <lucadimascolo@gmail.com> 1d9947eccb15a9df0f7831418008a7e9906b5075 m
PIPE-2274: apply linting to edited function
-
Rui Xue dded1146b55bd55c7a70a88ab02ac1e8ba537f2c m
PIPE-117: Add C.M, L.D.M, and P.B. to the Contributors list
-
Luca Di Mascolo <lucadimascolo@gmail.com> 59804525c95c64d4c69013a32882ed4a1c1fe8bc m
PIPE-2274: minor fixes
-
Luca Di Mascolo <lucadimascolo@gmail.com> 36efcbf9868657b31d636366fd60073370f75a77 m
PIPE-2274: save Pipeline_Final.old.timestamp without raising warning
-
Luca Di Mascolo <lucadimascolo@gmail.com> 57781cce258ac942fba203f0cb0b8da06b76b028 m
PIPE-2274: revert inclusion of custom flag_version_name as exportdata argument
This reverts commit f9a94849107c1693ad00fbbd4f3e4fca2ca522e8.- pipeline/h/cli/h_exportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/h/tasks/exportdata/exportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/hifa/cli/hifa_exportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/hifa/tasks/exportdata/almaexportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/hifv/cli/hifv_exportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/hifv/tasks/exportdata/vlaexportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/hsd/cli/hsd_exportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
- pipeline/hsdn/cli/hsdn_exportdata.py (version 57781cce258ac942fba203f0cb0b8da06b76b028) (diffs)
-
Luca Di Mascolo <lucadimascolo@gmail.com> 96506b3e63b0220f3007d83f1cc8c2293c26987f m
PIPE-2274: overwrite final flag and allow for custom flag name
-
Luca Di Mascolo <lucadimascolo@gmail.com> f9a94849107c1693ad00fbbd4f3e4fca2ca522e8 m
PIPE-2274: add flag_version_name as input parameter
- pipeline/h/cli/h_exportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
- pipeline/hifa/cli/hifa_exportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
- pipeline/hifa/tasks/exportdata/almaexportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
- pipeline/hifv/cli/hifv_exportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
- pipeline/hifv/tasks/exportdata/vlaexportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
- pipeline/hsd/cli/hsd_exportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
- pipeline/hsdn/cli/hsdn_exportdata.py (version f9a94849107c1693ad00fbbd4f3e4fca2ca522e8) (diffs)
-
Luca Di Mascolo <lucadimascolo@gmail.com> 2e5b87b40cce8fff6affb16ac4b68e7c7fa9bf30 m
PIPE-2274: directly use any() generator expression
-
Luca Di Mascolo <lucadimascolo@gmail.com> d6a0a60f8944700c9b62eef6ffa044c74092695d m
PIPE-2274: use Pipeline_Final_PreImaging for calibration only final flag version
-
Ajay Vibhute 4924cce99f2cb4b2738733a344217544d0689319 m
PIPE-2582: Skipping the spectral line SPW fully flagged warning if the offending antenna is fully flagged
-
Luca Di Mascolo <lucadimascolo@gmail.com> b1cf9e71c16fd9417de90d04f40940c7fca286d4 m
Make chan_resolutions a public attribute on SpectralWindow
-
Cristian A. Marocico <c.a.marocico@gmail.com> 9db0f143743bbaac94df1fa42abf5e21065a744a m
Implemented resolution columns for Spectral Setup Details
- pipeline/domain/spectralwindow.py (version 9db0f143743bbaac94df1fa42abf5e21065a744a) (diffs)
- pipeline/domain/spectralwindow_test.py (version 9db0f143743bbaac94df1fa42abf5e21065a744a) (diffs)
- pipeline/infrastructure/renderer/templates/t2-2-2.mako (version 9db0f143743bbaac94df1fa42abf5e21065a744a) (diffs)
- pipeline/infrastructure/tablereader.py (version 9db0f143743bbaac94df1fa42abf5e21065a744a) (diffs)
-
Ajay Vibhute 9023c84111ddd299655ca0371ef70d5e2e383437 m
PIPE-2582: passing set(vis) to applies_to
-
Ajay Vibhute 212a90b6dda94749827bf763351ba4c42eed5f70 m
PIPE-2582: added flaggedSolnApplycaldelay dictionary is structured, and other minior changes suggested during the PR review
-
Ajay Vibhute 8019a66f764d3376aad213e2454412254af1212e m
PIPE-2582: minor changes suggested during PR review
-
Ajay Vibhute 7bf027a8e219e5a5e4118e1c616115c0af162920 m
PIPE-2582: fixed merge conflicts
-
Ajay Vibhute c872ea103cef2ebe7eb876349ee08bffbfd37743 m
PIPE-2582: minor bugfix
-
Ajay Vibhute c4bab099de43a1479b721b8c48265efa6e723a84 m
PIPE-2582: updated QA messages
- pipeline/hifv/tasks/finalcals/qa.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
- pipeline/hifv/tasks/semiFinalBPdcals/qa.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
- pipeline/hifv/tasks/testBPdcals/qa.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
- pipeline/qa/scorecalculator.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
-
Ajay Vibhute 483e05f3203979dc3ee4615d2c7b9fd50ccdb3da m
PIPE-2582: maxout delay to 0.3
-
Ajay Vibhute 4880b2d93500d1fda39156ec51f0a623732e52f0 m
PIPE-2582: removed join from warning
-
Ajay Vibhute 6752dae07d45e73cbbaaf7c3495bda1870a83167 m
PIPE-2582: added applies_to to QAScore
-
Ajay Vibhute e8ca21c269fdc7f82f070d3d71adc316d3137b39 m
PIPE-2582: showing warning for fully flagged spw if it is spectral line spw
-
Ajay Vibhute a9c4fc9037a81e99d582d0f9d6752c8a0e8db470 m
PIPE-2582: updated QA criteria