Build: #11 was successful
Job: Pipeline PR Test 6.7.4 was successful
Code commits
Pipeline
-
Ajay Vibhute d6935f7a7f85827be7b35fdf765d9637f342708a
PIPE-2512: renamed score3 to score4
-
Ajay Vibhute a01bd6afb2e05fd3791c69ed29b3ee5425392a5f
Solved merge conflicts
-
Ajay Vibhute 747bb8a04857939de9920a68106747c212a783c8 m
Pull request #1664: PIPE-2582: updated QA criteria for semiFinalBPdcals
Merge in PIPE/pipeline from PIPE-2582-hifv_semifinalbpdcals-qa-criteria to main
* commit '9b09ac10aa3c105cbc95aee66acc0e6dfab10eaf':
PIPE-2582: Changes suggested in PR review
PIPE-2582: present warning if spw is fully flagged, or mulitple antennas are fully flagged
PIPE-2582: Skipping the spectral line SPW fully flagged warning if the offending antenna is fully flagged
PIPE-2582: passing set(vis) to applies_to
PIPE-2582: added flaggedSolnApplycaldelay dictionary is structured, and other minior changes suggested during the PR review
PIPE-2582: minor changes suggested during PR review
PIPE-2582: minor bugfix
PIPE-2582: updated QA messages
PIPE-2582: maxout delay to 0.3
PIPE-2582: removed join from warning
PIPE-2582: added applies_to to QAScore
PIPE-2582: showing warning for fully flagged spw if it is spectral line spw
PIPE-2582: updated QA criteria -
Rui Xue 058d8aeea34d9aecc6b4a6a172339e1e4dea7d4a m
Pull request #1810: PIPE-3085: reduce MS open calls
Merge in PIPE/pipeline from PIPE-3085-improve-the-freq-frame--chan-conversion-speed-within-fluxcalflag to main
* commit 'ad315c171f1d6b940df0fe50f4c392b23effb04e':
PIPE-3085: Replace singleton ms tool with MSReader; add type hints
PIPE-3085: Extend MS open optimization to `correctedampflag`, `rawflagchans`, `gcorfluxscale`
PIPE-3085: Reduce MS open overhead in `hif_applycal` weblog rendering
PIPE-3085: hifa_fluxcalflag - cache SPW freq grids and use searchsorted in _get_chanrange -
Rui Xue ad315c171f1d6b940df0fe50f4c392b23effb04e m
PIPE-3085: Replace singleton ms tool with MSReader; add type hints
-
Ajay Vibhute 9b09ac10aa3c105cbc95aee66acc0e6dfab10eaf m
PIPE-2582: Changes suggested in PR review
-
Luke Maud ef7a76e314f8eb8de28402720b4c4c5e1bdf82db m
Pull request #1775: PIPE-3016 polarization calibration recipes second hifa bandpass after hifa lockrefant should not
Merge in PIPE/pipeline from PIPE-3016-polarization-calibration-recipes-second-hifa_bandpass-after-hifa_lockrefant-should-not to main
* commit '73c2dd1ef7a52b32229634b19b59610cd75013d2':
PIPE-3016 edit to move table unregister to within merge to context at end of stage run
PIPE-3016: minor codestyle changes.
PIPE-3016 typos and better commentary
PIPE-3016 add parameter to unregister the spwphaseup offset table -
Luca Di Mascolo 0e80eb93ef9ccb197fc019ce786fdd6d4558dfaf m
Pull request #1820: PIPE-2209: replace call to deprecated AntennaArray.baselines
Merge in PIPE/pipeline from PIPE-2209-eliminate-antennaarray.baselines-deprecation-warning to main
* commit '67aeda9c8e55a6aed96d04b61dc934e82d2960ed':
PIPE-2209: remove deprecated `baselines`/`_baselines` in AntennaArray
PIPE-2209: remove debugging leftover
PIPE-2209: replace call to deprecated AntennaArray.baselines -
Rui Xue 143268e351aabe649c573e0ba88ad8ba3073b691 m
Pull request #1818: PIPE-3089: Fix caltable filename inconsistency between serial and parallel modes
Merge in PIPE/pipeline from PIPE-3089-caltable-filenames-might-differ-between-serial-and-parallel-modes-for-some-alma-cal-tasks to main
* commit '5a560095bf4b576af51b2d4a67e4fa35279b7235':
PIPE-3089: set NamingTemplate.task on MPI/Dask workers -
Takeshi Nakazato 7b4dd9b34aff97f0f8ef8f42d93e1d88e9e8ed71 m
Pull request #1802: PIPE-2967 hsd k2jycal backup url for jy k db query
Merge in PIPE/pipeline from PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-query to main
* commit 'aedad0e415d5cf24d1920ae51eae2aabaad2c2b8':
revert max casa version
PIPE-2967 removed unnecessary rstrip operation
PIPE-2967 safely remove trailing newline
PIPE-2967 replace "hosts" in the variable names with "urls"
reverse the order of log records to be displayed with original order
improvement of the analysis of warning messages
Set default backup hosts
CASA version requirement for getjyperkalma task
remove unnecessary filter
take care of the case of dbservice=False
Define backup_hosts as vis-dependent property so that it is listed in the weblog
Emit warning message per endpoint URL (per EB)
refactoring
Migrate to getjyperkalma to access Jy/K DB -
Takeshi Nakazato aedad0e415d5cf24d1920ae51eae2aabaad2c2b8 m
Merge branch 'main' into PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-query
-
Takeshi Nakazato 674acc5fa300d5d875228aac3e96eba9a54934e1 m
revert max casa version
-
Luca Di Mascolo <lucadimascolo@gmail.com> 67aeda9c8e55a6aed96d04b61dc934e82d2960ed m
PIPE-2209: remove deprecated `baselines`/`_baselines` in AntennaArray
-
Rui Xue 454b91e80c6962a09f89ae57b094da0fbc1bbc61 m
PIPE-3085: Extend MS open optimization to `correctedampflag`, `rawflagchans`, `gcorfluxscale`
Hoist casa_tools.MSReader outside the inner loops in three additional
tasks, following the same pattern established for hif_applycal weblog
rendering:
- hif_correctedampflag: open once for the intent × field × spw loop
in _run_flagging_iteration; thread ms_handle through
_evaluate_heuristic → _evaluate_heuristic_for_baseline_set →
mstools.read_channel_averaged_data_from_ms.
- hif_rawflagchans: open once for the spw loop in
RawflagchansData.prepare; call openms.reset() between iterations
instead of opening a fresh handle per SPW.
- hifa_gfluxscale: open once for the field × spw loop in
_derive_calvis_flux; pass ms_handle to mstools.compute_mean_flux.
Also: bare except: → except Exception:, lazy % log formatting.- pipeline/hif/tasks/correctedampflag/correctedampflag.py (version 454b91e80c6962a09f89ae57b094da0fbc1bbc61) (diffs)
- pipeline/hif/tasks/rawflagchans/rawflagchans.py (version 454b91e80c6962a09f89ae57b094da0fbc1bbc61) (diffs)
- pipeline/hifa/tasks/fluxscale/gcorfluxscale.py (version 454b91e80c6962a09f89ae57b094da0fbc1bbc61) (diffs)
-
Rui Xue 7673073843ca00326b758194ef083e23c7573149 m
PIPE-3085: Reduce MS open overhead in `hif_applycal` weblog rendering
Reduce the cost of opening measurement sets in get_brightest_field()
by reusing a single MS handle across all (field, spw) iterations instead
of opening and closing the MS once per combination. On lazy-import data
sets, where the DATA column is ASDM-backed, this cuts the applycal
post-processing time significantly (observed ~50 min saving on a
2496-call dataset).
- renderer.py: open MS once with casa_tools.MSReader and pass handle
down to mstools.compute_mean_flux via the new ms_handle kwarg.
- mstools.py: add keyword-only ms_handle parameter to both
read_channel_averaged_data_from_ms and compute_mean_flux; call
openms.reset() before each reuse to clear prior selection state. -
Luca Di Mascolo <lucadimascolo@gmail.com> b9348f477ae1b967972341d849ec172f718cf8e9 m
PIPE-2209: remove debugging leftover
-
Luca Di Mascolo <lucadimascolo@gmail.com> a71c2a5c4d64378e5b652014664ed2194a376785 m
PIPE-2209: replace call to deprecated AntennaArray.baselines
-
Rui Xue 5a560095bf4b576af51b2d4a67e4fa35279b7235 m
PIPE-3089: set NamingTemplate.task on MPI/Dask workers
NamingTemplate.task is set by basetask.execute() only when
is_top_level_task() is True, which is always False on MPI servers.
This caused worker-side data product filenames to lack the task name
prefix, breaking any logic relying on filename content (e.g. the
amplitude caltable lookup in hifa_gfluxscale).
In Tier0PipelineTask.get_executable(), resolve the Pipeline task name from
task_registry (with a ParallelFoo.Task fallback) and set
NamingTemplate.task before executing the task lambda. -
Ajay Vibhute 459606c4ccc5b35ee3efca1182991f72dc41d584 m
PIPE-2582: present warning if spw is fully flagged, or mulitple antennas are fully flagged
-
Rui Xue 50fed352aa45cc77be74ca0dc00d3c028d594bfc m
PIPE-3085: hifa_fluxcalflag - cache SPW freq grids and use searchsorted in _get_chanrange
Open the MS once per prepare() call instead of once per line candidate,
and cache the cvelfreqs result per (vis, fieldid, spwid, refframe) via a
new _get_spw_freqs helper. Replace the O(N) linear channel scan with
np.searchsorted for O(log N) boundary lookup. Also convert %-style LOG
calls to lazy-format style and raise ValueError instead of Exception. -
Takeshi Nakazato ec08870085b982bbd3852c3c2fada3293a584d1a m
PIPE-2967 removed unnecessary rstrip operation
-
Takeshi Nakazato e4a4a28cdfb53232478226ee34e8a87094629829 m
PIPE-2967 safely remove trailing newline
-
Takeshi Nakazato 6f33a5ba730f28ba922f9382ca34c1a50544d127 m
PIPE-2967 replace "hosts" in the variable names with "urls"
-
Ajay Vibhute 84c7162aa601647985e19da0c1ee23fbaf607fcb m
PIPE-2582:resolved conflicts
-
Luke Maud 73c2dd1ef7a52b32229634b19b59610cd75013d2 m
PIPE-3016: update merge conflic after PIPE-2903 merged back to branch and fixed lock_refant.py
-
Takeshi Nakazato be7e43930885331dfcd1adcd6cee44316b3d9196 m
reverse the order of log records to be displayed with original order
-
Takeshi Nakazato df21a3a6f65a1c7c41121d0a9ccb70ccddde7f73 m
improvement of the analysis of warning messages
- remove line feed character from the analysis
- preserve the order of URLs in the log -
Takeshi Nakazato e560fd1187fd2f5a21b6d87d8d1faa4a28902de6 m
Merge branch 'main' into PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-query
-
Takeshi Nakazato fe9504fef685dc0b2798004a954353d43be3b20a m
Merge branch 'main' into PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-query
-
Takeshi Nakazato 2a9841b35fa120ce5bba1de46904b5930e8b9ad9 m
Set default backup hosts
-
Takeshi Nakazato 665baeaa8567472f7806e1aa22f0ff2d2cb5c680 m
CASA version requirement for getjyperkalma task
-
Takeshi Nakazato a69f272f52cb367654b9ce0a4e683257506cdd3c m
remove unnecessary filter
-
Takeshi Nakazato 77f7e52d0b295f3e9d5bc0187f2aec88fe2cc96d m
take care of the case of dbservice=False
The gencal task is used in that case -
Takeshi Nakazato 5583665a04154ce512da8f6c2d867a3535d8d911 m
Define backup_hosts as vis-dependent property so that it is listed in the weblog
-
Takeshi Nakazato b85018be926f8a385fb8d8d664a6ee65c6d2b92d m
Emit warning message per endpoint URL (per EB)
-
Takeshi Nakazato 85fd1aaa9b626549038bd2fb346d8f397a71811d m
Merge branch 'main' into PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-query
-
Luke Maud aca952a3a5e602c79a35da8e0b0fe8b1be3bd528 m
PIPE-3016 edit to move table unregister to within merge to context at end of stage run
-
Rui Xue 0709544e640732d4fdb67dbb67494b71cc875809 m
PIPE-3016: minor codestyle changes.
-
Ajay Vibhute 4924cce99f2cb4b2738733a344217544d0689319 m
PIPE-2582: Skipping the spectral line SPW fully flagged warning if the offending antenna is fully flagged
-
Luke Maud 2eaf96cd1633d82630f35d93e390a6772532f7bd m
PIPE-3016 typos and better commentary
-
Luke Maud b81660a1234415be03d78a99af1e7f299ea1922c m
PIPE-3016 add parameter to unregister the spwphaseup offset table
-
Ajay Vibhute 9023c84111ddd299655ca0371ef70d5e2e383437 m
PIPE-2582: passing set(vis) to applies_to
-
Ajay Vibhute 212a90b6dda94749827bf763351ba4c42eed5f70 m
PIPE-2582: added flaggedSolnApplycaldelay dictionary is structured, and other minior changes suggested during the PR review
-
Takeshi Nakazato 642e4445409c6280df5a059d2e63e12b83880f06 m
refactoring
-
Takeshi Nakazato 201c8358c5e979b4c0f4734c1eb5c2d1693146c1 m
Migrate to getjyperkalma to access Jy/K DB
- register getjyperkalma to the pipeline
- define new parameter, backup_hosts, for backup URL
- update to_casa_args to return the dict compatible with getjyperkalma -
Ajay Vibhute 8019a66f764d3376aad213e2454412254af1212e m
PIPE-2582: minor changes suggested during PR review
-
Ajay Vibhute 7bf027a8e219e5a5e4118e1c616115c0af162920 m
PIPE-2582: fixed merge conflicts
-
Ajay Vibhute c872ea103cef2ebe7eb876349ee08bffbfd37743 m
PIPE-2582: minor bugfix
-
Ajay Vibhute c4bab099de43a1479b721b8c48265efa6e723a84 m
PIPE-2582: updated QA messages
- pipeline/hifv/tasks/finalcals/qa.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
- pipeline/hifv/tasks/semiFinalBPdcals/qa.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
- pipeline/hifv/tasks/testBPdcals/qa.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
- pipeline/qa/scorecalculator.py (version c4bab099de43a1479b721b8c48265efa6e723a84) (diffs)
-
Ajay Vibhute 483e05f3203979dc3ee4615d2c7b9fd50ccdb3da m
PIPE-2582: maxout delay to 0.3
-
Ajay Vibhute 4880b2d93500d1fda39156ec51f0a623732e52f0 m
PIPE-2582: removed join from warning
-
Ajay Vibhute 6752dae07d45e73cbbaaf7c3495bda1870a83167 m
PIPE-2582: added applies_to to QAScore
-
Ajay Vibhute e8ca21c269fdc7f82f070d3d71adc316d3137b39 m
PIPE-2582: showing warning for fully flagged spw if it is spectral line spw
-
Ajay Vibhute a9c4fc9037a81e99d582d0f9d6752c8a0e8db470 m
PIPE-2582: updated QA criteria