Build: #3 was successful Changes by Shawn Booth
Code commits
Pipeline
-
Shawn Booth ec96ef5a00ef45c84ca262416a338a89e2d97ba3
Merge remote-tracking branch 'origin/main' into PIPE-3259-clean-up-redundant-flux-service-query-probing-calls
-
Rui Xue 85a334903820b9841ba363dd5dec79fe92d113cd m
Pull request #2016: PIPE-3272: Add flux service query script and clairfy the new 4-digit "DataConditions" from 2026AUG
Merge in PIPE/pipeline from PIPE-3272-add-flux-service-query-script to main
* commit '4c62d794f7473aa7df7449b637c1f5ecfdd072e0':
PIPE-3272: reference ICT tickets for 4th DataConditions digit
PIPE-3272: update DataConditions parsing in dbfluxes for 4-digit codes
PIPE-3272: add `dbfluxes_query.py` script for catalogue lookups -
Rui Xue a7f8802d696f85d31b747a8dc52651366f1cf9c2 m
Pull request #1960: PIPE-3237: optimize unflagged data checks in `hif_findroi` and `ImageParamsHeuristics`
Merge in PIPE/pipeline from PIPE-3237-hif_findroi-very-inefficient-for-cases-with-many-fields-x-eb-x-spw to main
* commit '82fe783a77d453ed5300b9485da639fd9933cecc':
PIPE-3237: warn once when `hif_findroi` skips a virtual spw
PIPE-3237: simplify target field name list construction in `findroi.py`
PIPE-3237: optimize unflagged data checks in `hif_findroi` and `ImageParamsHeuristics` -
Rui Xue 4c62d794f7473aa7df7449b637c1f5ecfdd072e0 m
PIPE-3272: reference ICT tickets for 4th DataConditions digit
-
Rui Xue a3a8f9ac972247979d0280b51154721cd9104f16 m
PIPE-3272: update DataConditions parsing in dbfluxes for 4-digit codes
-
Rui Xue 293163dd05b17927cc2382fa157dbef71af89217 m
PIPE-3272: add `dbfluxes_query.py` script for catalogue lookups
-
Rui Xue df553e34d6e0e53244ac27c105e7fb0bf296f60f m
Pull request #1955: PIPE-684/PIPE-3218/PIPE-3255: VLA mosaic imaging
Merge in PIPE/pipeline from PIPE-684-vla-mosaic-imaging to main
* commit 'beed751da9a3c6555c661227f0e90d131b9ad0a7': (52 commits)
PIPE-684: handle per-MS field lists and streamline center_field_ids
PIPE-684: set VLA pblimit_image to 0.1 for mosaic non-cube imaging
PIPE-3247/PIPE-3248: Improve field name rendering with text wrapping
PIPE-684: consolidate flagged SPW warnings and skip fully flagged targets in makeimlist
PIPE-3218: display spectral window lists as ranges in `exportdata` tables
PIPE-684: Enable per-field mitigation parameter lookups in `makeimlist`
PIPE-684: Add optional field parameter to `hm_cell/hm_imsize` lookups
PIPE-684: improve `wrap_long_str` - track line length instead of using old modulo arithmetic
PIPE-684: fix multi-target product size mitigation with per-(field,spw) keying
PIPE-3218: fix HTML line breaks for long field names
PIPE-684: Fix product size calculation and add field filtering
PIPE-684: disable self-calibration heuristics for VLA mosaic targets
PIPE-3218: wrap long source names in exportdata.mako weblog tables
PIPE-3218: wrap long source names in `hifv_exportdata` weblog tables
PIPE-684: export `wrap_long_str` in pipeline.infrastructure.utils
PIPE-684: condense long composite field names in QA and log messages
PIPE-684: merge weblog table columns in findcont and VLA exportdata
PIPE-684: use `self.spwids` for field lookup and frequency calculation in VLA heuristics
PIPE-684: optimize logging and improve VLA field intent docs
PIPE-684: Refactor mosaic detection with modern Python standards and comprehensive tests
... -
Rui Xue 82fe783a77d453ed5300b9485da639fd9933cecc m
PIPE-3237: warn once when `hif_findroi` skips a virtual spw
-
Rui Xue 148f12af9c82315bbf9cd6b156b49b44be725d98 m
PIPE-3237: simplify target field name list construction in `findroi.py`
-
Hajime Ezawa 56745139edf63b1a6dd4dc351ecde473f08e2156 m
Pull request #1968: PIPE-3246: add overwrite=True to image_args
Merge in PIPE/pipeline from PIPE-3246-hsd_imaging-sometimes-hsd_imaging-crashes-with-runtimeerror-output-file-exists to main
* commit '1113f6eeab147278cd16547f836b6d5012ed49df':
PIPE-3246: add overwrite=True to image_args -
Rui Xue e334846327e00b2cda5bb860498fa94a3f63db6f m
Pull request #2006: PIPE-3252/PIPE-3264
Merge in PIPE/pipeline from PIPE-3252-docs-update-to-main to main
* commit '721235e8ba3766673fef78026556b927f802fdcb':
PIPE-3252: add AGENTS.md and align ruff pre-commit
PIPE-3252: add JM to the contributor list -
Rui Xue 721235e8ba3766673fef78026556b927f802fdcb m
PIPE-3252: add AGENTS.md and align ruff pre-commit
- Add AGENTS.md defining operational directives, architectural invariants, modern Python standards, and developer guidelines.
- Point .github/copilot-instructions.md to AGENTS.md as the canonical authority for AI assistant instructions.
- Switch .pre-commit-config.yaml to local hooks invoking pixi-managed ruff to guarantee parity across IDE, pre-commit, and agent workflows. -
Rui Xue 86ba85641552eef9b6f903264182026fbe19f74e m
PIPE-3252: add JM to the contributor list
-
Rui Xue beed751da9a3c6555c661227f0e90d131b9ad0a7 m
Merge remote-tracking branch 'origin/main' into PIPE-684-vla-mosaic-imaging
-
Rui Xue 09e7ce9075867e9c005c6a45926f0500ec33c5d9 m
Pull request #2003: PIPE-3252: add link to CASA Docs citation guide in acknowledgements
Merge in PIPE/pipeline from PIPE-3252-add-casa-citation-page to main
* commit '8c6a6a273861cfa5da6e3f57ed6248f35169d7bb':
PIPE-3252: add link to CASA Docs citation guide in acknowledgements -
Rui Xue 8c6a6a273861cfa5da6e3f57ed6248f35169d7bb m
PIPE-3252: add link to CASA Docs citation guide in acknowledgements
-
Remy Indebetouw a0586fcdb966530af2d64068f1c84376fdbd5144 m
Pull request #2000: reordered chronologically, added people who contributed significantly albeit not directly in the code repo
Merge in PIPE/pipeline from PIPE-3263-doc-updates to main
* commit 'a0038a8a2d5338d32976b6ba80057eff54bc66f7':
fixed "present" and double Andy
reordered chronologically, added people who contributed significantly albeit not directly in the code repo -
Remy Indebetouw <remy@virginia.edu> a0038a8a2d5338d32976b6ba80057eff54bc66f7 m
fixed "present" and double Andy
-
Remy Indebetouw <remy@virginia.edu> 0669c460be9ade6b26ce65288d1024f5d0d667bf m
reordered chronologically, added people who contributed significantly albeit not directly in the code repo
-
Rui Xue 6ebe41c7f7a634c6c0bd19ec6bc9a3dede8771da m
Pull request #1998: PIPE-3252: update release notes with ALMA task references and improve formatting
Merge in PIPE/pipeline from PIPE-3252-append-alma-task-ref-to-plug-main to main
* commit '8ac857aa5055fe97677559d13504a077fa590f08':
PIPE-3252: update release notes with ALMA task references and improve formatting -
Rui Xue 8ac857aa5055fe97677559d13504a077fa590f08 m
PIPE-3252: update release notes with ALMA task references and improve formatting
-
Rui Xue 17dd28330aea2d87240b0db9ff1e5883da443528 m
Pull request #1996: PIPE-3252: Add AL to Contributors list
Merge in PIPE/pipeline from PIPE-3252-append-alma-task-ref-to-plug-main to main
* commit '79b00e3aef7de55ad5b9c185aa71ccd39f6d86bd':
PIPE-3252: Add AL to Contributors list -
Rui Xue 79b00e3aef7de55ad5b9c185aa71ccd39f6d86bd m
PIPE-3252: Add AL to Contributors list
-
Rui Xue d4c1cf365fb7cf6405ee6f69b5aa57c67cc1c050 m
Pull request #1988: PIPE-3260: Fix false QA failures in `VLASetjy`
Merge in PIPE/pipeline from PIPE-3260-false-qa-warning-about-lack-of-flux-calibrator-in-hifv_vlasetjy-task to main
* commit '34228abc590663d2714f3d8cc7e37e8d124b2293':
PIPE-3260: Fix false QA failures in `VLASetjy` -
Rui Xue b0920bd33c2728cf8292bc773bf49ed5cb9e5ca4 m
Pull request #1983: PIPE-3258: fix reference antenna fallback and caltable cleanup in `hifv_semiFinalBPdcals`
Merge in PIPE/pipeline from PIPE-3258-antenna-fully-flagged-during-bandpass-scan-still-used-as-refant to main
* commit '8dabe1b5b997da832ea10696bb0a42d11d6c2337':
PIPE-3258: preserve list type in refant fallback and align testBPdcals
PIPE-3258: fix reference antenna fallback and caltable cleanup in `hifv_semiFinalBPdcals` -
Rui Xue 0e65d3296eb61d1facf16f2708c2a9cd6711f316 m
Pull request #1992: PIPE-3252 append alma task ref to plug main
Merge in PIPE/pipeline from PIPE-3252-append-alma-task-ref-to-plug-main to main
* commit 'c32c5ee6f49ee372db9c51fcd18132440540ac23':
PIPE-3252: partition dev docs and add contributors page
PIPE-3252: include ALMA tasks in User's Guide PDF and clean up doc links -
Rui Xue c32c5ee6f49ee372db9c51fcd18132440540ac23 m
PIPE-3252: partition dev docs and add contributors page
- partition dev toctrees and `conf.py` exclusions between public and internal builds
- move `dependencies.md` under `devel/setup/` and update cross-references
- add Contributors to Basics navigation with courtesy note
- tweak citation and transition notices in `docs/README.rst`
- clean up "CASA pipeline tasks" terminology across documentation- Contributors.rst (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/README.rst (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/conf.py (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/contributors.rst (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/devel/reference/callibrary.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/devel/setup/dependencies.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/devel/setup/index.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/devel/testing/diffing_execution_logs.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/devel/usage/running_pipeline.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/index.rst (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/qa.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
- docs/source/users_guide/pipeline-versions-and-documentation.md (version c32c5ee6f49ee372db9c51fcd18132440540ac23) (diffs)
-
Rui Xue 9b876959674a29dd5f275d64375dd01d13d472fe m
PIPE-3252: include ALMA tasks in User's Guide PDF and clean up doc links
- Add `users_guide/alma_tasks.rst` and Sphinx hooks in conf.py to resolve task hyperlinks in `users_guide.pdf` while excluding them from HTML builds.
- Drop "known_issues" from `users_guide/index.md` to eliminate duplicate toctree warnings and align navigation hierarchy with VLA.
- Fix broken cross-references, link syntax, code fences, and typos across the PLUG documentation files.- docs/source/conf.py (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/alma_tasks.rst (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/data-processing-files.md (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/helper-text-files.md (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/index.md (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/known_issues.md (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/lowSNR-workflow.md (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
- docs/source/users_guide/pipeline-weblog.md (version 9b876959674a29dd5f275d64375dd01d13d472fe) (diffs)
-
Rui Xue c394948a650b5fbd04e48e7d39f16e711270d163 m
Pull request #1990: PIPE-3262
Merge in PIPE/pipeline from PIPE-3262 to main
* commit '8d3c214a77b5638e53eed418fafc0f126617e138':
PIPE-3262: prevent MPI import deadlock and drop `casaplotserver` in pixi
PIPE-3262: avoid unconditional mpi4py import in `daskhelpers.py` -
Rui Xue 8d3c214a77b5638e53eed418fafc0f126617e138 m
PIPE-3262: prevent MPI import deadlock and drop `casaplotserver` in pixi
- Add dynamic `scripts/stubs/casalith.py` to defer MPI initialization to casashell script scope and avoid casatasks import-lock deadlocks (CAS-14037).
- Propagate PYTHONPATH with scripts/stubs in pixi `casa` and `casampi` tasks.
- Remove unused `casaplotserver` dependency from `pyproject.toml` and lockfile. -
Rui Xue 8f568c69ee1cef7d1b872cb1261b5ee41ca6a9bb m
PIPE-3262: avoid unconditional mpi4py import in `daskhelpers.py`
Use `MPIEnvironment.mpi_processor_rank` instead of `mpi4py.MPI.COMM_WORLD.Get_rank()` to prevent unmanaged `MPI_Init` calls and potentially crashes in macOS serial sessions environments with OpenMPI build/version mismatches. -
Rui Xue 34228abc590663d2714f3d8cc7e37e8d124b2293 m
PIPE-3260: Fix false QA failures in `VLASetjy`
- `pipeline/hifv/tasks/setmodel/qa.py`: filter standard calibrators to fields with AMPLITUDE intent, safeguard statistics lookups, and disambiguate MS field names in messages.
- `pipeline/hifv/tasks/setmodel/qa_test.py`: add unit tests covering single/multiple calibrators, pointing aliases, and edge cases. -
Rui Xue 8dabe1b5b997da832ea10696bb0a42d11d6c2337 m
PIPE-3258: preserve list type in refant fallback and align testBPdcals
Use list slicing instead of `np.delete` for refant fallback, clean up delay caltables on retry in testBPdcals, and streamline docstrings. -
Rui Xue 15dcc142b4d05281e356875261f733e0c026ef78 m
PIPE-3258: fix reference antenna fallback and caltable cleanup in `hifv_semiFinalBPdcals`
Propagate the updated reference antenna list in the delaycal retry loop, clean up preexisting delay caltables, and guard against empty antenna lists. -
Rui Xue ec0d64616bb1e25c69cdbdc3475801c422703a87 m
PIPE-684: handle per-MS field lists and streamline center_field_ids
- Support both string and per-MS sequence field selections in `center_field_ids`, fixing `AttributeError` from `.split()` when `inputs.field` is a list (e.g. in VLASS).
- Leverage `ms.get_fields(task_arg=...)` in `center_field_ids` to natively resolve field IDs, names, and selections via domain tools.
- Pass `fields` instead of flattened `field_names` in `phasecenter` to align with the per-MS heuristics contract.
- Add type hints and docstrings for `phasecenter` and `center_field_ids`. -
Rui Xue 302d80afc5c8d1f2c54c5f934078817de2cd77ba m
PIPE-684: set VLA pblimit_image to 0.1 for mosaic non-cube imaging
- Add optional `gridder` parameter to `pblimits` across base, VLA, and VLASS image heuristics classes.
- Update VLA heuristics to set `pblimit_image = 0.1` for non-cube mosaic imaging (keeping 0.2 for cube and -0.1 for single-field continuum).- pipeline/hif/heuristics/imageparams_base.py (version 302d80afc5c8d1f2c54c5f934078817de2cd77ba) (diffs)
- pipeline/hif/heuristics/imageparams_vla.py (version 302d80afc5c8d1f2c54c5f934078817de2cd77ba) (diffs)
- pipeline/hif/heuristics/imageparams_vlass_single_epoch_continuum.py (version 302d80afc5c8d1f2c54c5f934078817de2cd77ba) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 302d80afc5c8d1f2c54c5f934078817de2cd77ba) (diffs)
-
Rui Xue 963956e8bd22165cc051817a887b04312b9ee253 m
PIPE-3247/PIPE-3248: Improve field name rendering with text wrapping
- Wrap long comma-separated field names weblogs of `findcont` and `uvcontsub`
- Save and present only first field name by parsing composite field names in joint mask sky plots -
Hajime Ezawa 1113f6eeab147278cd16547f836b6d5012ed49df m
PIPE-3246: add overwrite=True to image_args
-
Rui Xue da22be2d53d62c4000bea3bf069e6e1ff56e4778 m
PIPE-684: consolidate flagged SPW warnings and skip fully flagged targets in makeimlist
- Aggregate completely flagged SPW warnings into a single consolidated message per EB/field using SPW ranges.
- Filter `field_intent_list` to skip imaging target generation and log warnings for fields that have no valid data within a receiver band.
- Add an explicit warning when no valid data remains across an entire receiver band. -
Rui Xue fa6824a49bda0ef9a3aa3bbdf576683fe62c0a2d m
PIPE-3218: display spectral window lists as ranges in `exportdata` tables
-
Rui Xue a2331a30330f62f5bd84a9ecd64599f36f6c978a m
PIPE-684: Enable per-field mitigation parameter lookups in `makeimlist`
Move `hm_cell` and `hm_imsize` parsing into `field_intent` loop to support field-specific custom mitigation parameters. Update dictionary keys from spwspec to `(field, spwspec)` tuples for field-specific lookups. -
Rui Xue 6ce2b6b36cd37892041044f1b4576fd4575e2d95 m
PIPE-684: Add optional field parameter to `hm_cell/hm_imsize` lookups
- Add field argument to `get_spw_hm_cell()` and `get_spw_hm_imsize()` for custom
field-specific mitigation parameter lookups
- Defaults to `self.field` for backward compatibility
- Reorder `hm_cell` parsing to after spw filtering for better code organization -
Rui Xue 670e29aca8932b3e3f8e760256e8e7c1870500eb m
PIPE-684: improve `wrap_long_str` - track line length instead of using old modulo arithmetic
-
Rui Xue d4978fd1728df6f0b0e6aaf61fb3e0336848e652 m
Merge remote-tracking branch 'origin/main' into PIPE-684-vla-mosaic-imaging
-
Rui Xue 963912718e33f9a2f72ba765774b003f2932c5a5 m
Merge branch 'PIPE-684-vla-mosaic-imaging' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-684-vla-mosaic-imaging
-
Rui Xue 6a8be109f9b22e126cb5e773430a0c17e7c8c422 m
PIPE-684: fix multi-target product size mitigation with per-(field,spw) keying
Fix four bugs in mitigation parameter propagation:
- Dictionary overwriting: use .update() to accumulate params
- Wrong task instance: use local_makeimlist_inputs for second-level mitigation
- Conditional logic: prioritize mitigation over user defaults
- SPW-only keying: change to (field,spw) tuple for proper isolation- pipeline/hif/heuristics/checkproductsize.py (version 6a8be109f9b22e126cb5e773430a0c17e7c8c422) (diffs)
- pipeline/hif/tasks/checkproductsize/renderer.py (version 6a8be109f9b22e126cb5e773430a0c17e7c8c422) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 6a8be109f9b22e126cb5e773430a0c17e7c8c422) (diffs)
-
Rui Xue 1a69811f2d2c52598eb8a9352bfba39903896042 m
PIPE-3218: fix HTML line breaks for long field names
Use `wrap_long_str(field, newline='<br>')` to properly render line breaks in long field names in the findcont table instead of invisible newlines. -
Rui Xue 95214d3a64821c117c187f3cd43768691b910db6 m
PIPE-684: Fix product size calculation and add field filtering
- Fix product size accumulation: sum all target sizes per SPW instead of last target only
- Fix max() on empty cubesizes dict with safe default
- Add 5% tolerance factor for product size limit checks
- Add field filtering support in VLA imaging heuristics with name/ID/source/pattern matching -
Rui Xue fc795b0a549b65680e113a5605a31c571999068e m
PIPE-3237: optimize unflagged data checks in `hif_findroi` and `ImageParamsHeuristics`
- Deduplicate target field names in hif_findroi using utils.deduplicate to avoid redundant probes across mosaic pointings
- Short-circuit the EB/field probe loop in hif_findroi as soon as unflagged data is confirmed for an SPW
- Break early in ImageParamsHeuristics.has_data once valid data is found for a field intent -
Rui Xue 912dd3dd9292793e05fd70a65e26038607f57e3b m
PIPE-684: disable self-calibration heuristics for VLA mosaic targets
- Disable self-calibration heuristics in `hif_selfcal` for VLA composite mosaic observations (multiple pointings) while preserving single-pointing VLA and ALMA mosaic self-calibration.
- Format skipped target warnings using `utils.condense_field_names` and `utils.find_ranges` for cleaner log output.
- Update self-calibration QA message to reflect unsupported VLA mosaic mode.
- Add `scal` argument docstring in `MakeImListInputs`. -
Rui Xue 5aa024e4bee0ea4643dc91739c0e4bd93630dbb6 m
PIPE-3218: wrap long source names in exportdata.mako weblog tables
- Use `utils.wrap_long_str` with `<br>` in `pipeline/h/templates/exportdata.mako` across all image tables to prevent long comma-separated mosaic source names from expanding table columns horizontally. -
Rui Xue b2d6cdac0bd96869e722a76fa8841205b206ffdc m
PIPE-3218: wrap long source names in `hifv_exportdata` weblog tables
-
Rui Xue d7e1c886146b70fea8425e0f1eaf2267e2351103 m
PIPE-684: export `wrap_long_str` in pipeline.infrastructure.utils
- Add `wrap_long_str` to `__all__` in `utils.py` so it is properly exposed in the top-level `pipeline.infrastructure.utils` package namespace.
- Add unit tests for `wrap_long_str` in `utils_test.py`. -
Rui Xue 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e m
PIPE-684: condense long composite field names in QA and log messages
- Add `utils.condense_field_names` to abbreviate long comma-separated field lists for presentation and logging.
- Add unit test coverage for `condense_field_names` in `conversion_test.py`.
- Apply `condense_field_names` to log messages and QA score banners across `makeimlist`, `makeimages`, and `tclean`.
- Modernize message formatting to f-strings in `tclean/qa.py` and use lazy logging in `tclean.py`.- pipeline/hif/tasks/makeimages/makeimages.py (version 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e) (diffs)
- pipeline/hif/tasks/tclean/qa.py (version 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e) (diffs)
- pipeline/infrastructure/utils/conversion.py (version 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e) (diffs)
- pipeline/infrastructure/utils/conversion_test.py (version 61caed82fb7256a88d2cbd6b5bd7bdabb24f441e) (diffs)
-
Rui Xue cc949427bb5b2336cfc85fc552fe977457f540e5 m
PIPE-684: merge weblog table columns in findcont and VLA exportdata
- Apply utils.merge_td_columns to the imaging summary table in hif_findcont.
- Introduce dedicated T2_4MDetailsVLAExportDataRenderer and template for hifv_exportdata to merge repeated source/spw rows in exported FITS image tables.
- Add defensive guards for missing image lists and dictionary key access.- pipeline/hif/tasks/findcont/renderer.py (version cc949427bb5b2336cfc85fc552fe977457f540e5) (diffs)
- pipeline/hif/templates/findcont.mako (version cc949427bb5b2336cfc85fc552fe977457f540e5) (diffs)
- pipeline/hifv/tasks/exportdata/__init__.py (version cc949427bb5b2336cfc85fc552fe977457f540e5) (diffs)
- pipeline/hifv/tasks/exportdata/renderer.py (version cc949427bb5b2336cfc85fc552fe977457f540e5) (diffs)
- pipeline/hifv/templates/exportdata.mako (version cc949427bb5b2336cfc85fc552fe977457f540e5) (diffs)
-
Rui Xue d2879d37ba29ca61808565a31b12584c644ce647 m
PIPE-684: use `self.spwids` for field lookup and frequency calculation in VLA heuristics
-
Rui Xue 948332397d4aef69335df5e92434fb14ab3d0b21 m
Merge remote-tracking branch 'origin/main' into PIPE-684-vla-mosaic-imaging
Resolve conflicts:
- `pipeline/hif/heuristics/imageparams_base.py` -
Rui Xue e16ab072f5445b683d8fedab9860a1b87d056cd1 m
PIPE-684: optimize logging and improve VLA field intent docs
- Convert LOG.info to lazy logging pattern (defer string interpolation)
- Add return type hint to field_intent_list: set[tuple[str, str]]
- Expand docstring with Args/Returns and mosaic behavior details
- Remove unnecessary `MosaicDetectionHeuristics()` instantiation
- Add inline comments documenting mosaic processing steps
- Clean up imports, blank lines, and quote consistency- pipeline/hif/heuristics/imageparams_base.py (version e16ab072f5445b683d8fedab9860a1b87d056cd1) (diffs)
- pipeline/hif/heuristics/imageparams_vla.py (version e16ab072f5445b683d8fedab9860a1b87d056cd1) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version e16ab072f5445b683d8fedab9860a1b87d056cd1) (diffs)
-
Rui Xue 5ef52151133ecf3b46bb6c421ca4208d17a5ece6 m
PIPE-684: Refactor mosaic detection with modern Python standards and comprehensive tests
- Convert MosaicDetectionHeuristics methods to @staticmethod (stateless design)
- Upgrade to Python 3.12+ type hints (PEP 604/585): list[], tuple[], dict[]
- Add Google-style docstrings with Args/Returns sections
- Add create_mosaic_groups() testing interface
- Refactor check_targets_for_mosaic() to reuse clustering logic
- Add comprehensive test suite (12 tests):
* Core clustering scenarios (low/high declination, independent fields)
* Edge cases (empty, single field, transitive closure)
* Parameter validation (overlap_tol)
* Unit tests for helper methods (merge_pairs, normalize_dec) -
Rui Xue c1e6f762cd2f0325aa46243b4050f19e74f3fb10 m
PIPE-684: Fix composite source detection and consolidate `wrap_long_str`
- Fix makeimlist.py: Check all fields for composite sources (comma-separated names), not just the first field. Prevents incorrect representative source reordering for mixed VLA field lists.
- Consolidate duplicate wrap_long_str implementations from renderer.py and makeimlist.mako into utils.py with configurable newline parameter.
- Standardize HTML: Use <br> instead of malformed </br> tag.
- Add Python 3.12+ type hints and Google-style docstring to wrap_long_str.- pipeline/hif/tasks/findcont/renderer.py (version c1e6f762cd2f0325aa46243b4050f19e74f3fb10) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version c1e6f762cd2f0325aa46243b4050f19e74f3fb10) (diffs)
- pipeline/hif/templates/makeimlist.mako (version c1e6f762cd2f0325aa46243b4050f19e74f3fb10) (diffs)
- pipeline/infrastructure/utils/utils.py (version c1e6f762cd2f0325aa46243b4050f19e74f3fb10) (diffs)
-
Rui Xue 791541abdfcfcba38726455e62e74446599de9cd m
PIPE-684: Add type hints and modernize docstrings in `mosaicoverlap.py`
-
Rui Xue 05b4b0cd3bf3de5a30af603de0c3f6e8c1ac652b m
PIPE-684: Refactor VLA mosaic field handling to be less invasive
Remove mosaic_sources parameter from base class cont_ranges_spwsel()
method and read composite mosaic field names directly from contfile
via ContFileHandler. This eliminates VLA-specific parameter pollution
of the base class interface.
Key changes:
- Read field names from contfile to handle composite mosaic sources
(e.g., "Field_A,Field_B") that don't exist in MS source table
- Remove tmpfield extraction that was breaking selfcal lookups by
splitting mosaic field names
- Use full field_intent[0] for selfcal parameter queries
- Deduplicate source names to avoid redundant dict initialization
This makes VLA mosaic support non-invasive while maintaining backward
compatibility with ALMA and single-field imaging.- pipeline/hif/heuristics/imageparams_base.py (version 05b4b0cd3bf3de5a30af603de0c3f6e8c1ac652b) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 05b4b0cd3bf3de5a30af603de0c3f6e8c1ac652b) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 05b4b0cd3bf3de5a30af603de0c3f6e8c1ac652b) (diffs)
-
Rui Xue 81b2d36c691c9ceaa10b424dcbfc68ea1a0ce1f6 m
PIPE-684: Refactor VLA mosaic detection to use direct spw->field mapping
Remove VLA-specific parameters from factory interface and simplify
by directly querying fields for current spws instead of deriving
band first. Keeps VLA logic isolated within VLA heuristics class.- pipeline/hif/heuristics/imageparams_factory.py (version 81b2d36c691c9ceaa10b424dcbfc68ea1a0ce1f6) (diffs)
- pipeline/hif/heuristics/imageparams_vla.py (version 81b2d36c691c9ceaa10b424dcbfc68ea1a0ce1f6) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 81b2d36c691c9ceaa10b424dcbfc68ea1a0ce1f6) (diffs)
-
Ajay Vibhute 8573c7f42e081b577f05600612ee4d3bd55ff1b7 m
PIPE-684: fixed a bug in hpbw calculation
-
Ajay Vibhute 9dcb46a1234cfa7d267b42ee5e37e9742352d98e m
Merge branch 'main' into PIPE-684-vla-mosaic-gridder-heuristic-with-field-label
-
Ajay Vibhute dab9c465423fdbd2586b43c5d5f1521af7875779 m
PIPE-684: updated cont_ranges_spwsel method to work with mosaic source list
-
Ajay Vibhute a8e4a6d13a4f9b475c7f3f3c6fff81ee6418ead5 m
PIPE-684: updated template to wrap field names
-
Ajay Vibhute fdcdd803948803ce4086ab0ba540446bfd8adb2f m
PIPE-684: fixed unbound variable band_fields in makeimlist
-
Ajay Vibhute c11e460eef30863f31cd506592b031db553fec15 m
Merge branch 'main' into PIPE-684-vla-mosaic-gridder-heuristic-with-field-label
-
Ajay Vibhute cdc72ba15bd5d873088f5a1df06f7b16be4d297e m
PIPE-684: updated center_field_ids method call in calc_sensitivities
-
Ajay Vibhute b0d5d24bb6d32c61653de5dac5fb89df7c2fcce6 m
PIPE-684: fixed incorrect psf_phasecentre for vla
-
Ajay Vibhute dde0e1ef0d72d635893a95819579cf72f201df1e m
PIPE-684: wrap findcont field list in weblogs
-
Ajay Vibhute 1197bb8248b79f74fb14a4bc595f8f64e0e85d10 m
PIPE-684: resolved conflicts in makeimlist.py
-
Ajay Vibhute 49d11815f16ca161eab5bb1dd1aab3ffa777e1f2 m
PIPE-684: For VLA mosaic, skipping call to place_repr_source_first method
-
Ajay Vibhute 8db04c4bad1b7c211022fc9bcc589caeeac11bb7 m
PIPE-684: code cleanup and docstring update for mosaicOverlapFactorMS method
-
Ajay Vibhute 3ce62db086f285fcb5c784d5cd0ff82929bc1ec2 m
PIPE-684: added VLA-specific field_inten_list method and moved VLA mosaic detection inside it
- pipeline/hif/heuristics/imageparams_factory.py (version 3ce62db086f285fcb5c784d5cd0ff82929bc1ec2) (diffs)
- pipeline/hif/heuristics/imageparams_vla.py (version 3ce62db086f285fcb5c784d5cd0ff82929bc1ec2) (diffs)
- pipeline/hif/heuristics/mosaic_detection.py (version 3ce62db086f285fcb5c784d5cd0ff82929bc1ec2) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 3ce62db086f285fcb5c784d5cd0ff82929bc1ec2) (diffs)
-
Ajay Vibhute 8152f429c6464abe187a42efdf2699592b944162 m
PIPE-684: moving mosaic image filename setting in VLA heuristics
-
Ajay Vibhute 92d4375476556520d6d1aaf59a3e283c8c5a9519 m
PIPE-684: Using scipy.sparse method for mosaic detection
-
Ajay Vibhute b7ec79fdb1db09ab3fac8ce0937c15d2f749024c m
PIPE-684: use range format for SPW presentation in the weblog of makeimlist
-
Ajay Vibhute 89ff480b6073ac50b82c625dfae6b3e0ec9e4f27 m
PIPE-684: setting mosaic image name to first field
-
Ajay Vibhute 92c46ad8ac3058b4b097cb8b044aa6b9e8e6f2d1 m
Merge branch 'PIPE-684-vla-mosaic-gridder-heuristic-with-field-label' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-684-vla-mosaic-gridder-heuristic-with-field-label
-
Ajay Vibhute 8f3d8d4b0cdcedda01de9896e52c1487a7242491 m
minor bugfix in filed intent list in mosaic
-
Ajay Vibhute 8e2d64db42def5a24f87390fd36ef539b14c3a25 m
PIPE-684: moved mosaic detection code to MosaicDetectionHeuristics class and removed is_cluster
- pipeline/hif/heuristics/imageparams_base.py (version 8e2d64db42def5a24f87390fd36ef539b14c3a25) (diffs)
- pipeline/hif/heuristics/mosaic_detection.py (version 8e2d64db42def5a24f87390fd36ef539b14c3a25) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 8e2d64db42def5a24f87390fd36ef539b14c3a25) (diffs)
- pipeline/hif/tasks/makeimlist/resultobjects.py (version 8e2d64db42def5a24f87390fd36ef539b14c3a25) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 8e2d64db42def5a24f87390fd36ef539b14c3a25) (diffs)
- pipeline/infrastructure/launcher.py (version 8e2d64db42def5a24f87390fd36ef539b14c3a25) (diffs)
-
Ajay Vibhute 2cd1b5dc5e973c0bc98b9e7be726aac22e604834 m
PIPE-684: Updated the mosaic detection heuristic to use fields belonging to the current band
-
Ajay Vibhute b28fffc84b6c94b5eabf87fe5f4473a4efa2783e m
PIPE-684: updated mosaic overlap factor for VLA mosaic
-
Ajay Vibhute 50303d2902848129e89a6754f9ce07d10835ab8a m
PIPE-684: limiting file name length to 128 chars and changing doquantiles in get_mean_amplitude to boolean
-
Ajay Vibhute 448e3cebc8809e018881fc1c1bd2932918ee4550 m
PIPE-684: minor bugfix
-
Ajay Vibhute 6a224ed8aa9be859ad16b3b71604d7b91b9fe2c6 m
PIPE-684: mosaic gridder for VLA
- pipeline/hif/heuristics/imageparams_base.py (version 6a224ed8aa9be859ad16b3b71604d7b91b9fe2c6) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 6a224ed8aa9be859ad16b3b71604d7b91b9fe2c6) (diffs)
- pipeline/hif/tasks/makeimlist/resultobjects.py (version 6a224ed8aa9be859ad16b3b71604d7b91b9fe2c6) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 6a224ed8aa9be859ad16b3b71604d7b91b9fe2c6) (diffs)
- pipeline/infrastructure/launcher.py (version 6a224ed8aa9be859ad16b3b71604d7b91b9fe2c6) (diffs)
-
Ajay Vibhute 598d18353dc35ed3fd06ce54835d4d342c24aa6c m
PIPE-684: limiting file name length to 128 chars and changing doquantiles in get_mean_amplitude to boolean
-
Ajay Vibhute 09e379ad6933d4a0bc51b3d69e45e2e6c2c56537 m
Merge branch 'main' into PIPE-684-vla-mosaic-gridder-heuristic-with-field-label
-
Ajay Vibhute cb4cd6204af5da6fe6f724251bf791b18b07ff40 m
PIPE-684: Updated the mosaic detection heuristic to use fields belonging to the current band
-
Ajay Vibhute 0834fa4ee0f041a562377cbeae58e9401b14342b m
minor bugfix in filed intent list in mosaic
-
Ajay Vibhute bcd16d38342e5132373cb58cc1a750dae94c9bf5 m
PIPE-684: updated mosaic overlap factor for VLA mosaic
-
Ajay Vibhute bc2f5bd59acd8295df07ecec5a58ef74181c002c m
Merge branch 'PIPE-684-vla-mosaic-gridder-heuristic-with-field-label' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-684-vla-mosaic-gridder-heuristic-with-field-label
-
Ajay Vibhute 981febf61cc29f62f8a3e2c1f9014feebb2b895e m
PIPE-684: moved mosaic detection code to MosaicDetectionHeuristics class and removed is_cluster
- pipeline/hif/heuristics/imageparams_base.py (version 981febf61cc29f62f8a3e2c1f9014feebb2b895e) (diffs)
- pipeline/hif/heuristics/mosaic_detection.py (version 981febf61cc29f62f8a3e2c1f9014feebb2b895e) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version 981febf61cc29f62f8a3e2c1f9014feebb2b895e) (diffs)
- pipeline/hif/tasks/makeimlist/resultobjects.py (version 981febf61cc29f62f8a3e2c1f9014feebb2b895e) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 981febf61cc29f62f8a3e2c1f9014feebb2b895e) (diffs)
- pipeline/infrastructure/launcher.py (version 981febf61cc29f62f8a3e2c1f9014feebb2b895e) (diffs)
-
Rui Xue 5fd865d10e51c45bbfbb54f1fe556a7e17930e63 m
Merge branch 'main' into PIPE-684-vla-mosaic-gridder-heuristic-with-field-label
-
Ajay Vibhute 552aad7503e53a638fc033916e80c733e17cd9ac m
PIPE-684: minor bugfix
-
Ajay Vibhute b45cb718487df0940c472669157c439408932d43 m
PIPE-684: mosaic gridder for VLA
- pipeline/hif/heuristics/imageparams_base.py (version b45cb718487df0940c472669157c439408932d43) (diffs)
- pipeline/hif/tasks/makeimlist/makeimlist.py (version b45cb718487df0940c472669157c439408932d43) (diffs)
- pipeline/hif/tasks/makeimlist/resultobjects.py (version b45cb718487df0940c472669157c439408932d43) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version b45cb718487df0940c472669157c439408932d43) (diffs)
- pipeline/infrastructure/launcher.py (version b45cb718487df0940c472669157c439408932d43) (diffs)