Code commits
Pipeline
-
Rui Xue 605c2acddcfc5ae7dbf6cb59c903677259aeb7c0
Merge remote-tracking branch 'origin/main' into PIPE-2941-refactor-pipeline-auto_selfcal-code-to-better-match-structure-of-gh-auto_selfcal-in
-
Remy Indebetouw 3dd2dbdadc6deee2b97f34951d888bd4d45158ad m
Pull request #1898: PIPE-3163: reinstate a fallback for when tsys is not taken on every target to plot the closest target-mapped tsys field.
Merge in PIPE/pipeline from PIPE-3163-source-pointings-plots-missing-for-multi-target-datasets to main
* commit '63d27a50e125fb013f04590846b0ecb57b31339d':
PIPE-3163: Fix field-level deduplication in tsysfieldmap
PIPE-3163: Refactor `select_tsys_fields` to return single best-matching field
I don't know how the pytest is set up, just trying to get this done since the dev. is not available.
added debugging log messages about multiple tsys fields fixed function name that broke the test
typo
reinstate a fallback, for when tsys is not taken on every target, to plot all the other target mapped tsys fields. -
Rui Xue 63d27a50e125fb013f04590846b0ecb57b31339d m
PIPE-3163: Fix field-level deduplication in tsysfieldmap
- `get_tsys_fields_for_intent` now returns an insertion-ordered list[str]
instead of a set, ensuring reproducible output
- Fix f() to deduplicate at the field ID level, not the whole
comma-separated string level -
Rui Xue 27753479c2122ad6297b0c79919ef3d603d442f1 m
PIPE-3163: Refactor `select_tsys_fields` to return single best-matching field
- Rename `select_tsys_fields` back to `select_tsys_field`; return Field | None
instead of list[Field] / raising LookupError
- Implement nearest-field fallback (angular separation) replacing the
previous "return all fields" approach
- Update `plot_tsys_scans` to handle `None` return gracefully
- Fix tests: add per-case gainfield mock, add nearest-fallback test case -
Remy Indebetouw 123b10ba26ae1284ee9f165be7d5c4ae6ed72d73 m
I don't know how the pytest is set up, just trying to get this done since the dev. is not available.
-
Remy Indebetouw 17e5a34b0ff469384fce44dacca55659dfc08b21 m
added debugging log messages about multiple tsys fields fixed function name that broke the test
-
Remy Indebetouw 5b51c79645174737c1e709495578732e9007e98f m
typo
-
Remy Indebetouw e5fb2a32cc1c3d6e75dcc8c561712e151f22632c m
reinstate a fallback, for when tsys is not taken on every target, to plot all the other target mapped tsys fields.
-
Cristian Marocico a3186143b7554cd93d50a799eb697b297c5557a3 m
Pull request #1837: PIPE-3101
Merge in PIPE/pipeline from PIPE-3101-refactor-sc-flux to main
* commit '7af6a27670ba0ffdef56181555161e319bc94e4e':
Implemented changes -
Rui Xue fbf19139c1e1be87e01ad7c653534520b6f1bead m
Pull request #1890: PIPE-3164 and PIPE-3156
Merge in PIPE/pipeline from PIPE-3164-hif_findcont-needs-to-have-field-parameter-available to main
* commit 'f5c355fbcb7eaf67b66524cd06fe3b72aa11f21b':
PIPE-3164: Refactor the use of `MakeImListInputs`
PIPE-3164/PIPE-3156: Add `field` parameter to `hif_findcont` in recipe templates
PIPE-3164: Add field selection parameter to `hif_findcont` -
Rui Xue b2ad7f2c4e8f667bc093c4f25271c403aea0189e m
Pull request #1892: PIPE-3118: Update `procedure_hifv_nofluxcal.xml`
Merge in PIPE/pipeline from PIPE-3118-recipe to main
* commit '3542b894c3c105bdec4c869cc155027823822063':
PIPE-3118: Update `procedure_hifv_nofluxcal.xml` -
Rui Xue 54bc70ded7172f5aec51b8216869c6772fe8ede1 m
Pull request #1886: PIPE-3147: Remove mosaic mode QA score from `hif_selfcal`
Merge in PIPE/pipeline from PIPE-3147-remove-mosaic-is-a-new-mode-message-for-selfcal to main
* commit '445261df4db945a799e6eba30dbe8641bb5b328d':
PIPE-3147: Remove mosaic mode QA score from `hif_selfcal` -
Rui Xue 3542b894c3c105bdec4c869cc155027823822063 m
PIPE-3118: Update `procedure_hifv_nofluxcal.xml`
-
Ajay Vibhute be49d0353cdd545efe57d653f84ea8fa866b5917 m
Pull request #1872: PIPE-3046: adding cont.dat file present notification on weblogs
Merge in PIPE/pipeline from PIPE-3046-vla-pipeline-to-issue-a-notification-when-cont.dat-is-applied to main
* commit '641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0':
PIPE-3046: add QA score 1 when cont.dat is used
PIPE-3046: adding cont.dat file present notification on weblogs -
Rui Xue 96038e7ee74c4ac80d657243177bd60c82b8f96a m
Pull request #1841: PIPE-3117/PIPE-3118: Rubin Alert processing workflow
Merge in PIPE/pipeline from PIPE-3117-change-gencal-caltype-gc-to-caltype-gceff-in-hifv_priorcals-update-weblog-to-match to main
* commit '7913169a814c7b5c8a84338718061995550c3551':
PIPE-3117: Rename the test procedure to `procedure_hifv_nofluxcal.xml`
PIPE-3117: Add test recipe `test_procedure_hifv_calimage_cont_fast.xml` for flux-calibrator-free VLA calibration workflow
PIPE-3117: Update caltype in GainCurves from 'gc' to 'gceff' and add 'gceff' mapping in CalFrom
PIPE-3118: Implement flux-calibrator-free mode with solution normalization
PIPE-3117: Change `gencal` caltype from `gc` to `gceff` in `hifv_priorcals` -
Rui Xue f5c355fbcb7eaf67b66524cd06fe3b72aa11f21b m
PIPE-3164: Refactor the use of `MakeImListInputs`
- Refactor `MakeImListInputs` initialization for cleaner parameter passing
- Remove unused `imageparams_factory` import -
Rui Xue 7b80aafbfb96723a51c7d615df546acda5d94ee2 m
PIPE-3164/PIPE-3156: Add `field` parameter to `hif_findcont` in recipe templates
Update ALMA/VLA templates with `field` parameter for `hif_findcont`,
remove `hif_findroi` from ALMA template. -
Rui Xue 09a9d58206d3a9fe6b699c3be81c2d5bd25c3430 m
PIPE-3164: Add field selection parameter to `hif_findcont`
Add `field` parameter to filter continuum finding to specific fields,
forwarded to internal `makeimlist` call. Defaults to all fields if empty.
Fully backward compatible - `target_list` takes precedence if specified. -
Rui Xue 2e06f4cd50e17add733fb06d7d5ae5413bf1b91c m
Pull request #1885: PIPE-3096/PIPE-3157/PIPE-3155
Merge in PIPE/pipeline from PIPE-3096-PIPE-3157-PIPE-3155 to main
* commit '8d9d3c2f7515c5a46d04db5091f79f2a68ccf178':
PIPE-3096: Improve code quality in imageparams heuristics
PIPE-3155: inline findroi channel-to-frequency conversion
PIPE-3155: inline findroi field phase-center extraction
PIPE-3157: Correctly display VLASS non-pbcor image min/max statistics in tclean weblog
PIPE-3096: Re-implement a "pass-through" source name resolution from field selections for ALMA and VLA -
Rui Xue 8d9d3c2f7515c5a46d04db5091f79f2a68ccf178 m
PIPE-3096: Improve code quality in imageparams heuristics
- Fix method signature compatibility: revert `_vislist` to `vislist` in `get_sourcename`
override to maintain base class interface compliance
- Add `ARG002` linter directive to suppress unused parameter warnings
- Rename `field_list` to `normalized_field_list` for clarity (always contains a list)
- Enhance docstring with Args/Returns sections explaining parameter intent -
Hajime Ezawa 81e1d57dea5aae391ffda40e59c00bee283d4f97 m
Pull request #1883: PIPE-3152: apply aggregator and formatter to hsd_skycal QA scores
Merge in PIPE/pipeline from PIPE-3152-hsd_skycal-apply-common-formatter-to-qa-message to main
* commit 'aefca8ab8ad508c3f3ade5c71b7e12591d32df19':
PIPE-3152: additional typo corrections
PIPE-3152: bracket aggregator with try-finally to guarantee the recovery of keys_to_aggregate
PIPE-3152: organize to handle el_threshold
PIPE-3152: type hint correction
PIPE-3152: typo corrections
PIPE-3152: add aggregator to render()
PIPE-3152: simplify QA score generation
PIPE-3152: qascores.py: introduce metric_scores_func, format longmsg if no keys of keys_to_aggregate are empty
PIPE-3152: apply aggregator and formatter to hsd_skycal QA scores -
Hajime Ezawa aefca8ab8ad508c3f3ade5c71b7e12591d32df19 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3152-hsd_skycal-apply-common-formatter-to-qa-message
-
Hajime Ezawa 31378bbc24c9f7dafc741b2e6a1500992e1742a3 m
PIPE-3152: additional typo corrections
-
Hajime Ezawa b9aebbb17635338bb39923410462f156dfecc37b m
PIPE-3152: bracket aggregator with try-finally to guarantee the recovery of keys_to_aggregate
-
Hajime Ezawa e1168f7ddb6682f8bfcb5d15170637f81deaf86f m
PIPE-3152: organize to handle el_threshold
-
Kana Sugimoto 0d86943f0f0ed717bdfb0ace61e5d79b1410a0e7 m
Pull request #1866: PIPE-3109: avoid access to out of bounds array elements in frequency array.
Merge in PIPE/pipeline from PIPE-3109-hsd_imaging-missed_line-plot-was-failed-to-generate-due-to-indexerror to main
* commit '310618f9b22a578b65ed06daa4f9ca0a8d5e8a85':
PIPE-3109 a fix to channel range to take into account of edges.
PIPE-3109: avoid access to out of bounds array elements in frequency array. -
Hajime Ezawa e4a7779945bfff7c8f4157157164023a2b8572b6 m
PIPE-3152: type hint correction
-
Ajay Vibhute 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0 m
PIPE-3046: add QA score 1 when cont.dat is used
- pipeline/hifv/tasks/flagging/qa.py (version 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0) (diffs)
- pipeline/hifv/tasks/statwt/qa.py (version 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0) (diffs)
- pipeline/hifv/templates/checkflag.mako (version 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0) (diffs)
- pipeline/hifv/templates/statwt.mako (version 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0) (diffs)
- pipeline/hifv/templates/vlatargetflag.mako (version 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0) (diffs)
- pipeline/qa/scorecalculator.py (version 641cd86f332b9366cc1dbfc4d52dbd6318a5d7e0) (diffs)
-
Hajime Ezawa ae6b5d4dbccfb62a6eed2fe48c41986a695ec653 m
Pull request #1869: PIPE-3143 hsd k2jycal hsd atmcor hsd blflag aggregate qa message from the same metric with the same
Merge in PIPE/pipeline from PIPE-3143-hsd_k2jycal-hsd_atmcor-hsd_blflag-aggregate-qa-message-from-the-same-metric-with-the-same to main
* commit 'a9531d40cff36ca3013b8b37da6001a40bf974bd':
Applied suggestion
PIPE-3143: fix the bug in scorecalculator.py
PIPE-3143: implement QAScore aggregator and Formatter to hsd_k2jycal, hsd_atmcor, hsd_blflag -
Ajay Vibhute 45818174894f0d347ad39ba59be8fc2ee64119bc m
Pull request #1887: PIPE-3145: changed the log level of the 'no cont.dat found' message to INFO
Merge in PIPE/pipeline from PIPE-3145-suppress-warning-about-lack-of-cont.dat-in-hifv_checkflag-and-hifv_statwt to main
* commit '8e76b663c9252b8922ef760371cea51627b383f8':
PIPE-3145: changed the log level of the 'no cont.dat found' message to INFO -
Hajime Ezawa 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393 m
PIPE-3152: typo corrections
- pipeline/hsd/tasks/applycal/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/atmcor/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/baseline/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/baselineflag/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/exportdata/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/flagging/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/imaging/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/importdata/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/k2jycal/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/skycal/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
- pipeline/hsd/tasks/tsysflag/renderer.py (version 50b0f2d93632cc1a8bdda1d3b7dd7958fc5ed393) (diffs)
-
Takeshi Nakazato fbd3f28dcd354bc8c8186e241d0845ab651b2ce2 m
Pull request #1868: PIPE-3141 hsd imaging channel range set for moment map in lsb data
Merge in PIPE/pipeline from PIPE-3141-hsd_imaging-channel-range-set-for-moment-map-in-lsb-data to main
* commit '019ce018b719b91c44bb0a6ea9ebafb31bd3e0e4':
Set flagged_edges to outcome when manual linewindow is set
simplification of the code
Add restriction on invert_range_list method to the docstring
fix for correct line range
clarify the intention of create_channel_mask method
PIPE-3141 taking into account channel flipping for LSB and edge trimming in the computation of line free channel ranges for moment map -
Takeshi Nakazato 019ce018b719b91c44bb0a6ea9ebafb31bd3e0e4 m
Set flagged_edges to outcome when manual linewindow is set
-
Takeshi Nakazato bebf20f49548116a7ac65e090b224bef464a2694 m
Pull request #1859: PIPE-3129 add antenna attribute to product key
Merge in PIPE/pipeline from PIPE-3129-missing-image-products-in-nro-pipeline to main
* commit 'a6cd114639c09c369021fa41653f0f266bb2d831':
PIPE-3129 add antenna key to product_key_stokes_i as well
PIPE-3129 add antenna attribute to product key -
Takeshi Nakazato a6cd114639c09c369021fa41653f0f266bb2d831 m
Merge branch 'main' into PIPE-3129-missing-image-products-in-nro-pipeline
-
Ajay Vibhute 8e76b663c9252b8922ef760371cea51627b383f8 m
PIPE-3145: changed the log level of the 'no cont.dat found' message to INFO
-
Rui Xue 445261df4db945a799e6eba30dbe8641bb5b328d m
PIPE-3147: Remove mosaic mode QA score from `hif_selfcal`
-
ryanaloomis <ryan.a.loomis@gmail.com> 58bdab88e2a1686d7730123d748f4066d1c35d88 m
PIPE-3155: inline findroi channel-to-frequency conversion
-
ryanaloomis <ryan.a.loomis@gmail.com> 4b113ed9207befa285008c9b5577529a21267f43 m
PIPE-3155: inline findroi field phase-center extraction
-
Rui Xue c5ab86c96cb7ed93104703bf81dba84c8affae1f m
PIPE-3157: Correctly display VLASS non-pbcor image min/max statistics in tclean weblog
- Add `non_pbcor_minmax` field to ImageRow to display non-pb-corrected
image statistics using r.nonpbcor_image_max/min with proper IQUV support
- Rename `pbcor` field to `pbcor_minmax` for consistency and clarity
- Update `tclean.mako`, `vlass_tclean.mako`, and `vlasscube_tclean.mako` templates to use new field names- pipeline/hif/tasks/tclean/renderer.py (version c5ab86c96cb7ed93104703bf81dba84c8affae1f) (diffs)
- pipeline/hif/templates/tclean.mako (version c5ab86c96cb7ed93104703bf81dba84c8affae1f) (diffs)
- pipeline/hif/templates/vlass_tclean.mako (version c5ab86c96cb7ed93104703bf81dba84c8affae1f) (diffs)
- pipeline/hif/templates/vlasscube_tclean.mako (version c5ab86c96cb7ed93104703bf81dba84c8affae1f) (diffs)
-
Rui Xue 8565eb28602c779e145eee7eb6071fd55a6753c4 m
PIPE-3096: Re-implement a "pass-through" source name resolution from field selections for ALMA and VLA
Add a "pass-through" `get_sourcename()` method to ALMA/VLA heuristics to resolve field selections and assign it to Tclean Results.- pipeline/hif/heuristics/imageparams_alma.py (version 8565eb28602c779e145eee7eb6071fd55a6753c4) (diffs)
- pipeline/hif/heuristics/imageparams_vla.py (version 8565eb28602c779e145eee7eb6071fd55a6753c4) (diffs)
- pipeline/hif/tasks/tclean/cleanbase.py (version 8565eb28602c779e145eee7eb6071fd55a6753c4) (diffs)
- pipeline/hif/tasks/tclean/resultobjects.py (version 8565eb28602c779e145eee7eb6071fd55a6753c4) (diffs)
-
Hajime Ezawa 10b2a88794f12464051e2995d906e73c06a89a4f m
PIPE-3152: add aggregator to render()
-
Hajime Ezawa 4651b5ef6886e3418e8411264ee526eb14e54bec m
PIPE-3152: simplify QA score generation
-
Hajime Ezawa f900310b5f5286071ff0706f0460ed35aacba918 m
PIPE-3152: qascores.py: introduce metric_scores_func, format longmsg if no keys of keys_to_aggregate are empty
-
Hajime Ezawa be59b31aa92b04e4638380413a4baf5c12b7e972 m
PIPE-3152: apply aggregator and formatter to hsd_skycal QA scores
-
Luca Di Mascolo 91aa36f13dcdfa8a0ab44d625400e4ca1d9beaf3 m
Pull request #1871: PIPE-2489: replace result.image with imname
Merge in PIPE/pipeline from PIPE-2489-include-multiterm-info-in-the-image-names-reported-in-pipeline_aquareport.xml to main
* commit 'de212a7c6646329da6d6dfc94313c804d5a35e70':
PIPE-2489: replace result.image with imname -
Luca Di Mascolo b4ae1884c4da5eebdc4b85d20286b85862be5c33 m
Pull request #1832: PIPE-2470: add EB IDs list to aquareport
Merge in PIPE/pipeline from PIPE-2470-add-asdm-eb-uids-to-pipeline_aquareport.xml to main
* commit '5cd0a813b05fb813af86c28f3008cb8df54554e7':
PIPE-2470: convert execblock_ids to deduplicated list
PIPE-2470: remove EB sorting from individual *aqua.py files
PIPE-2470: add EB IDs list to aquareport -
Luke Maud 4431a0d494e60da7027980e315333c4aa2c21c11 m
Pull request #1771: PIPE-3006 allow hifa wvrgcalflag to use lowsnr heuristic for gaincal phaseup and bandpass
Merge in PIPE/pipeline from PIPE-3006-allow-hifa_wvrgcalflag-to-use-lowsnr-heuristic-for-gaincal-phaseup-and-bandpass to main
* commit '46040188b5b688af6af3be7a08b33ba3d8694c06':
PIPE-3006: Minor typo fixes; update path references to use ms.basename
PIPE-3006 corrections to pass information combine and solint in subsequent iterations after antenna flags
PIPE-3006 propagate combine spw and solint to all gaincals with and without WVR
PIPE-3006 bandpass to use lowSNR almaphcorrbandpass filter qa_spw_list
PIPE-3006 bandpass to use lowSNR almaphcorrbandpass selects spectralspec common with best scoring spw -
Ryan Loomis aa076a32b10279281486fea98646ac5b833c3411 m
Pull request #1880: PIPE-3151 add hif findroi to alma imaging recipes
Merge in PIPE/pipeline from PIPE-3151-add-hif-findroi-to-alma-imaging-recipes to main
* commit '3c0ffbf59499ce302a08d67209d7aafe1c073bdf': (21 commits)
PIPE-3151: add hif_findroi to ALMA imaging recipes
PIPE-3136: export hif_findroi tar via aux products
PIPE-3149: add ROI.dat placeholders for empty SPWs
PIPE-3149: keep only stitched mosaic cubes in products
PIPE-3149: filter mixed-array findroi imaging inputs
PIPE-3149: clean up hif_findroi metadata and tar accounting
Switch findroi handoff to tar
Rename findroi cube outputs and enable saving
Rename findroi products and schema keys
Package findroi outputs in workdir tarball
Remove overabstraction in findroi
Trim hif_findroi public surface
Align findroi OUS prefix with imaging tasks
Inline remaining findroi metadata helpers
Inline findroi MOUS prefix lookup
Fix findroi OUS prefix source
Remove findroi fallback metadata paths
PIPEREQ-414 Fix findroi plot import
PIPEREQ-414 Refactor findroi into hif task
Fix hifa_findroi task contract
... -
Dirk Muders 3c0ffbf59499ce302a08d67209d7aafe1c073bdf m
Merge remote-tracking branch 'origin/main' into PIPE-3151-add-hif-findroi-to-alma-imaging-recipes
-
ryanaloomis <ryan.a.loomis@gmail.com> 9ad4b0238b9d32c0e7075ff669c618b1f178657c m
PIPE-3151: add hif_findroi to ALMA imaging recipes
- pipeline/recipes/procedure_hifa_calimage.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
- pipeline/recipes/procedure_hifa_calimage_diffgain.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
- pipeline/recipes/procedure_hifa_image.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
- pipeline/recipes/procedure_hifa_polcalimage.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
- pipeline/recipes/procedure_hifa_polcalimage_totalintensity.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
- pipeline/recipes/procedure_hifa_polimage.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
- pipeline/recipes/template_hifa_cubeimage.xml (version 9ad4b0238b9d32c0e7075ff669c618b1f178657c) (diffs)
-
ryanaloomis <ryan.a.loomis@gmail.com> 0dbae07994d13e5f33c9d8aeaa9e310999ef93b9 m
Merge remote-tracking branch 'origin/PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont' into PIPE-3151-add-hif-findroi-to-alma-imaging-recipes
# Conflicts:
# pipeline/infrastructure/utils/imaging.py -
Dirk Muders 691da9fe7689ce896a944518a8693084ac773505 m
Pull request #1860: PIPE-3131 Use intrinsic hif makeimlist call in hif findcont
Merge in PIPE/pipeline from PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont to main
* commit '5a96dd3590e06f3b17a7655bacf9178882cd0e53':
PIPE-3131: Added mosweight to findcont heuristics. Require datacolumn to be set if a vis list is given without a target list.
Applied suggestion
PIPE-3131: Force cheap weighting in coarse findcont
PIPE-3131: Adjust coarse findcont taper factor
PIPE-3131: Added minpix option to hif_makeimlist. Use minpix=64 for the coarse hif_findcont mode.
PIPE-3131: Changed uvtaper to klambda units using the representative frequency.
PIPE-3131: Added uvtaper heuristic. Moved coarse parameter calculation to findcont heuristics class.
PIPE-3131: Implemented initial coarse mode as in PIPEREQ-416.
PIPE-3131: Re-enabled target_list parameter passing. It now no longer defaults to context.clean_list_pending.
PIPE-3131: Added global cont file name initialization.
PIPE-3131: Initial implementation of using an intrinsic hif_makeimlist call. Not yet working. Also edited recipes. -
Dirk Muders 5a96dd3590e06f3b17a7655bacf9178882cd0e53 m
PIPE-3131: Added mosweight to findcont heuristics. Require datacolumn to be set if a vis list is given without a target list.
-
Ryan Loomis f0cb0d94bdd05e31c5a54a56e7ba0855d4ffbfbc m
Applied suggestion
-
Cristian Marocico 74dfe4ec2e06d4117d3ac57dda8d3f1c35e8e536 m
Pull request #1849: PIPE-2553: add hifa_gfluxscale amplitude-time QA metric
Merge in PIPE/pipeline from PIPE-2553-hifa_gfluxscale-amplitude-time-QA-metric to main
* commit '614c006665764d1809832379fede55c9e0c0c053':
PIPE-2553: add hifa_gfluxscale amplitude-time QA metric -
Dirk Muders c3f1b5741b2c960d46154e119a7ea8ac1070a902 m
Merge remote-tracking branch 'origin/main' into PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont
-
Kana Sugimoto 310618f9b22a578b65ed06daa4f9ca0a8d5e8a85 m
PIPE-3109 a fix to channel range to take into account of edges.
-
Hajime Ezawa a9531d40cff36ca3013b8b37da6001a40bf974bd m
Merge branch 'PIPE-3143-hsd_k2jycal-hsd_atmcor-hsd_blflag-aggregate-qa-message-from-the-same-metric-with-the-same' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3143-hsd_k2jycal-hsd_atmcor-hsd_blflag-aggregate-qa-message-from-the-same-metric-with-the-same
-
Takeshi Nakazato 39f98181be7f587a401e1057f65cd44fdf09550f m
Merge branch 'main' into PIPE-3141-hsd_imaging-channel-range-set-for-moment-map-in-lsb-data
-
ryanaloomis <ryan.a.loomis@gmail.com> 504d1945cc5abe4b3fb50c589f3217f745d6c627 m
PIPE-3136: export hif_findroi tar via aux products
-
ryanaloomis <ryan.a.loomis@gmail.com> 383e1e90ac20c7a88cefa1ae4d4bce1648bb272d m
PIPE-3149: add ROI.dat placeholders for empty SPWs
-
ryanaloomis <ryan.a.loomis@gmail.com> 0ea63a99b008905659616b9d0e5c2aa86199346a m
PIPE-3149: keep only stitched mosaic cubes in products
-
ryanaloomis <ryan.a.loomis@gmail.com> 9d91d77ed41057494875ab95d5214486f71a7572 m
PIPE-3149: filter mixed-array findroi imaging inputs
-
ryanaloomis <ryan.a.loomis@gmail.com> 438260f919e73889730c3c1322021d4a295dc420 m
PIPE-3149: clean up hif_findroi metadata and tar accounting
-
Hajime Ezawa a5f15d877d022effdbec94d94057bfa181ce8a80 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3143-hsd_k2jycal-hsd_atmcor-hsd_blflag-aggregate-qa-message-from-the-same-metric-with-the-same
-
Kana Sugimoto 610afeaccf3089c5880b6021d4826439bbc92620 m
Applied suggestion
Thanks for the catch. Actually this may not harm the behavior, but surely it is better to correct. -
Hajime Ezawa a67433e06b8ad173b6124b1d9e5142bc69963dc8 m
Pull request #1867: PIPE-2988 sort qa messages within the same color by associated score
Merge in PIPE/pipeline from PIPE-2988-sort-qa-messages-within-the-same-color-by-associated-score to main
* commit 'e691eb5132324ccfb45296300234d674c7075ae2':
PIPE-2988: clean a garbage
PIPE-2988: use decorator for QA aggregator and sorting
PIPE-2988: clean-up
PIPE-2988 sort QAScores of hsd_exportdata
PIPE-2988 sort QAScores of hsd_k2jycal
PIPE-2988 sort QAScores of hsd_imaging
PIPE-2988 sort QAScores of hsd_blflag
PIPE-2988 sort QAScores of hsd_baseline
PIPE-2988 sort QAScores of hsd_atmcor
PIPE-2988 sort QAScores of hsd_applycal
PIPE-2988 sort QAScores of hsd_skycal
PIPE-2988 sort QAScores of hsd_tsysflag
PIPE-2988 sort QAScores of hsd_flagdata
PIPE-2988 sort QAScores of hsd_importdata -
Takeshi Nakazato e0ea4fe9e88ab81b65be105b394576eba8ff9161 m
simplification of the code
-
Takeshi Nakazato f0bbcafc0483bf6e9a678397798fc4671fdfe390 m
Pull request #1865: PIPE-3138 use representative source taken from SBSummary even if EB doesn't observe it
Merge in PIPE/pipeline from PIPE-3138-aqua-report-contains-more-than-one-isrepresentative-true-target to main
* commit '92b13394ecd486d631ed8630aa8be6e2232cc935':
PIPE-3138 use representative source taken from SBSummary even if EB doesn't observe it -
Hajime Ezawa e691eb5132324ccfb45296300234d674c7075ae2 m
PIPE-2988: clean a garbage
-
Hajime Ezawa 9e1ffc423389e65297e28b91aed8607a3fbe79b6 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-2988-sort-qa-messages-within-the-same-color-by-associated-score
-
Hajime Ezawa e4626cf7cdf871ff42b699d37261d9eeb66809ed m
Pull request #1850: PIPE-3055 hsd applycal aggregate qa message from the same metric with the same score
Merge in PIPE/pipeline from PIPE-3055-hsd_applycal-aggregate-qa-message-from-the-same-metric-with-the-same-score to main
* commit '508719fa22a5031936f1a2e0a5a15addfae1d7d3': (27 commits)
PIPE-3055: correct intent in TargetDataSelection of QAScore 'AmpVsTimePlotQuality'
PIPE-3055: slightly modify qautils.py
PIPE-3055: improve imaging/qa.py
Revert "PIPE-3055: improve imaging/qa.py"
PIPE-3055: improve imaging/qa.py
PIPE-3055: some minor modifications
PIPE-3055: correct docstring of renderer.py
PIPE-3055: improve qautils.py with supplemental info
PIPE-3055: fix sd_applycal_qa.py to follow PEP8
PIPE-3055: improve qa.py to avoid redundancies
PIPE-3055: correct the docstrings
PIPE-3055: bug fix to exclude feature in qautils.py
PIPE-3055: eleminate pol from TargetDataSelection for no XX-YY differences case
PIPE-3055: remove garbage
PIPE-3055: fix the bug in applycal/qa.py
PIPE-3055: slightly improve the shortmsg
PIPE-3055: remove the file irrelevant to Pipeline
PIPE-3055: tentative measures to prevent crashing for some QAScores
PIPE-3055: remove scan='all' from TargetDataSelection applicable to entire data
PIPE-3055: slight changes to optimize shortmsg
... -
Dirk Muders 01a10a944d95bd874e27eee957b9ad8f2cf459c2 m
Merge remote-tracking branch 'origin/main' into PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont
-
Luke Maud c79f0ba71050bacf0005fb504099bfad131a39ed m
Pull request #1864: PIPE-3139 correct code to add phase offset before phaseup and change SNR trigger levels
Merge in PIPE/pipeline from PIPE-3139-correct-missing-phase-offset-phase-solve-for-pipe-2601 to main
* commit 'dabc9a2de4b493ba2f089038935fb9c049eb861a':
PIPE-3139 correct code to add phase offset before phaseup and change SNR trigger levels -
Rui Xue 23668517e8bd08200a5edc8b8d62814a40903d88 m
Pull request #1842: PIPE-3074: Include EB UID in image deduplication key
Merge in PIPE/pipeline from PIPE-3074-in-multi-eb-mouses-for-the-same-check-source-pl2025-exports-imaging-products-for-one-the to main
* commit '3ddc2ef8f573ad41a06945a93436cc97420cb69c':
PIPE-3074: Add `imagename_prefix` to cutout and RMS ImageItems
PIPE-3074: Propagate `imagename_prefix` through `ImageItem` for per-EB products -
Ajay Vibhute 50bf5d052019a60b31a970b3915684ed28b92ca4 m
PIPE-3046: adding cont.dat file present notification on weblogs
- pipeline/hifv/tasks/flagging/checkflag.py (version 50bf5d052019a60b31a970b3915684ed28b92ca4) (diffs)
- pipeline/hifv/tasks/flagging/targetflag.py (version 50bf5d052019a60b31a970b3915684ed28b92ca4) (diffs)
- pipeline/hifv/tasks/statwt/statwt.py (version 50bf5d052019a60b31a970b3915684ed28b92ca4) (diffs)
- pipeline/hifv/templates/checkflag.mako (version 50bf5d052019a60b31a970b3915684ed28b92ca4) (diffs)
- pipeline/hifv/templates/statwt.mako (version 50bf5d052019a60b31a970b3915684ed28b92ca4) (diffs)
- pipeline/hifv/templates/vlatargetflag.mako (version 50bf5d052019a60b31a970b3915684ed28b92ca4) (diffs)
-
Dirk Muders 4a49076549f9cbae538254207e48f4ef7097bebf m
Merge remote-tracking branch 'origin/main' into PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont
-
Rui Xue d27df87bd0eb34fb3ce71bfbfc8f38a041edf59f m
Pull request #1853: PIPE-3128
Merge in PIPE/pipeline from PIPE-3128-polarization-calibration-imaging-repbw-stokes-iquv-image-not-inheriting-cleanmask-and to main
* commit 'f9ded2cde48b05139f176936511a63f36c8d7a88':
PIPE-3128: Fix CleanTargetInfo specmode key mismatch for repBW imaging
PIPE-3096: Fix the 'field' name value mismatch in `CleanTargetInfo` -
Ilsang Yoon 5d29697925179e03f19005ed5846cfc581075e8e m
Pull request #1847: PIPE-3026: I updated the score/PIPE-3028: I updated the QA message
Merge in PIPE/pipeline from PIPE-3026-update-qa-score-for-phase-offset-outliers-in-unmapped-spws to main
* commit '482b4e46deab5ae30083d567ccd08fae5e6d5c4e':
PIPE-3026/3028: update the code style
PIPE-3026: I updated the score/PIPE-3028: I updated the QA message -
Dirk Muders 1e6b2262bf02c2ac29e5e8d9b7efe3209b51461c m
Merge remote-tracking branch 'origin/main' into PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont
-
Dirk Muders 0199f3a67825f32f63d28bb09bfaae319dc182b1 m
Pull request #1846: PIPE-3057 / PIPE-3053: Modify uvcontsub and IF imaging for new MS frames
Merge in PIPE/pipeline from PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames to main
* commit '5c610c885dd2b5760246f65f709426e49bce774f':
PIPE-3003: Rolled back VLA flagging template name changes.
PIPE-3003: Added new MS name extensions to sanitize method. Use actual MS name root to get default flagging task templates.
PIPE-3057: Fixed contfilehandler test.
PIPE-3003: Make `MstransformResults.output_data_type` optional for VLA compatibility
PIPE-3057/PIPE-3053: Changed all "_topo" methods and variable names to "_ms_frame". Changed advisechansel calls to use the MS native frequency frame as desired frame to convert to.
PIPE-3003: Removed duplicate lines.
PIPE-3003: Changed 'cont+line' phrasing to 'transformed'.
PIPE-3003: Fixed empty results return use case.
PIPE-3003: Added ephemeris object handling code.
PIPE-3003: Edited doc strings and log messages. Attempt to return more useful empty result (not yet working).
PIPE-3003: Remove inputs parameters that CASA's mstransform does not understand.
PIPE-3003: Added DataType.RAW to 'processing_data_types' to prepare for out-of-sequence call handling.
PIPE-3003: Fixed bug (previous instead of new MS name) in creating '*.flagtargetstemplate.txt' files for new MSes in hif_mstransform and hif_uvcontsub.
PIPE-3003: Implemented new hif_mstransform mode to create imaging MSes with re-gridding to the native frequency frame (SOURCE still to be excluded). Changed 'processing_data_type' to 'processing_data_types' in all pipeline tasks.
PIPE-3003: Added new imaging datatypes.
PIPE-2955: Consolidate parameter cleanup for unsupported inputs to `casatasks/mstransform`
PIPE-2955: Add `per_spw` option to `hif_mstransform` for splitting MSes on each spectral window -
Hajime Ezawa 8f05b8f68bfd28dde6045b9b43809fa63c661750 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-2988-sort-qa-messages-within-the-same-color-by-associated-score
-
Takeshi Nakazato 92b13394ecd486d631ed8630aa8be6e2232cc935 m
Merge branch 'main' into PIPE-3138-aqua-report-contains-more-than-one-isrepresentative-true-target
-
Hajime Ezawa 508719fa22a5031936f1a2e0a5a15addfae1d7d3 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3055-hsd_applycal-aggregate-qa-message-from-the-same-metric-with-the-same-score
-
ryanaloomis <ryan.a.loomis@gmail.com> 372d17a15c80881596f87b7b3b457275030b6f5e m
PIPE-3131: Force cheap weighting in coarse findcont
-
ryanaloomis <ryan.a.loomis@gmail.com> f6a9b65ad38a1a64c81c6b43114af337bec1ac96 m
PIPE-3131: Adjust coarse findcont taper factor
-
Hajime Ezawa 52801dda78b5751a456ddc1444b7bb6d6db0f204 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3143-hsd_k2jycal-hsd_atmcor-hsd_blflag-aggregate-qa-message-from-the-same-metric-with-the-same
-
Hajime Ezawa e94b4e7b17de9a4c893a514984b456f6ec17e1d7 m
PIPE-3143: fix the bug in scorecalculator.py
-
Takeshi Nakazato 520dad92d55b2ef2ce1f415caef9b2f3a9973fdd m
Pull request #1870: PIPE-3146 set status to None if dbservice is False
Merge in PIPE/pipeline from PIPE-3146-hsd_k2jycal-weblog-shows-as-dbaccess-has-been-done-even-when-dbservice-false to main
* commit '8a367a99ebb3444f89b51a0b3a0a51c887fc84f1':
clarify the intention to set status None
PIPE-3146 set status to None if dbservice is False -
Takeshi Nakazato 8a367a99ebb3444f89b51a0b3a0a51c887fc84f1 m
clarify the intention to set status None
-
Takeshi Nakazato 094ee97d2bc458abb274db99e35e30fbd60a5bc8 m
PIPE-3146 set status to None if dbservice is False
-
Dirk Muders 5c610c885dd2b5760246f65f709426e49bce774f m
Merge branch 'PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames
-
Dirk Muders 24896f9a345d22a094663e2f6491a7f0518a1964 m
Merge remote-tracking branch 'origin/main' into PIPE-3057_PIPE-3053_Modify_uvcontsub_and_IF_imaging_for_new_MS_frames
-
Dirk Muders 1168c9cbf9336a4bddba356f6ad59de9bf80eb14 m
Merge remote-tracking branch 'origin/main' into PIPE-3131_Use_intrinsic_hif_makeimlist_call_in_hif_findcont
-
ilsangyoon <yoonilsang.umass@gmail.com> 482b4e46deab5ae30083d567ccd08fae5e6d5c4e m
PIPE-3026/3028: update the code style
-
Ilsang Yoon 12cc5686d469e9a3b173a675b6fdec17a3c7f5b3 m
Pull request #1835: PIPE-3042: updating QA score
Merge in PIPE/pipeline from PIPE-3042-change-qa-aggregation-function-for-check-source-fitting-in-hif_makeimages to main
* commit '9b70ce19197e30b21ab5a527cebcc0e221f66e26':
PIPE-3042: second commit after the code reviewer's feedback
PIPE-3042: updating QA score -
Hajime Ezawa 7377702e04eb58841ddbbd39e2f03cfcd6e1b905 m
PIPE-3143: implement QAScore aggregator and Formatter to hsd_k2jycal, hsd_atmcor, hsd_blflag
- pipeline/hsd/tasks/atmcor/qa.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
- pipeline/hsd/tasks/atmcor/renderer.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
- pipeline/hsd/tasks/baselineflag/qa.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
- pipeline/hsd/tasks/baselineflag/renderer.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
- pipeline/hsd/tasks/k2jycal/qa.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
- pipeline/hsd/tasks/k2jycal/renderer.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
- pipeline/qa/scorecalculator.py (version 7377702e04eb58841ddbbd39e2f03cfcd6e1b905) (diffs)
-
Hajime Ezawa 5c8a5ea8f52ffdb80c9ba6f05ec604b6e9290fbc m
Merge remote-tracking branch 'origin/PIPE-2988-sort-qa-messages-within-the-same-color-by-associated-score' into PIPE-3143-hsd_k2jycal-hsd_atmcor-hsd_blflag-aggregate-qa-message-from-the-same-metric-with-the-same
-
Hajime Ezawa 7ee2790d5ea1726d51104a9e29db315ff21417ab m
PIPE-2988: use decorator for QA aggregator and sorting
- pipeline/hsd/tasks/applycal/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/atmcor/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/baseline/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/baselineflag/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/common/qautils.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/exportdata/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/flagging/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/imaging/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/importdata/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/k2jycal/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/skycal/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)
- pipeline/hsd/tasks/tsysflag/renderer.py (version 7ee2790d5ea1726d51104a9e29db315ff21417ab) (diffs)