Code commits
Pipeline
-
Rui Xue 73998b946595418d179ed619454b197430a0ab5c
Merge remote-tracking branch 'origin/main' into PIPE-2014-improve-timetracker-and-weblog-timing-stats
Resolved conflicts:
- `pipeline/infrastructure/basetask.py`
- `pipeline/infrastructure/renderer/htmlrenderer.py` -
Kristin Berry 465285e01b87f372c957660f993a467c2b67a264 m
Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
* commit '84610e456d06c5b0b695a098e974859674ecf063':
PIPE-2985: Update bullet-points to use - rather than o
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects -
Kristin Berry 84610e456d06c5b0b695a098e974859674ecf063 m
PIPE-2985: Update bullet-points to use - rather than o
-
Rui Xue 86fc31bbafba3c8bef51d393fa16ca193a2a57f2 m
Pull request #1744: PIPE-2916/PIPE-2986: Fix the offset search limit by using half of the cutout image size; improve observing_run handling in hif_transformimagedata
Merge in PIPE/pipeline from PIPE-2916-fix-field-selection-limit to main
* commit '42735b2555f8e61818dca1abd0914d087009175a':
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
PIPE-2916: Fix the offset search limit by using half of the cutout image size. -
Rui Xue 42735b2555f8e61818dca1abd0914d087009175a m
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
-
Vincent Geers 94268aa24af2f9c7d36c4f45214750b9f14ae682 m
Pull request #1660: PIPE-2689: add new residual phase offset QA scores to hifa_diffgaincal
Merge in PIPE/pipeline from PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals to main
* commit '26306aec824fa25e46796a8667050d46ab51879f':
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
PIPE-2689: Update scores for poor and elevated cases to lower severity
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
PIPE-2689: Fix to take the max of the absolute value rather than abs val of the max and incorporate B2B offset solution diferences into score.
PIPE-2689: Fix loop over all antennas per timestamp to instead loop over a list of unique antennas
PIPE-2689: update hifa_diffgaincal QA to refactor step that generates a consolidated QA message.
PIPE-2689: update hifa_diffgaincal QA to add new score for residual diffgain phase offsets. -
Kristin Berry bfbbaa0368fe900908701bbb32276f319be535df m
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
- pipeline/h/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
-
Rui Xue c803738bb10600e6c981f04299977d89b71acdb9 m
Pull request #1747: PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
Merge in PIPE/pipeline from PIPE-2947-restrict-scipy-versions to main
* commit '0d175efa4b8737eb989c29f85733e0c8d38bc953':
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+ -
Ajay Vibhute 10433a340af5e4fa2481a549357eb38720420103 m
Pull request #1746: PIPE-2987: changing log level of message to 'info'
Merge in PIPE/pipeline from PIPE-2987-set-log-level-to-info-for-message-in-phasecenter_to_skycoord to main
* commit '0af3f3f8f1ef7bae96e03951988831d580ff1d44':
PIPE-2987: changing log level of message to 'info' -
Rui Xue 0d4b78ef40cd78e712540ef858a07e5c821a9c4b m
Pull request #1739: PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
Merge in PIPE/pipeline from PIPE-2980-save-context-snapshot-before-weblog-rendering-for-loglevel-debug-model to main
* commit 'f4c6fb9eb954108ac509c86af0d1d8791bce9645':
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug -
Rui Xue 0d175efa4b8737eb989c29f85733e0c8d38bc953 m
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
-
Kristin Berry 5129aacd04c5b51be9953b76172fb17ae994225f m
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
-
Ajay Vibhute 0af3f3f8f1ef7bae96e03951988831d580ff1d44 m
PIPE-2987: changing log level of message to 'info'
-
Rui Xue 14c61f65845bec6b84e4aa229f8adadce7dfed1f m
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
-
Kristin Berry 135cf97804064a13bedd459633f8849061b6ca0a m
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
- docs/source/develdocmd/DeveloperDocumentation.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/develdocmd/ways_to_run_the_pipeline.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/notebooks/context.ipynb (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/infrastructure/new_pipeline_task/verify_new_pipeline_task.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
-
Rui Xue 1d80cb40e721b7ec87c4ee7faa63260e0f4a79c9 m
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
-
Rui Xue 7be8cb4542002e053347059bf832b9641c32ddf1 m
PIPE-2916: Fix the offset search limit by using half of the cutout image size.
-
Kristin Berry 26306aec824fa25e46796a8667050d46ab51879f m
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
-
Ajay Vibhute 1fc30b1c7ac18ecd77610ee3ccc15b190fcba272 m
Pull request #1705: PIPE-2580: QA score for hifv_testBPdcals
Merge in PIPE/pipeline from PIPE-2580-hifv_testbpdcals-qa-criteria to main
* commit '218b1b17a9dfa015c33d1ea932d343cdaa7ab02a':
PIPE-2580: included bad refant/s in the weblog message
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
PIPE-2580: added applies_to to the QA scores
PIPE-2580: returning score 1.0 when everything is fine, renamed ref_ant to refant, and used SCORE_THRESHOLD_ERROR instead of hardcoded 0.3
PIPE-2580: QA score for hifv_testBPdcals -
Luke Maud 0db75813d36a22ccde45d9ae528f82bc1dca112b m
Pull request #1723: PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic
Merge in PIPE/pipeline from PIPE-2915-stop-hifa_diffgaincal-crashing-if-the-first-diffgain-scan-group-set-is-fully-flagged to main
* commit 'ebfc12707e30e2ab90b53f0e6464d67912cf99bd':
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic -
Rui Xue f4c6fb9eb954108ac509c86af0d1d8791bce9645 m
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
-
Ajay Vibhute 60282b613ca7ba9625a300f1a4e25433803d6a0d m
Pull request #1713: PIPE-2166: potentially switch to doquantiles=False in visstat in hifa_polcal
Merge in PIPE/pipeline from PIPE-2166-potentially-switch-to-doquantiles-false-in-visstat-in-hifa_polcal to main
* commit '85d71ca40e6beb946daa6d00d757782c79edca31':
PIPE-2166: removed continue
PIPE-2166: removed extra whitespace
PIPE-2166: code cleanup
PIPE-2166: setting doquantiles= False in visstat cal in imageparams_vla
PIPE-2166: setting doquantiles to False in visstat -
Ajay Vibhute ab0dadfb1323e2029711307cbd0f0163aea0ba5f m
Pull request #1728: PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
Merge in PIPE/pipeline from PIPE-2881-vlass-phasecenter-in-parameter-list-format-flexibility to main
* commit '13743f4c6175651be5e562d7b23bb078c6d69d67':
PIPE-2881: adding unit tests for phasecenter_to_skycoord
PIPE-2881: moved angle units to the top of module
PIPE-2881:Fix dd.mm.ss Dec parsing
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing -
Shawn Booth 197e7c19f83ffb1ba9b1dbd7c6e80ebe07a97858 m
Pull request #1735: PIPE-2142: Turn back on skipped test
Merge in PIPE/pipeline from pipe-2142-turn-on-selfcal-test to main
* commit '05b8cc54d4747ea1828827faf3dca5fa478f90ac':
PIPE-2142: removed redundant test and switched new test to use previous results file
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge -
Shawn Booth 05b8cc54d4747ea1828827faf3dca5fa478f90ac m
PIPE-2142: removed redundant test and switched new test to use previous results file
-
Shawn Booth f6fde5f01f168ff49193277bc45624a9c5d816e6 m
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge
-
Rui Xue 515cc8fead5706b41830d6faae65ababe418a545 m
Pull request #1734: PIPE-2738: reverse the broken change made in ca3e7a
Merge in PIPE/pipeline from PIPE-2738-hotpatch-for-state-classes to main
* commit '7d5d223acafa8e4278783226adbf21dbf4568913':
PIPE-2738: reverse the broken change made in ca3e7a -
Rui Xue 7d5d223acafa8e4278783226adbf21dbf4568913 m
PIPE-2738: reverse the broken change made in ca3e7a
-
Hajime Ezawa 6ad5949781a7b027ba60466ac9c2ea714caca04f m
Pull request #1731: PIPE-2491 skip manipulating ms weight column
Merge in PIPE/pipeline from PIPE-2491-skip-manipulating-ms-weight-column to main
* commit '2629116b177f236e2e9ae2652632e49b5ccd3b46':
PIPE-2491: add 'updateweight=True' to sdbaseline call in baseline/worker.py
PIPE-2491: remove weighting.py and related codes -
Rui Xue ff4645b0f586a177f12bacff5c759c9c830fa9a0 m
Pull request #1714: PIPE-2738: Additional Documentation Improvements
Merge in PIPE/pipeline from docs-additional-improvements to main
* commit 'a746207f192669f3b9d78e47b4e952b11f8bbc17':
PIPE-1883: Refactor CSS and update documentation for improved clarity and consistency
PIPE-1883: Update descriptions and styling in `modular.rst` and `custom_theme.css` for improved readability and consistency.
PIPE-1883: Improve `Conda` environment setup documentation with detailed installation steps and usage patterns for `Pipeline`.
PIPE-1883: Improve documentation for the `launcher` module and `Context` class
PIPE-1883: Add interface overview section with input/output diagram
PIPE-1883: Refactor class docstrings for consistency and clarity across multiple domain classes
PIPE-1883/PIPE-2292: Remove temporary hard-coded release version string for the PL2025 release prep from `conf.py`
PIPE-1793: Update pipeline_tests.md to clarify regression tests and add instructions for running tests in an mpicasa session -
Rui Xue a746207f192669f3b9d78e47b4e952b11f8bbc17 m
Merge remote-tracking branch 'origin/main' into docs-additional-improvements
Resolve conflicts in:
- `docs/source/develdocmd/pipeline_tests.md` -
Kristin Berry 17413edf54594d80572f508ffd183efc5fa76fa5 m
PIPE-2689: Update scores for poor and elevated cases to lower severity
-
Shawn Booth 1bd603f02b7ec81b6349411fdf74b0633d927082 m
Pull request #1696: PIPE-2127: Exit pipeline when both primary and backup flux service queries fail in hifa_importdata
Merge in PIPE/pipeline from PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the to main
* commit 'e9a2fcd7945a3af6708b1a220d1b53158d22e3f7':
PIPE-2127: changed test_get_fluxes_both_fail_fallbacks to look for warning logs instead of error logs
PIPE-2127: modified fail message for score_fluxservice to indicate the PL exited
PIPE-2127: removed the sys.exit call in the task in favor of the results.tb traceback error handling method; created almaimportdata_test.py for unit tests to exercise flux retrieval use cases
PIPE-2127: changed behavior when both primary and backup test flux queries fail to exit the pipeline -
Joshua Hoskins 58d8102b96d38d9635faf49e9c5ec3eb5965b836 m
Pull request #1726: Make change to fix log message error.
Merge in PIPE/pipeline from PIPE-2920-wrong-unit-in-the-log-message-reporting-max-separation-of-pointing-outlier to main
* commit 'e32bd5023c14c5a9cd139f7d0d55680ffa555bd3':
Make change to fix log message error. -
Joshua Hoskins 6de114add3b8b59e3b4af833b72805b0230585a6 m
Pull request #1715: PIPE-1781 tier 0 parallelization of hsd atmcor
Merge in PIPE/pipeline from PIPE-1781-tier-0-parallelization-of-hsd_atmcor to main
* commit 'e70da25205a3b4f7c4e74657ddfaf162c37121b1':
Remove cli code that is no longer needed.
Remove comment at the request of Takeshi.
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
Make .mailmap, .gitignore, and .dockerignore match main
Revert .mailmap, .gitignore, .dockerignore
Small syntax change to trigger push.
Add parallel input to the hsd_atmcor(...) task
Removed commented out code that I missed.
Bring testing repo up to date.
Change default class call for hsd_atmcor to HpcSDATMCorrection(...) -
Shawn Booth e9a2fcd7945a3af6708b1a220d1b53158d22e3f7 m
Merge remote-tracking branch 'origin/main' into PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the
-
Shawn Booth c76b657b6c2c3fba6a30f13990b6e35936b38932 m
Pull request #1684: PIPE-1840/PIPE-2142/PIPE-2503/PIPE-2778/PIPE-2875: Refactor of Pipeline Test Suite
Merge in PIPE/pipeline from test-suite-refactor to main
* commit 'ed893888cdcd425710540706bda323bcf477c4d3': (34 commits)
fixed indentation issue in docstring
improved tests/testing_utils.py file per CoPilot code review, including adding type hints, error handling, and string formatting
skipped additional test requiring test repo update
added skip markers to tests using new data that is not yet merged into test repo
added unhandled exceptions in recipereducer.py:run_named_tasks; added initialization of public attributes for PipelineTester
implemented improvements per CoPilot code review, including docstring fixes, consolidation of duplicated code, better error handling, and more robust string matching
PIPE-2778: removed defunct OphA missing spws tests; added marks to spw_mapping_missing_spws test
PIPE-2778: added new test spw_mapping_missing_spws to test mixed spw names and missing spws between datasets
PIPE-2875: reverted configuration functions to conftest.py and removed now defunct plugins file
PIPE-2503: changed dataset and recipe used for B2B test, requiring change to test name to test_2023_1_00228_S__uid___A002_X1199f9e_X7c24__procedure_hifa_calimage_diffgain__regression
PIPE-2503: add fast ALMA IF test test_2022_1_000017_CSV__uid___A002_Xff99e1_X15e4f__procedure_hifa_cal_diffgain__regression for B2B testing
PIPE-2875: updated pyproject.toml to be consistent with documentation
PIPE-2778: removed unnecessary information from docstring and updated code to more modern standards
PIPE-2778: added _execute_task helper to unify task execution (logging, exception handling, traceback check); added run_named_tasks public helper to execute an ordered list of tasks (initializes context, runs tasks, saves context); refactored reduce to use _execute_task, eliminating duplicated try/except + traceback logic; preserves early return on unhandled exceptions and stage exit semantics
PIPE-2503: added fast alma test for polcal+imaging
PIPE-2875: added line separation in _auto_mark function for clarity and changed conditionals to prevent double marks
PIPE-2875: fixed inline documentation to remove reference to now deleted regression_tester.py
PIPE-2875: Removed marks automatically added with pytest_plugins.py; updated inline documentation and improved code consistency and naming conventions; moved Nobeyama tests to separate test file
PIPE-2875: moved pytest configuration functions from conftest.py to pipeline/pytest_plugins.py to allow for importing from CASA
PIPE-2778: updated pipeline_tests.md documentation to include component tests
... -
Shawn Booth ed893888cdcd425710540706bda323bcf477c4d3 m
fixed indentation issue in docstring
-
Ajay Vibhute 2f2683c339095b33b25a2eb8a43c05f361d64bb0 m
Pull request #1730: PIPE-2934: Remove duplicate code and code cleanup
Merge in PIPE/pipeline from PIPE-2934-remove-the-seemingly-redundant-helper-functions-in-htmlrrenderer.py-after-pipe-2307 to main
* commit 'e4fd72e6a2138b07d841b0f3de23cf11f190268e':
PIPE-2934: Remove duplicate code and code cleanup -
Shawn Booth 6d6eae206995598e211d4690036fe6fa1e688c79 m
improved tests/testing_utils.py file per CoPilot code review, including adding type hints, error handling, and string formatting
-
Shawn Booth 3f484808d7653c8549ea07d2ddff738f55dd5882 m
skipped additional test requiring test repo update
-
Shawn Booth c992b9855fe6390c08710a78321da32c7b598a6d m
PIPE-2127: changed test_get_fluxes_both_fail_fallbacks to look for warning logs instead of error logs
-
Ajay Vibhute 13743f4c6175651be5e562d7b23bb078c6d69d67 m
PIPE-2881: adding unit tests for phasecenter_to_skycoord
-
Ajay Vibhute 0f9d16ac253918947417a122057f29b8ec0051cb m
PIPE-2881: moved angle units to the top of module
-
Shawn Booth 76d9cf5dd43452712dbd90fde41c7ac8bc520f3e m
Merge remote-tracking branch 'origin/main' into PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the
-
Ajay Vibhute 218b1b17a9dfa015c33d1ea932d343cdaa7ab02a m
PIPE-2580: included bad refant/s in the weblog message
-
Joshua Hoskins e70da25205a3b4f7c4e74657ddfaf162c37121b1 m
Remove cli code that is no longer needed.
-
Joshua Hoskins 9c5dd54b746a0074fc62d493087967ff8ced6e0d m
Remove comment at the request of Takeshi.
-
Joshua Hoskins 3ad65e68e4d8985515bbdc70d2c84930eb5c6590 m
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
-
Joshua Hoskins c81d89c3a3af03d43b4637e88e943a0c941092e4 m
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
-
Joshua Hoskins 3f7ca1cd94bfadf4d69011be779dcf4819f4b88b m
Make .mailmap, .gitignore, and .dockerignore match main
-
Joshua Hoskins 4b993582ca0aef7810ffc2e7ee05a61bdb282dd4 m
Revert .mailmap, .gitignore, .dockerignore
-
Ajay Vibhute e4fd72e6a2138b07d841b0f3de23cf11f190268e m
PIPE-2934: Remove duplicate code and code cleanup
-
Rui Xue 350d7136e1863a6a549fb250ad56f262f7e072b8 m
Pull request #1725: PIPE-2935: Add GitHub Copilot custom instructions for the Pipeline Python development guidelines
Merge in PIPE/pipeline from PIPE-2935-add-custom-copilot-instructions to main
* commit 'df4f30ec0e0b34d9f2452b05c5fd29f33a309932':
PIPE-2935: fixed a typo
PIPE-2935: Add GitHub Copilot custom instructions for the Pipeline Python development guidelines -
Kristin Berry 4239a5f7ddad996c33ef10cd107a9c7454e40e38 m
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
-
Kristin Berry 2111b7a919fc24bd9fe02c1f2448ccbab1f94c39 m
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
-
Shawn Booth c03987165109bd02a9d30954b9972f788938184f m
added skip markers to tests using new data that is not yet merged into test repo
-
Shawn Booth d6dcbcdc5732a090c094af580bb8544ca882589a m
Merge remote-tracking branch 'origin/main' into test-suite-refactor
-
Rui Xue 705866c55085ef0f95c1017fdc22b2eff9b272a3 m
Pull request #1599: PIPE-2752/PIPE-2753/PIPE-1421: improve compatibility for data without target intents e.g calsurvey
Merge in PIPE/pipeline from PIPE-2752-improve-compatibility-for-data-without-target-intents-e.g-calsurvey to main
* commit '896906166551cd3976fe26360627713a8b391bd0':
PIPE-2752: Apply docstring and edge-case-handling suggestions from CoPilot code review
PIPE-1421: Update the calsurvey regression test to use raw ASDM input.
PIPE-2752: Fix issues of attempting to access/accept non-existent caltables in `hifa_timegaincal`.
PIPE-2752: Fix issue of attempting to use non-existent caltables in `hifa_gfluxscale`.
PIPE-2752: Fix issue of attempting to register non-existent caltables into the local context in `hifa_gfluxscaleflag`.
PIPE-2752: Only proceed with SNR calculations for calapps with caltables successfully created by `CASA/gaincal`.
PIPE-2752: preserve the input order after deduplication.
PIPE-2752: fix a typo in a debugging message.
PIPE-2752: additional updates to handle cal-only MSes.
PIPE-2752: fallback to BANDPASS spws for gaincalSNR qa assessment in `hifa_gfluxscale`.
PIPE-2752: re-enable the calsurvey regression test.
PIPE-2725: add fallbacks for `TsysPerAntennaChart` calapp selection in case where the 'TARGET' intent is absent in data.
PIPE-2753: handle the edge case where SOURCE.xml includes spws not present in MSes.
PIPE-2752: improve the compatibility of `hif_applycal`, `hifa_flagdata`, and `hif_timegaincal`, to data without the `TARGET` intent.
PIPE-2753: fix an edge-case bug when querying/importing online flux catalogue results, if the imported data are MSes without SOUCE.xml. -
Rui Xue <r-xue@users.noreply.github.com> 896906166551cd3976fe26360627713a8b391bd0 m
PIPE-2752: Apply docstring and edge-case-handling suggestions from CoPilot code review
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>- pipeline/hifa/tasks/fluxscale/qa.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
- pipeline/hifa/tasks/gaincal/timegaincal.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
- pipeline/hifa/tasks/spwphaseup/spwphaseup.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
- pipeline/qa/scorecalculator.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
-
Ajay Vibhute 40fe06c3ef18abd6a9b2ab5481498f7e1faa12a6 m
PIPE-2881:Fix dd.mm.ss Dec parsing
-
Ajay Vibhute 386bd5480dc36495baccb07e649a9b0d0922b72a m
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
-
Hajime Ezawa 2629116b177f236e2e9ae2652632e49b5ccd3b46 m
PIPE-2491: add 'updateweight=True' to sdbaseline call in baseline/worker.py
-
Hajime Ezawa d7d095d28d66a5a16f1c00e56d94d3bf08475ef1 m
PIPE-2491: remove weighting.py and related codes
-
Joshua Hoskins a96ad230cb095efc3ba3c0ab30f9533b11b58c71 m
Merge branch 'main' into PIPE-1781-tier-0-parallelization-of-hsd_atmcor
# Conflicts:
# pipeline/hsd/cli/hsd_atmcor.py -
Joshua Hoskins c7b39a12b490ed35f36f466343b10bef103cea95 m
Small syntax change to trigger push.
-
Shawn Booth e1c51f13a9f7dd23e09bc957641c7b23aa646be1 m
added unhandled exceptions in recipereducer.py:run_named_tasks; added initialization of public attributes for PipelineTester
-
Shawn Booth 960f093db3673a924455395af3c073b4e0873bee m
implemented improvements per CoPilot code review, including docstring fixes, consolidation of duplicated code, better error handling, and more robust string matching
- conftest.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- pipeline/recipereducer.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/component/component_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/fast/alma_sd_fast_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/fast/vlass_fast_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/slow/conftest.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/slow/vlass_slow_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/testing_utils.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
-
Shawn Booth 9e48a363c9f9826df022734016dc2bd334ebbb2e m
Merge remote-tracking branch 'origin/main' into test-suite-refactor
-
Kana Sugimoto 71899cd59a29303253c1ab3d8f6c75a871ca07b6 m
Pull request #1706: PIPE-2791 clone for main hsd applycal ms name should be located after preamble of the plots
Merge in PIPE/pipeline from PIPE-2791-clone-for-main-hsd_applycal-ms-name-should-be-located-after-preamble-of-the-plots to main
* commit '1e1e971978117aff4780053120b80076fd1e3bf3':
PIPE-2791: removed an unused variable, uv_max, from mako context.
PIPE-2791: removed unused codes in hsdn_restoredata.mako.
PIPE-2791: removed unnecessary 'if' statements in ms_preable.
PIPE-2791: Remove the definition and use 'contains_single_dish' in importdata.mako.
PIPE-2791: changed MS indipendent description of plots from ms_preable to preable. -
Joshua Hoskins 91d663d23b6a1cb9baf055742b38949c95210ff4 m
Merge remote-tracking branch 'origin/PIPE-1781-tier-0-parallelization-of-hsd_atmcor' into PIPE-1781-tier-0-parallelization-of-hsd_atmcor
-
Joshua Hoskins fc76a5d6eda77f9270837025b24cb2962aca57e7 m
Add parallel input to the hsd_atmcor(...) task
-
Rui Xue 993acf26d83229d9f81e77c923cd9e2c077823c8 m
Merge remote-tracking branch 'origin/main' into docs-additional-improvements
-
Rui Xue 833271bbb1d972b3671dfc3f18350fdd76733ee2 m
Pull request #1717: PIPE-2930: Refactor region file handling in `edit_pybdsf_islands` function and update deprecated `np.in1d` uses to `np.isin` for improved clarity and performance
Merge in PIPE/pipeline from PIPE-2930-compatibility-with-numpy-2.4.0 to main
* commit '4b7a0913c57f2e2594e44ace55e72045a0d43622':
PIPE-2930: Improve the performance of `np.isin` in `Syspower` by using `assume_unique=True`; update requirements to maintain numpy version compatibility below 2.4
PIPE-2930: Refactor region file handling in `edit_pybdsf_islands` function and update deprecated `np.in1d` uses to `np.isin` for improved clarity and performance -
Rui Xue 4b7a0913c57f2e2594e44ace55e72045a0d43622 m
PIPE-2930: Improve the performance of `np.isin` in `Syspower` by using `assume_unique=True`; update requirements to maintain numpy version compatibility below 2.4
-
Rui Xue 4bfe628a21ba5326db983bd1ee7fc2fe7c3b3c60 m
PIPE-1883: Refactor CSS and update documentation for improved clarity and consistency
-
Joshua Hoskins e32bd5023c14c5a9cd139f7d0d55680ffa555bd3 m
Make change to fix log message error.
-
Rui Xue 874a3955c3fe2a61a7bdda048227cf7e0f7cc90b m
PIPE-1883: Update descriptions and styling in `modular.rst` and `custom_theme.css` for improved readability and consistency.
-
Rui Xue 9435fb76f2e54a5a2a2115a80c50a4eac375769d m
PIPE-1883: Improve `Conda` environment setup documentation with detailed installation steps and usage patterns for `Pipeline`.
-
Ajay Vibhute df4f30ec0e0b34d9f2452b05c5fd29f33a309932 m
PIPE-2935: fixed a typo
-
Kristin Berry dd25bef4d004e947656e5c2caf4125cb76d397b6 m
Merge branch 'main' of ssh://open-bitbucket.nrao.edu:7999/pipe/pipeline into PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals
-
Ajay Vibhute 85d71ca40e6beb946daa6d00d757782c79edca31 m
PIPE-2166: removed continue
-
Rui Xue ebfc12707e30e2ab90b53f0e6464d67912cf99bd m
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
-
Rui Xue b19bc4f84f48515b860f0a240e4bd3497ff076ce m
PIPE-2935: Add GitHub Copilot custom instructions for the Pipeline Python development guidelines
-
Rui Xue bb63fc2cf2ce4978a08d7bc9c05a7a50d2e7b5ba m
PIPE-1883: Improve documentation for the `launcher` module and `Context` class
-
Rui Xue a60385eb46a6f3cf5b78fa26db7abe39b1871f5c m
PIPE-1883: Add interface overview section with input/output diagram
-
Rui Xue 8217e34fdfa2a7cb3907297f06c5191ac6024e2d m
Merge remote-tracking branch 'origin/main' into docs-additional-improvements:
Resolved conflicts:
* `pipeline/domain/field.py` -
Rui Xue ca3e7a41acd549fddbaab49b70916a7cbe597d1a m
PIPE-1883: Refactor class docstrings for consistency and clarity across multiple domain classes
- pipeline/domain/antenna.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/antennaarray.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/datadescription.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/datatable.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/datatype.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/field.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/measurementset.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/observingrun.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/polarization.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/scan.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/source.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/spectralwindow.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
- pipeline/domain/state.py (version ca3e7a41acd549fddbaab49b70916a7cbe597d1a) (diffs)
-
Rui Xue 115291b1a90f55f59ec7e6e5cb570d9b4e602ea8 m
PIPE-1883/PIPE-2292: Remove temporary hard-coded release version string for the PL2025 release prep from `conf.py`
-
Ajay Vibhute 63f5b436f4d0a0f96a784f46a8b537a87c71e7f3 m
PIPE-2166: removed extra whitespace
-
Ajay Vibhute d1952834822dcb4501d5a815d031a9bdceae59a6 m
PIPE-2166: code cleanup
-
Ajay Vibhute 764a52ed3ed63b1652e7eb261b572dfc835ca142 m
Pull request #1721: PIPE-2933: typeerror-in-hifv_exportvlassdata-when-selfcal_result.caltable-is-none
Merge in PIPE/pipeline from PIPE-2933-typeerror-in-hifv_exportvlassdata-when-selfcal_result.caltable-is-none to main
* commit '6992d52a921dbf8f78f845930f535b6afb9406b1':
PIPE-2933: fixed a bug in return value of applycal
PIPE-2933: fixed a bug causing type error -
Takeshi Nakazato 0063e26c242b1d514a1b7d8877adafb2ba34a7cd m
Pull request #1716: PIPE-2718 address three refactoring suggestions
Merge in PIPE/pipeline from PIPE-2718-refactoring-code-for-pipe-2168 to main
* commit '3ca2241f5a2a1d2faa71e1f6cc8cc01edd07cf3f':
PIPE-2718 address three refactoring suggestions -
Ajay Vibhute 6992d52a921dbf8f78f845930f535b6afb9406b1 m
PIPE-2933: fixed a bug in return value of applycal
-
Ajay Vibhute cbbf75c4ed7672079c58cc735cc40e5cffdffc7d m
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
-
Ajay Vibhute 8918baa6b2cf2442a9b8b2af64d5ffed346e2a59 m
PIPE-2933: fixed a bug causing type error
-
Shawn Booth bb1a48e90576de173198678c6230ffd9da47afd6 m
Pull request #1533: PIPE-2472: Improvements to zenith angle reporting in weblog and FITS headers
Merge in PIPE/pipeline from PIPE-2472-improvements-to-zenith-angle-reporting-in-weblog-and-fits-headers to main
* commit '90dc00d7c8658bff6e28ae346972f74016d98cb9':
PIPE-2472: improved docstring and type hints for compute_zd_telmjd_for_ms function
PIPE-2472: removed unused astropy import
PIPE-2472: replaced deprecated position correction utilities with CASA Measures framework for zenith distance calculations; updated Field, Analyzealpha, and htmlrenderer modules to use new compute_zenith_distance() utility function; enhanced ZDTELMJDChart with field legends and multi-point support; increased Sky Setup table header font size for visibility and added section headers to clearly distinguish Elevation (All Fields) from Zenith Angle (TARGET Fields Only) data
PIPE-2472: removed unused changes to Scan object and find_sky_center function; changed static method link_obs_to_fields to set_field_zd_telmjd to be more representative of its usage
PIPE-2472: moved ZD and TELMJD descriptions to fits history
PIPE-2472: fixed downstream bug from previous commit; added back rounding of ZD angles
PIPE-2472: removed list assignment in compute_zd_telmjd_for_ms
PIPE-2472: reverted back to using average over median
PIPE-2472: changed zd average to median
PIPE-2472: added average zenith angle and telmjd to the Sky Setup page
PIPE-2472: added center_ra and center_dec parameters and set_sky_center function to Scan object; created multiple new helper functions and custom dictionary types in utils.py
PIPE-2472: replaced plt.plot with plt.scatter to remove connecting lines from plot
PIPE-2472: added zd and telmjd, as well as function to calculate them, to the Field object; created ZDTELMJDChart object for producing zd vs time plot; added min and max zenith angle and TARGET telescope MJD time frame to MS Overview under Sky Setup; added zd vs time plot to Sky Setup Details page; included descriptions of ZD and TELMJD to the FITS header -
Rui Xue a29f3cdfcf16d330ce833c2fcec3cfd7f5988df0 m
Pull request #1719: PIPE-2891: Clear time cache before and after importing ASDMs in `ImportData` tasks
Merge in PIPE/pipeline from PIPE-2891-VLA to main
* commit 'af7445ca19dc283d45a8256619cd7228735b44dc':
PIPE-2891: Clear time cache before and after importing ASDMs in `ImportData` tasks -
Shawn Booth 6a27c28ab2a922987a78128055c4fc60d5559862 m
Pull request #1703: PIPE-2698/PIPE-2869: cleanup code from merged PR #1678
Merge in PIPE/pipeline from PIPE-2698-code-cleanup to main
* commit '2787cfc263df424641971266334af35aec5fbaea':
PIPE-2698: changed lookup table to use integers as keys and the comparison to exclude all except ALMA; changed comparison of tsys field names to check if it starts with TARGET field name -
Rui Xue af7445ca19dc283d45a8256619cd7228735b44dc m
PIPE-2891: Clear time cache before and after importing ASDMs in `ImportData` tasks