Code commits
Pipeline
-
Rui Xue ee58e080236d14cb7c8fa5d57e3258a3d3996131
Merge remote-tracking branch 'origin/main' into PIPE-2901-add-commentary-explanations-into-hifa-heursitics-snr-code
-
Rui Xue 5dead9ae807422078ab5ba32dacd80165f625251 m
Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
Merge in PIPE/pipeline from unit-test-vlass2026 to main
* commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
PIPE-2940: Add Pixi environment definitions for the PL2026 development
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026. -
Rui Xue 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m
Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
* commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability: -
Rui Xue 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
-
Takeshi Nakazato 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m
Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
* commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
move channel axis label upward slightly
added note to docstring for add_channel_axis
PIPE-2894 always display channel axis to sparse profile map -
Kristin Berry 465285e01b87f372c957660f993a467c2b67a264 m
Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
* commit '84610e456d06c5b0b695a098e974859674ecf063':
PIPE-2985: Update bullet-points to use - rather than o
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects -
Kristin Berry 84610e456d06c5b0b695a098e974859674ecf063 m
PIPE-2985: Update bullet-points to use - rather than o
-
Rui Xue 86fc31bbafba3c8bef51d393fa16ca193a2a57f2 m
Pull request #1744: PIPE-2916/PIPE-2986: Fix the offset search limit by using half of the cutout image size; improve observing_run handling in hif_transformimagedata
Merge in PIPE/pipeline from PIPE-2916-fix-field-selection-limit to main
* commit '42735b2555f8e61818dca1abd0914d087009175a':
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
PIPE-2916: Fix the offset search limit by using half of the cutout image size. -
Rui Xue 42735b2555f8e61818dca1abd0914d087009175a m
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
-
Vincent Geers 94268aa24af2f9c7d36c4f45214750b9f14ae682 m
Pull request #1660: PIPE-2689: add new residual phase offset QA scores to hifa_diffgaincal
Merge in PIPE/pipeline from PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals to main
* commit '26306aec824fa25e46796a8667050d46ab51879f':
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
PIPE-2689: Update scores for poor and elevated cases to lower severity
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
PIPE-2689: Fix to take the max of the absolute value rather than abs val of the max and incorporate B2B offset solution diferences into score.
PIPE-2689: Fix loop over all antennas per timestamp to instead loop over a list of unique antennas
PIPE-2689: update hifa_diffgaincal QA to refactor step that generates a consolidated QA message.
PIPE-2689: update hifa_diffgaincal QA to add new score for residual diffgain phase offsets. -
Kristin Berry bfbbaa0368fe900908701bbb32276f319be535df m
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
- pipeline/h/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
-
Rui Xue c803738bb10600e6c981f04299977d89b71acdb9 m
Pull request #1747: PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
Merge in PIPE/pipeline from PIPE-2947-restrict-scipy-versions to main
* commit '0d175efa4b8737eb989c29f85733e0c8d38bc953':
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+ -
Ajay Vibhute 10433a340af5e4fa2481a549357eb38720420103 m
Pull request #1746: PIPE-2987: changing log level of message to 'info'
Merge in PIPE/pipeline from PIPE-2987-set-log-level-to-info-for-message-in-phasecenter_to_skycoord to main
* commit '0af3f3f8f1ef7bae96e03951988831d580ff1d44':
PIPE-2987: changing log level of message to 'info' -
Rui Xue 0d4b78ef40cd78e712540ef858a07e5c821a9c4b m
Pull request #1739: PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
Merge in PIPE/pipeline from PIPE-2980-save-context-snapshot-before-weblog-rendering-for-loglevel-debug-model to main
* commit 'f4c6fb9eb954108ac509c86af0d1d8791bce9645':
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug -
Rui Xue d9b21b61a46e2b5984530ce12c589bfcbf4805cd m
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
-
Rui Xue 0d175efa4b8737eb989c29f85733e0c8d38bc953 m
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
-
Kristin Berry 5129aacd04c5b51be9953b76172fb17ae994225f m
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
-
Ajay Vibhute 0af3f3f8f1ef7bae96e03951988831d580ff1d44 m
PIPE-2987: changing log level of message to 'info'
-
Rui Xue 59c8188f469ff3a13e3cf13514ca275405dbc0e4 m
PIPE-2940: Add Pixi environment definitions for the PL2026 development
-
Rui Xue 14c61f65845bec6b84e4aa229f8adadce7dfed1f m
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
-
Kristin Berry 135cf97804064a13bedd459633f8849061b6ca0a m
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
- docs/source/develdocmd/DeveloperDocumentation.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/develdocmd/ways_to_run_the_pipeline.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/notebooks/context.ipynb (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/infrastructure/new_pipeline_task/verify_new_pipeline_task.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
-
Rui Xue 1d80cb40e721b7ec87c4ee7faa63260e0f4a79c9 m
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
-
Rui Xue 7be8cb4542002e053347059bf832b9641c32ddf1 m
PIPE-2916: Fix the offset search limit by using half of the cutout image size.
-
Rui Xue ff81a69f88b19bde5acbec5fcc55c199e98bf8fc m
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
-
Rui Xue 5d766135d6e53fcaf6a8587471448022205f7311 m
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
-
Kristin Berry 26306aec824fa25e46796a8667050d46ab51879f m
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
-
Ajay Vibhute 1fc30b1c7ac18ecd77610ee3ccc15b190fcba272 m
Pull request #1705: PIPE-2580: QA score for hifv_testBPdcals
Merge in PIPE/pipeline from PIPE-2580-hifv_testbpdcals-qa-criteria to main
* commit '218b1b17a9dfa015c33d1ea932d343cdaa7ab02a':
PIPE-2580: included bad refant/s in the weblog message
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
PIPE-2580: added applies_to to the QA scores
PIPE-2580: returning score 1.0 when everything is fine, renamed ref_ant to refant, and used SCORE_THRESHOLD_ERROR instead of hardcoded 0.3
PIPE-2580: QA score for hifv_testBPdcals -
Luke Maud 0db75813d36a22ccde45d9ae528f82bc1dca112b m
Pull request #1723: PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic
Merge in PIPE/pipeline from PIPE-2915-stop-hifa_diffgaincal-crashing-if-the-first-diffgain-scan-group-set-is-fully-flagged to main
* commit 'ebfc12707e30e2ab90b53f0e6464d67912cf99bd':
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic -
Rui Xue f4c6fb9eb954108ac509c86af0d1d8791bce9645 m
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
-
Rui Xue 31e86a1d7c971cb9da5283a724b8b03d673745d0 m
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
-
Rui Xue 448be2c8aed741f59ac62b3667bc83c98fc73c5b m
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
-
Ajay Vibhute 60282b613ca7ba9625a300f1a4e25433803d6a0d m
Pull request #1713: PIPE-2166: potentially switch to doquantiles=False in visstat in hifa_polcal
Merge in PIPE/pipeline from PIPE-2166-potentially-switch-to-doquantiles-false-in-visstat-in-hifa_polcal to main
* commit '85d71ca40e6beb946daa6d00d757782c79edca31':
PIPE-2166: removed continue
PIPE-2166: removed extra whitespace
PIPE-2166: code cleanup
PIPE-2166: setting doquantiles= False in visstat cal in imageparams_vla
PIPE-2166: setting doquantiles to False in visstat -
Rui Xue 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6 m
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
-
Rui Xue 8a0f7c3bf61b6a94b352e2d27b5db421574d7add m
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
- Remove temporary file handling.
- Use `ia.histograms` for histogram calculation. -
Ajay Vibhute ab0dadfb1323e2029711307cbd0f0163aea0ba5f m
Pull request #1728: PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
Merge in PIPE/pipeline from PIPE-2881-vlass-phasecenter-in-parameter-list-format-flexibility to main
* commit '13743f4c6175651be5e562d7b23bb078c6d69d67':
PIPE-2881: adding unit tests for phasecenter_to_skycoord
PIPE-2881: moved angle units to the top of module
PIPE-2881:Fix dd.mm.ss Dec parsing
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing -
Shawn Booth 197e7c19f83ffb1ba9b1dbd7c6e80ebe07a97858 m
Pull request #1735: PIPE-2142: Turn back on skipped test
Merge in PIPE/pipeline from pipe-2142-turn-on-selfcal-test to main
* commit '05b8cc54d4747ea1828827faf3dca5fa478f90ac':
PIPE-2142: removed redundant test and switched new test to use previous results file
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge -
Shawn Booth 05b8cc54d4747ea1828827faf3dca5fa478f90ac m
PIPE-2142: removed redundant test and switched new test to use previous results file
-
Shawn Booth f6fde5f01f168ff49193277bc45624a9c5d816e6 m
PIPE-2142: turned back on test_13A_537__restore__cont_cube_selfcal__regression pending merge of pipeline-testdata merge
-
Rui Xue 9ced50c5939dce02f1b0b571ef9ccdcae59533db m
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
-
Rui Xue 1021a12af545145f4d575bcc69f6f5c524c9318d m
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
- Modify build-gh-pages.yml to trigger on changes to `environment*.yml`
- Update env-setup-run-template.yml to allow dynamic conda environment file input
- Adjust test-unit.yml to support multiple conda environments and update artifact naming logic
- Refine apisummary.rst to correct module references
- Add `new environment_vlass2026.yml` for specific pipeline dependencies of VLASS-PL2026- .github/workflows/build-gh-pages.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/env-setup-run-template.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/test-unit.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- docs/source/apisummary.rst (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- environment_vlass2026.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
-
Rui Xue 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43 m
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
-
Rui Xue 515cc8fead5706b41830d6faae65ababe418a545 m
Pull request #1734: PIPE-2738: reverse the broken change made in ca3e7a
Merge in PIPE/pipeline from PIPE-2738-hotpatch-for-state-classes to main
* commit '7d5d223acafa8e4278783226adbf21dbf4568913':
PIPE-2738: reverse the broken change made in ca3e7a -
Rui Xue 7d5d223acafa8e4278783226adbf21dbf4568913 m
PIPE-2738: reverse the broken change made in ca3e7a
-
Takeshi Nakazato 3a599a4f0e1e027e7f556d83ea70f672836bf335 m
move channel axis label upward slightly
-
Takeshi Nakazato f0f64bcdf812d8198d1c62dfe5fd779c245e73c9 m
added note to docstring for add_channel_axis
-
Hajime Ezawa 6ad5949781a7b027ba60466ac9c2ea714caca04f m
Pull request #1731: PIPE-2491 skip manipulating ms weight column
Merge in PIPE/pipeline from PIPE-2491-skip-manipulating-ms-weight-column to main
* commit '2629116b177f236e2e9ae2652632e49b5ccd3b46':
PIPE-2491: add 'updateweight=True' to sdbaseline call in baseline/worker.py
PIPE-2491: remove weighting.py and related codes -
Takeshi Nakazato 9d26316d3f9be62fb3470dba9aac87e3cb77f95d m
Merge branch 'main' into PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map
-
Rui Xue ff4645b0f586a177f12bacff5c759c9c830fa9a0 m
Pull request #1714: PIPE-2738: Additional Documentation Improvements
Merge in PIPE/pipeline from docs-additional-improvements to main
* commit 'a746207f192669f3b9d78e47b4e952b11f8bbc17':
PIPE-1883: Refactor CSS and update documentation for improved clarity and consistency
PIPE-1883: Update descriptions and styling in `modular.rst` and `custom_theme.css` for improved readability and consistency.
PIPE-1883: Improve `Conda` environment setup documentation with detailed installation steps and usage patterns for `Pipeline`.
PIPE-1883: Improve documentation for the `launcher` module and `Context` class
PIPE-1883: Add interface overview section with input/output diagram
PIPE-1883: Refactor class docstrings for consistency and clarity across multiple domain classes
PIPE-1883/PIPE-2292: Remove temporary hard-coded release version string for the PL2025 release prep from `conf.py`
PIPE-1793: Update pipeline_tests.md to clarify regression tests and add instructions for running tests in an mpicasa session -
Rui Xue a746207f192669f3b9d78e47b4e952b11f8bbc17 m
Merge remote-tracking branch 'origin/main' into docs-additional-improvements
Resolve conflicts in:
- `docs/source/develdocmd/pipeline_tests.md` -
Kristin Berry 17413edf54594d80572f508ffd183efc5fa76fa5 m
PIPE-2689: Update scores for poor and elevated cases to lower severity
-
Shawn Booth 1bd603f02b7ec81b6349411fdf74b0633d927082 m
Pull request #1696: PIPE-2127: Exit pipeline when both primary and backup flux service queries fail in hifa_importdata
Merge in PIPE/pipeline from PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the to main
* commit 'e9a2fcd7945a3af6708b1a220d1b53158d22e3f7':
PIPE-2127: changed test_get_fluxes_both_fail_fallbacks to look for warning logs instead of error logs
PIPE-2127: modified fail message for score_fluxservice to indicate the PL exited
PIPE-2127: removed the sys.exit call in the task in favor of the results.tb traceback error handling method; created almaimportdata_test.py for unit tests to exercise flux retrieval use cases
PIPE-2127: changed behavior when both primary and backup test flux queries fail to exit the pipeline -
Joshua Hoskins 58d8102b96d38d9635faf49e9c5ec3eb5965b836 m
Pull request #1726: Make change to fix log message error.
Merge in PIPE/pipeline from PIPE-2920-wrong-unit-in-the-log-message-reporting-max-separation-of-pointing-outlier to main
* commit 'e32bd5023c14c5a9cd139f7d0d55680ffa555bd3':
Make change to fix log message error. -
Joshua Hoskins 6de114add3b8b59e3b4af833b72805b0230585a6 m
Pull request #1715: PIPE-1781 tier 0 parallelization of hsd atmcor
Merge in PIPE/pipeline from PIPE-1781-tier-0-parallelization-of-hsd_atmcor to main
* commit 'e70da25205a3b4f7c4e74657ddfaf162c37121b1':
Remove cli code that is no longer needed.
Remove comment at the request of Takeshi.
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
Make .mailmap, .gitignore, and .dockerignore match main
Revert .mailmap, .gitignore, .dockerignore
Small syntax change to trigger push.
Add parallel input to the hsd_atmcor(...) task
Removed commented out code that I missed.
Bring testing repo up to date.
Change default class call for hsd_atmcor to HpcSDATMCorrection(...) -
Shawn Booth e9a2fcd7945a3af6708b1a220d1b53158d22e3f7 m
Merge remote-tracking branch 'origin/main' into PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the
-
Shawn Booth c76b657b6c2c3fba6a30f13990b6e35936b38932 m
Pull request #1684: PIPE-1840/PIPE-2142/PIPE-2503/PIPE-2778/PIPE-2875: Refactor of Pipeline Test Suite
Merge in PIPE/pipeline from test-suite-refactor to main
* commit 'ed893888cdcd425710540706bda323bcf477c4d3': (34 commits)
fixed indentation issue in docstring
improved tests/testing_utils.py file per CoPilot code review, including adding type hints, error handling, and string formatting
skipped additional test requiring test repo update
added skip markers to tests using new data that is not yet merged into test repo
added unhandled exceptions in recipereducer.py:run_named_tasks; added initialization of public attributes for PipelineTester
implemented improvements per CoPilot code review, including docstring fixes, consolidation of duplicated code, better error handling, and more robust string matching
PIPE-2778: removed defunct OphA missing spws tests; added marks to spw_mapping_missing_spws test
PIPE-2778: added new test spw_mapping_missing_spws to test mixed spw names and missing spws between datasets
PIPE-2875: reverted configuration functions to conftest.py and removed now defunct plugins file
PIPE-2503: changed dataset and recipe used for B2B test, requiring change to test name to test_2023_1_00228_S__uid___A002_X1199f9e_X7c24__procedure_hifa_calimage_diffgain__regression
PIPE-2503: add fast ALMA IF test test_2022_1_000017_CSV__uid___A002_Xff99e1_X15e4f__procedure_hifa_cal_diffgain__regression for B2B testing
PIPE-2875: updated pyproject.toml to be consistent with documentation
PIPE-2778: removed unnecessary information from docstring and updated code to more modern standards
PIPE-2778: added _execute_task helper to unify task execution (logging, exception handling, traceback check); added run_named_tasks public helper to execute an ordered list of tasks (initializes context, runs tasks, saves context); refactored reduce to use _execute_task, eliminating duplicated try/except + traceback logic; preserves early return on unhandled exceptions and stage exit semantics
PIPE-2503: added fast alma test for polcal+imaging
PIPE-2875: added line separation in _auto_mark function for clarity and changed conditionals to prevent double marks
PIPE-2875: fixed inline documentation to remove reference to now deleted regression_tester.py
PIPE-2875: Removed marks automatically added with pytest_plugins.py; updated inline documentation and improved code consistency and naming conventions; moved Nobeyama tests to separate test file
PIPE-2875: moved pytest configuration functions from conftest.py to pipeline/pytest_plugins.py to allow for importing from CASA
PIPE-2778: updated pipeline_tests.md documentation to include component tests
... -
Shawn Booth ed893888cdcd425710540706bda323bcf477c4d3 m
fixed indentation issue in docstring
-
Ajay Vibhute 2f2683c339095b33b25a2eb8a43c05f361d64bb0 m
Pull request #1730: PIPE-2934: Remove duplicate code and code cleanup
Merge in PIPE/pipeline from PIPE-2934-remove-the-seemingly-redundant-helper-functions-in-htmlrrenderer.py-after-pipe-2307 to main
* commit 'e4fd72e6a2138b07d841b0f3de23cf11f190268e':
PIPE-2934: Remove duplicate code and code cleanup -
Shawn Booth 6d6eae206995598e211d4690036fe6fa1e688c79 m
improved tests/testing_utils.py file per CoPilot code review, including adding type hints, error handling, and string formatting
-
Shawn Booth 3f484808d7653c8549ea07d2ddff738f55dd5882 m
skipped additional test requiring test repo update
-
Shawn Booth c992b9855fe6390c08710a78321da32c7b598a6d m
PIPE-2127: changed test_get_fluxes_both_fail_fallbacks to look for warning logs instead of error logs
-
Ajay Vibhute 13743f4c6175651be5e562d7b23bb078c6d69d67 m
PIPE-2881: adding unit tests for phasecenter_to_skycoord
-
Ajay Vibhute 0f9d16ac253918947417a122057f29b8ec0051cb m
PIPE-2881: moved angle units to the top of module
-
Shawn Booth 76d9cf5dd43452712dbd90fde41c7ac8bc520f3e m
Merge remote-tracking branch 'origin/main' into PIPE-2127-in-hifa_importdata-when-dbservice-true-and-both-test-queries-fail-then-halt-the
-
Ajay Vibhute 218b1b17a9dfa015c33d1ea932d343cdaa7ab02a m
PIPE-2580: included bad refant/s in the weblog message
-
Joshua Hoskins e70da25205a3b4f7c4e74657ddfaf162c37121b1 m
Remove cli code that is no longer needed.
-
Joshua Hoskins 9c5dd54b746a0074fc62d493087967ff8ced6e0d m
Remove comment at the request of Takeshi.
-
Joshua Hoskins 3ad65e68e4d8985515bbdc70d2c84930eb5c6590 m
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
-
Joshua Hoskins c81d89c3a3af03d43b4637e88e943a0c941092e4 m
Make .mailmap, .gitignore, and .dockerignore match main [now with .dockerignore]
-
Joshua Hoskins 3f7ca1cd94bfadf4d69011be779dcf4819f4b88b m
Make .mailmap, .gitignore, and .dockerignore match main
-
Joshua Hoskins 4b993582ca0aef7810ffc2e7ee05a61bdb282dd4 m
Revert .mailmap, .gitignore, .dockerignore
-
Ajay Vibhute e4fd72e6a2138b07d841b0f3de23cf11f190268e m
PIPE-2934: Remove duplicate code and code cleanup
-
Rui Xue 350d7136e1863a6a549fb250ad56f262f7e072b8 m
Pull request #1725: PIPE-2935: Add GitHub Copilot custom instructions for the Pipeline Python development guidelines
Merge in PIPE/pipeline from PIPE-2935-add-custom-copilot-instructions to main
* commit 'df4f30ec0e0b34d9f2452b05c5fd29f33a309932':
PIPE-2935: fixed a typo
PIPE-2935: Add GitHub Copilot custom instructions for the Pipeline Python development guidelines -
Kristin Berry 4239a5f7ddad996c33ef10cd107a9c7454e40e38 m
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
-
Kristin Berry 2111b7a919fc24bd9fe02c1f2448ccbab1f94c39 m
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
-
Shawn Booth c03987165109bd02a9d30954b9972f788938184f m
added skip markers to tests using new data that is not yet merged into test repo
-
Shawn Booth d6dcbcdc5732a090c094af580bb8544ca882589a m
Merge remote-tracking branch 'origin/main' into test-suite-refactor
-
Rui Xue 705866c55085ef0f95c1017fdc22b2eff9b272a3 m
Pull request #1599: PIPE-2752/PIPE-2753/PIPE-1421: improve compatibility for data without target intents e.g calsurvey
Merge in PIPE/pipeline from PIPE-2752-improve-compatibility-for-data-without-target-intents-e.g-calsurvey to main
* commit '896906166551cd3976fe26360627713a8b391bd0':
PIPE-2752: Apply docstring and edge-case-handling suggestions from CoPilot code review
PIPE-1421: Update the calsurvey regression test to use raw ASDM input.
PIPE-2752: Fix issues of attempting to access/accept non-existent caltables in `hifa_timegaincal`.
PIPE-2752: Fix issue of attempting to use non-existent caltables in `hifa_gfluxscale`.
PIPE-2752: Fix issue of attempting to register non-existent caltables into the local context in `hifa_gfluxscaleflag`.
PIPE-2752: Only proceed with SNR calculations for calapps with caltables successfully created by `CASA/gaincal`.
PIPE-2752: preserve the input order after deduplication.
PIPE-2752: fix a typo in a debugging message.
PIPE-2752: additional updates to handle cal-only MSes.
PIPE-2752: fallback to BANDPASS spws for gaincalSNR qa assessment in `hifa_gfluxscale`.
PIPE-2752: re-enable the calsurvey regression test.
PIPE-2725: add fallbacks for `TsysPerAntennaChart` calapp selection in case where the 'TARGET' intent is absent in data.
PIPE-2753: handle the edge case where SOURCE.xml includes spws not present in MSes.
PIPE-2752: improve the compatibility of `hif_applycal`, `hifa_flagdata`, and `hif_timegaincal`, to data without the `TARGET` intent.
PIPE-2753: fix an edge-case bug when querying/importing online flux catalogue results, if the imported data are MSes without SOUCE.xml. -
Rui Xue <r-xue@users.noreply.github.com> 896906166551cd3976fe26360627713a8b391bd0 m
PIPE-2752: Apply docstring and edge-case-handling suggestions from CoPilot code review
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>- pipeline/hifa/tasks/fluxscale/qa.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
- pipeline/hifa/tasks/gaincal/timegaincal.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
- pipeline/hifa/tasks/spwphaseup/spwphaseup.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
- pipeline/qa/scorecalculator.py (version 896906166551cd3976fe26360627713a8b391bd0) (diffs)
-
Ajay Vibhute 40fe06c3ef18abd6a9b2ab5481498f7e1faa12a6 m
PIPE-2881:Fix dd.mm.ss Dec parsing
-
Ajay Vibhute 386bd5480dc36495baccb07e649a9b0d0922b72a m
PIPE-2881: Add support for implicit and explicit units in phasecentre parsing
-
Hajime Ezawa 2629116b177f236e2e9ae2652632e49b5ccd3b46 m
PIPE-2491: add 'updateweight=True' to sdbaseline call in baseline/worker.py
-
Hajime Ezawa d7d095d28d66a5a16f1c00e56d94d3bf08475ef1 m
PIPE-2491: remove weighting.py and related codes
-
Joshua Hoskins a96ad230cb095efc3ba3c0ab30f9533b11b58c71 m
Merge branch 'main' into PIPE-1781-tier-0-parallelization-of-hsd_atmcor
# Conflicts:
# pipeline/hsd/cli/hsd_atmcor.py -
Joshua Hoskins c7b39a12b490ed35f36f466343b10bef103cea95 m
Small syntax change to trigger push.
-
Shawn Booth e1c51f13a9f7dd23e09bc957641c7b23aa646be1 m
added unhandled exceptions in recipereducer.py:run_named_tasks; added initialization of public attributes for PipelineTester
-
Shawn Booth 960f093db3673a924455395af3c073b4e0873bee m
implemented improvements per CoPilot code review, including docstring fixes, consolidation of duplicated code, better error handling, and more robust string matching
- conftest.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- pipeline/recipereducer.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/component/component_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/fast/alma_sd_fast_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/fast/vlass_fast_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/slow/conftest.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/regression/slow/vlass_slow_test.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
- tests/testing_utils.py (version 960f093db3673a924455395af3c073b4e0873bee) (diffs)
-
Shawn Booth 9e48a363c9f9826df022734016dc2bd334ebbb2e m
Merge remote-tracking branch 'origin/main' into test-suite-refactor
-
Kana Sugimoto 71899cd59a29303253c1ab3d8f6c75a871ca07b6 m
Pull request #1706: PIPE-2791 clone for main hsd applycal ms name should be located after preamble of the plots
Merge in PIPE/pipeline from PIPE-2791-clone-for-main-hsd_applycal-ms-name-should-be-located-after-preamble-of-the-plots to main
* commit '1e1e971978117aff4780053120b80076fd1e3bf3':
PIPE-2791: removed an unused variable, uv_max, from mako context.
PIPE-2791: removed unused codes in hsdn_restoredata.mako.
PIPE-2791: removed unnecessary 'if' statements in ms_preable.
PIPE-2791: Remove the definition and use 'contains_single_dish' in importdata.mako.
PIPE-2791: changed MS indipendent description of plots from ms_preable to preable. -
Joshua Hoskins 91d663d23b6a1cb9baf055742b38949c95210ff4 m
Merge remote-tracking branch 'origin/PIPE-1781-tier-0-parallelization-of-hsd_atmcor' into PIPE-1781-tier-0-parallelization-of-hsd_atmcor
-
Joshua Hoskins fc76a5d6eda77f9270837025b24cb2962aca57e7 m
Add parallel input to the hsd_atmcor(...) task
-
Takeshi Nakazato 4d26e9806f4963cb529fa490af25b0bcab1be550 m
PIPE-2894 always display channel axis to sparse profile map
-
Rui Xue 993acf26d83229d9f81e77c923cd9e2c077823c8 m
Merge remote-tracking branch 'origin/main' into docs-additional-improvements
-
Rui Xue 833271bbb1d972b3671dfc3f18350fdd76733ee2 m
Pull request #1717: PIPE-2930: Refactor region file handling in `edit_pybdsf_islands` function and update deprecated `np.in1d` uses to `np.isin` for improved clarity and performance
Merge in PIPE/pipeline from PIPE-2930-compatibility-with-numpy-2.4.0 to main
* commit '4b7a0913c57f2e2594e44ace55e72045a0d43622':
PIPE-2930: Improve the performance of `np.isin` in `Syspower` by using `assume_unique=True`; update requirements to maintain numpy version compatibility below 2.4
PIPE-2930: Refactor region file handling in `edit_pybdsf_islands` function and update deprecated `np.in1d` uses to `np.isin` for improved clarity and performance -
Rui Xue 4b7a0913c57f2e2594e44ace55e72045a0d43622 m
PIPE-2930: Improve the performance of `np.isin` in `Syspower` by using `assume_unique=True`; update requirements to maintain numpy version compatibility below 2.4
-
Rui Xue 4bfe628a21ba5326db983bd1ee7fc2fe7c3b3c60 m
PIPE-1883: Refactor CSS and update documentation for improved clarity and consistency
-
Joshua Hoskins e32bd5023c14c5a9cd139f7d0d55680ffa555bd3 m
Make change to fix log message error.
-
Rui Xue 874a3955c3fe2a61a7bdda048227cf7e0f7cc90b m
PIPE-1883: Update descriptions and styling in `modular.rst` and `custom_theme.css` for improved readability and consistency.
-
Rui Xue 9435fb76f2e54a5a2a2115a80c50a4eac375769d m
PIPE-1883: Improve `Conda` environment setup documentation with detailed installation steps and usage patterns for `Pipeline`.
-
Ajay Vibhute df4f30ec0e0b34d9f2452b05c5fd29f33a309932 m
PIPE-2935: fixed a typo
-
Kristin Berry dd25bef4d004e947656e5c2caf4125cb76d397b6 m
Merge branch 'main' of ssh://open-bitbucket.nrao.edu:7999/pipe/pipeline into PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals