Code commits
Pipeline
-
Luke Maud 73c2dd1ef7a52b32229634b19b59610cd75013d2
PIPE-3016: update merge conflic after PIPE-2903 merged back to branch and fixed lock_refant.py
-
Rui Xue 57e37988e5efa6c75a1e874b66154a64bf0fb28c m
Pull request #1805: PIPE-3077: doc update on regression test, pixi tasks
Merge in PIPE/pipeline from PIPE-3077-isolate-individual-regression-tests-from-casa-stateful-behavior to main
* commit '72a633b55efcf3af84583b240744337865ac7a6b':
PIPE-3077: Remove deprecated environment configuration files for pipeline and pipeline-vlass2026
PIPE-3077: `pyproject.toml` improve comments and move pandoc to docs env
PIPE-3077: Refactor Pixi task documentation for clarity and consistency
PIPE-3077: Update documentation and configuration for running tests with pixi and pytest -
Rui Xue <rx.astro@gmail.com> 72a633b55efcf3af84583b240744337865ac7a6b m
PIPE-3077: Remove deprecated environment configuration files for pipeline and pipeline-vlass2026
-
Rui Xue <rx.astro@gmail.com> 3222b0ed762be0d3baea6bcb0bece7e0235c76ec m
PIPE-3077: `pyproject.toml` improve comments and move pandoc to docs env
- Add inline rationale comments: poppler/imagemagick (Pipeline),
protobuf pin (casaplotms), openmpi-mpicxx (C++ MPI bindings),
nodefaults (not needed in pixi), casa674 indirect deps
- Move pandoc to [tool.pixi.feature.docs] — only needed for doc builds
- Add --junitxml=regression-results.xml to test-regression task
Co-authored-by: Copilot <copilot@github.com> -
Rui Xue <rx.astro@gmail.com> 578d072259b387f9969b6121b5cbf12c630a3725 m
PIPE-3077: Refactor Pixi task documentation for clarity and consistency
Co-authored-by: Copilot <copilot@github.com> -
Rui Xue <rx.astro@gmail.com> de8bdaccb6bbf11018c8bce17185ae3a6fcccd72 m
PIPE-3077: Update documentation and configuration for running tests with pixi and pytest
Co-authored-by: Copilot <copilot@github.com> -
Takeshi Nakazato 60a4c0de699922601dcb4adecc5377495d6b9989 m
Pull request #1762: PIPE-2945 hsd_skycal should not crash if it failed to generate sky caltable for only one
Merge in PIPE/pipeline from PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one to main
* commit '16ce874a58991b45f3955a2b0924440c2e5becae':
Skip generating elevation plot if the data is empty
Bug fix on removing extra files created by plotbandpass
Fix wrong scan number issue in amp vs freq summary plot
Skip computing elevation difference when no valid skycal solution exists
Improvement of warning message
refactoring
Remove obsolete debug log
Simply the implementation
Remove unused class
Refactoring
Fix typo
Error accurate error handling
PIPE-2945 consolidate per-fields sdcal calls into just a single call -
Rui Xue b49d03f06a1a212024a52fada5fa3e60699a3099 m
Pull request #1767: PIPE-2947: Implement NaN handling for `savgol_filter` and update requirements to unpin scipy version
Merge in PIPE/pipeline from PIPE-2947-update-heuristics to main
* commit '0c9b827f1b746ffb8167e59bff1ef6824776157f':
PIPE-2947: Implement NaN handling for `savgol_filter` and update requirements to unpin scipy version -
Rui Xue 0c9b827f1b746ffb8167e59bff1ef6824776157f m
Merge remote-tracking branch 'origin/main' into PIPE-2947-update-heuristics
-
Shawn Booth 5d62817fa7d0d41f848349fcf5ca3d7e2962cc02 m
Pull request #1736: PIPE-1787: Integrating Regression Test Documentation into RTD Source Code
Merge in PIPE/pipeline from integrate-docs-to-source-code to main
* commit 'e72af9e9f6dc3cdcab1f3251c0b9ae662207d915':
PIPE-1787: move table of contents to top of page
PIPE-1787: integrated regression testing instructions from confluence; updated to include information on component and unit tests -
Shawn Booth e72af9e9f6dc3cdcab1f3251c0b9ae662207d915 m
Merge remote-tracking branch 'origin/main' into integrate-docs-to-source-code
-
Takeshi Nakazato 16ce874a58991b45f3955a2b0924440c2e5becae m
Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
-
Takeshi Nakazato 19019e59b38674e3f5a2dcef53abe374862910b4 m
Pull request #1794: PIPE-3001 hsd baseline proper use of virtual real spw id in baseline worker.py
Merge in PIPE/pipeline from PIPE-3001-hsd_baseline-proper-use-of-virtual-real-spw-id-in-baseline-worker.py to main
* commit '72b7331ba1f531a7577dcc2efdfaaeae0dd9dfd7':
harmless change to trigger Bamboo build
Replace string format method with f-string
Update spw-related variable names to indicate they store real spw id
Replace "EB" with more generic word, "MS"
rename spw-related variables to distinguish virtual or real
Fix inconsistent order of the args
Add docstrings to some methods
Update parameter name accordingly
gather fitting configuration log per EB (per worker process)
bug fix on the use of local _wave_number
Remove extra comma
Clearly separate the use of real/virtual spw ids -
Takeshi Nakazato 20c1fde25f0a690cb78314659b1e9a8ed2020392 m
Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
-
Takeshi Nakazato 72b7331ba1f531a7577dcc2efdfaaeae0dd9dfd7 m
harmless change to trigger Bamboo build
-
Takeshi Nakazato 78659804c692531c049fdd943848342283554f73 m
Merge branch 'main' into PIPE-3001-hsd_baseline-proper-use-of-virtual-real-spw-id-in-baseline-worker.py
Co-authored-by: Copilot <copilot@github.com> -
Ryan Loomis d94fb1cb5caf9e7a9169818bb224b1445ad8ba02 m
Pull request #1787: PIPE-2617: make hif_findcont use uvrange
Merge in PIPE/pipeline from PIPE-2617-make-hif_findcont-use-uvrange to main
* commit '803f8d791bb8a562a28f97f032ba7939e678f16d':
PIPE-2617: make hif_findcont use uvrange -
Shawn Booth a1e5544161d269358a369c16ed132a32904a2706 m
Pull request #1724: PIPE-2903 & PIPE-2939: Python Code Modernization, Import Optimization, and Cleanup
Merge in PIPE/pipeline from PIPE-2903-additional-refactoring-items-after-pr-1452 to main
* commit '83fe0c033e0abcb3a7237aa8768681ca58a63e1a':
PIPE-2903: reverted super reference calls to the parent object; changed type of QuantityDict value
PIPE-2903: fix failure introduced at merge
PIPE-2903: removed references to custom dictionaries in the all block that got reintroduced on merge with main
PIPE-2903: fixed docstring reference to the correct Jira ticket
PIPE-2903: removed defunct _cluster_details function replaced by deferred request
Replace naive datetimes with timezone-aware UTC datetimes throughout codebase
PIPE-2903: fixed timezone naive issues by adding UTC timezone
PIPE-2903: gathered all custom CASA type hints into single module casa_types
PIPE-2903: fixes to unit test failures associated with datetime changes from naive to UTC aware
PIPE-2903: converted callable type hint to Callable; removed commented out code and duplicated type hints from docstrings; updated numpy type hints
PIPE-2939: removed defunct pipeline/infrastructure/docutils module
PIPE-2903: updated type hints to use type MaskedArray instead of constructor; fixed inaccurate type hints in hsd/baselineflag; updated several NewType custom variables to use TypedDict; fixed several indentation levels; moved type-hint-only imports into TYPE_CHECKING; replaced Integral with Real for more accurate type hint
PIPE-2903: reverted changes to extern module; reverted several namespace imports that were incorrectly removed; reverted incorrectly moved imports to TYPE_CHECKING
PIPE-2903: moved more type-hint-only imports to TYPE_CHECKING; removed several unused imports; fixed several unbound/undefined variable errors; replaced deprecated imports with functionally-equivalent imports; fixed invalid type forms; added import of collections.abc library
PIPE-2903: moved more type-hint-only imports into TYPE_CHECKING; replaced typing module shims with direct module imports
PIPE-2903: removed deprecated datetime.utcnow function; migrated generic type hints to appropriate modules per PEP585; switched abstract base class usage per PEP 3119
PIPE-2903: moved many type-hint-only imports into TYPE_CHECKING; added future annotations and removed many string literals from type hints; updated many old style docstrings; removed object name from class definitions and super calls
PIPE-2903: updated type hinting standards per PEP484, PEP585, and PEP604, including replacing imports for built-ins and removing string literals and adding annotation forwarding -
Rui Xue 1fa18ea485c9483ae9961384aedc3e0d4ce45e92 m
Pull request #1790: PIPE-3061/PIPE-3027
Merge in PIPE/pipeline from PIPE-3061-examining-the-possible-memory-leak-when-running-multiple-regression-tests-on-one-pytest to main
* commit 'ebb6ced6fd1f23d977a302abef49c5d461feca85':
PIPE-3061: Update `pixi_tasks.md`
PIPE-3061: drop Python 3.10/3.11, add CASA 6.7.4 env, update docs theme
PIPE-3061: add pixi tasks for regression/unit tests and developer docs
PIPE-3061: Add `pytest-xvfb` to development requirements for headless testing support without `xvfb-run`
PIPE-3061: Update documentation to clarify xdist worker scaling and per-test timing details
PIPE-3061: Add MPI worker scaling recommendations and per-test timing details to documentation
PIPE-3061: Add usage examples for `@pytest.mark.mpi` in documentation
PIPE-3061: Further improve memory management by triggering garbage collection after clearing caches and releasing context in `PipelineTester`
PIPE-3027: Simplify MPI marker handling in pytest configuration and update description for clarity
PIPE-3027: add `@pytest.mark.mpi` marker and `--ignore-mpi-markers` option
PIPE-2061: Add fixture to clear module-level caches between tests to reduce memory footprint
PIPE-3061: Implement unsubscribe functionality in eventbus and improve the memory management for `Context` in `PipelineTester` -
Takeshi Nakazato 9b6f98a19b6ed94b5194f1179604ed21ea3afb3f m
Merge branch 'main' into PIPE-3001-hsd_baseline-proper-use-of-virtual-real-spw-id-in-baseline-worker.py
-
Takeshi Nakazato 4ea0c6786241662b50f1467baab613b34249a4c4 m
Replace string format method with f-string
-
Rui Xue <rx.astro@gmail.com> ebb6ced6fd1f23d977a302abef49c5d461feca85 m
PIPE-3061: Update `pixi_tasks.md`
-
Rui Xue <rx.astro@gmail.com> d42126852c0284c766a041f46c36e47382b81001 m
PIPE-3061: drop Python 3.10/3.11, add CASA 6.7.4 env, update docs theme
- Bump requires-python to >=3.12; remove 3.10/3.11 classifiers
- Drop casa666-py310 and casa671-py310 pixi environments
- Add casa674-py312 feature/environment (CASA 6.7.4, Python 3.12)
- Enable casa675-py313 on osx-arm64; guard bdsf via sys_platform
marker in requirements.txt instead of platform list restriction
- Bump macos system-requirement to 15.0
- Simplify astropy pin: drop python_version conditional (3.10 gone)
- Add build-docs-fast (incremental) and build-pdf pixi tasks
- Add furo Sphinx theme to requirements_docs.txt and docs environment -
Rui Xue <rx.astro@gmail.com> 87558d0b47039b0f84760dfe0c9eae09d184db12 m
PIPE-3061: add pixi tasks for regression/unit tests and developer docs
Add two pixi tasks to pyproject.toml:
- test-regression: runs tests/regression/fast/ with pytest-xdist
(worksteal, -m "not mpi") inside a plain Python session
- test-pltest1: runs a single small ALMA-IF regression test via `casashell`
Both tasks cd into PL_WORKDIR (default: ../working) before launching,
keeping CASA logs and pipeline output out of the source tree.
PL_WORKDIR is overridable at invocation time:
PL_WORKDIR=/zfs/scratch/myrun pixi run test-regression
Also add docs/source/develdocmd/pixi_tasks.md documenting all five
pixi tasks (test-unit, test-regression, test-pltest1,
fetch-casarundata, build-docs), the available CASA environments,
PL_WORKDIR usage, and per-environment invocation examples. -
Rui Xue <rx.astro@gmail.com> 7a18fb44737e7411b666b4d547fec735bb9e78f6 m
PIPE-3061: Add `pytest-xvfb` to development requirements for headless testing support without `xvfb-run`
-
Rui Xue <rx.astro@gmail.com> 1a2b9adcaa74775f5ed57162127b9132773f2488 m
PIPE-3061: Update documentation to clarify xdist worker scaling and per-test timing details
-
Rui Xue <rx.astro@gmail.com> 2b588848a18322c774aaa1984949cd5c8105be68 m
PIPE-3061: Add MPI worker scaling recommendations and per-test timing details to documentation
-
Takeshi Nakazato 205fec595f43e475ddc7936b24ba264a37d177aa m
Update spw-related variable names to indicate they store real spw id
-
Takeshi Nakazato 7dc7aaff480337556994edd8ab262731bd661c6a m
Replace "EB" with more generic word, "MS"
-
Takeshi Nakazato f82c92fe5d2109a066c88967333c9607f0c95336 m
rename spw-related variables to distinguish virtual or real
-
Takeshi Nakazato dd6b61aebe504d8ffb1da0dff71191162b693197 m
Fix inconsistent order of the args
-
Takeshi Nakazato b9c676fa2d8c0223de535bb0c619f743f5bce723 m
Add docstrings to some methods
-
Shawn Booth 83fe0c033e0abcb3a7237aa8768681ca58a63e1a m
PIPE-2903: reverted super reference calls to the parent object; changed type of QuantityDict value
-
Ajay Vibhute 066a71cca960d6dab310199d95f057b0d7c8d10c m
Pull request #1796: PIPE-3070: changing doquantiles to boolean from string
Merge in PIPE/pipeline from PIPE-3070-change-the-value-of-doquantiles-argument-value-from-string-to-boolean to main
* commit '3225e28bc9fb8dd7374a28f163c05ba463fbe6ba':
PIPE-3070: changing doquantiles to boolean from string -
Rui Xue <rx.astro@gmail.com> a03d8c4a4d73e15e284dcdf7c14ab036edd35d73 m
PIPE-3061: Add usage examples for `@pytest.mark.mpi` in documentation
-
Rui Xue 1fdf943c22c982a2fafa8be9827c6ac93cfbd1e0 m
Pull request #1789: PIPE-3060: Refactor masking logic in syspower to ensure proper boolean array handling
Merge in PIPE/pipeline from PIPE-3060-clone-typeerror-in-hifv_syspower to main
* commit '48578da916cdd083f98e572695bf6ed92de9d347':
PIPE-3060: Refactor masking logic in syspower to ensure proper boolean array handling -
Rui Xue 48182a99d008cbad907a23a6931d27675ea6fa18 m
Pull request #1792: PIPE-3063: add pipeline scripts/
Merge in PIPE/pipeline from PIPE-3063-add-scripts-for-standalone-helpers-cicd-functions to main
* commit 'b691966bbd3884dcb41b45ab29a60970f2c08337':
PIPE-3063: Update documentation in procedure_add_parallel.py to clarify task support for parallel execution
PIPE-3063: Add script to inject `parallel=True` into procedure/PPR for faster development testing -
Shawn Booth bd2d6c90ae315b302adb9ea120052a2f6efbf060 m
PIPE-2903: fix failure introduced at merge
-
Shawn Booth 5b727dd9aa82adb227b08d2d4c66bd4fd036df02 m
Merge remote-tracking branch 'origin/main' into PIPE-2903-additional-refactoring-items-after-pr-1452
-
Ajay Vibhute 3225e28bc9fb8dd7374a28f163c05ba463fbe6ba m
PIPE-3070: changing doquantiles to boolean from string
-
Takeshi Nakazato b5bbd549effbe90924cd068cfc70edf869a3d2df m
Update parameter name accordingly
-
Takeshi Nakazato 8a6139173ac337ed8a7838258a312045ace5627a m
gather fitting configuration log per EB (per worker process)
-
Takeshi Nakazato b6005bb326fa30689ea73cfc0eca7a0b8ca84550 m
bug fix on the use of local _wave_number
-
Takeshi Nakazato 8e6c772470209dab9cef7efcb77090149a479d54 m
Remove extra comma
-
Takeshi Nakazato a2f12afcd6e4c489117d3fd6e280782f56b96dbd m
Clearly separate the use of real/virtual spw ids
In baseline/worker.py most of the spw ids are *real*. Exception is dictionary keys in fit_order, fit_func, and wave_number. When processing these dictionaries, every keys are checked if they are virtual and converted to real spw ids if necessary. -
Takeshi Nakazato bb957e3eeada2f1133358c97fbaed230fdbc2369 m
Pull request #1774: PIPE-2774 hsd atmcor selected atmtype become worse in pl2025
Merge in PIPE/pipeline from PIPE-2774-hsd_atmcor-selected-atmtype-become-worse-in-pl2025 to main
* commit '6dbac1563e26e93c773bb3f9b6139dd58440b0d0':
Eliminate matplotlib.pyplot depencency
Eliminate pylab dependency
Simplify the code using numpy function
Eliminate unnecessary conditional block
Complete docstring and type annotation of smooth function
Examine separate atmowpheric features individually
Adjust smoothing box size
increase smoothing kernel size
Refactoring to reduce number of smoothing operation
bug fix on metricnorm and revised skychansel
Mitigate boundary effect of convolution
change default metric for selectModelParams to 'intsqdiff'
intsqdiff -
Rui Xue 60ddcac9ca40ee8314460cf1007d7d1310c59415 m
Pull request #1779: PIPE-3034: Fix AQUA report formatting error due to single-string `vis` specifications of `TargetDataSelection`
Merge in PIPE/pipeline from PIPE-3034-aqua-report-datas-selection-asdm-description-section-got-comma-splitted-string to main
* commit '9a44970a9ba0fa860d5209486a307e66f954920d':
PIPE-3034: Fix AQUA report formatting error due to single-string `vis` specifications of `TargetDataSelection` -
Rui Xue 1d2fb62039efa1638db27ef4674750eb42f4d55f m
Pull request #1777: PIPE-3025: Remove serial model write enforcement logic in tclean for 'mosaic' gridder
Merge in PIPE/pipeline from PIPE-3025-remove-the-serial-model-write-enforcement-logic-in-hif_selfcal to main
* commit 'eb7e76035f6b6ca3a7d9bb131dc988dc669d61d3':
PIPE-3025: Remove serial model write enforcement logic in tclean for 'mosaic' gridder -
Dirk Muders 77b65bba576542a5c2e63db2fbd0e346b73183ad m
Pull request #1778: PIPE-3018: Applied changes made in PIPE-3012 for the PL2025 release and changed the image library 'overwrite' parameter to 'overwrite_on_export' to clarify the meaning.
Merge in PIPE/pipeline from PIPE-3018_Missing_cubes_hifa_exportdata_output to main
* commit 'e26c8ead3642ecc1751599fff56925ac214f0b17':
PIPE-3018: Added doc string for add_item method to explain its behavior in detail.
PIPE-3018: Applied changes made in PIPE-3012 for the PL2025 release and changed the image library 'overwrite' parameter to 'overwrite_on_export' to clarify the meaning. -
Takeshi Nakazato 6dbac1563e26e93c773bb3f9b6139dd58440b0d0 m
Eliminate matplotlib.pyplot depencency
-
Takeshi Nakazato f6934da6f8dfdba3997a01116a28b838c360f948 m
Eliminate pylab dependency
-
Takeshi Nakazato 6605902ee53a01ba945f8bbcce8de86a0832c65a m
Simplify the code using numpy function
-
Dirk Muders e26c8ead3642ecc1751599fff56925ac214f0b17 m
PIPE-3018: Added doc string for add_item method to explain its behavior in detail.
-
Dirk Muders 993278cbb303ae10148f08146199e09e8d1d20ad m
Merge remote-tracking branch 'origin/main' into PIPE-3018_Missing_cubes_hifa_exportdata_output
-
Takeshi Nakazato cfbf937b7d2cc3b77ffa1d407f47a5303e2bcde4 m
Eliminate unnecessary conditional block
-
Takeshi Nakazato d906191ca22646b37e14c08e8263ea74e885fa1c m
Complete docstring and type annotation of smooth function
Also added safeguard code not to perform the smoothing operation unnecessarily. -
Takeshi Nakazato c2578a84746e49bf4c35a2698c96484bbc5d7a66 m
Merge branch 'main' into PIPE-2774-hsd_atmcor-selected-atmtype-become-worse-in-pl2025
-
Joshua Hoskins 75da060fa90f5525ab4ff38f6ec9e3c78812903c m
Pull request #1757: PIPE-2893 hsd baseline enable sinusoid option
Merge in PIPE/pipeline from PIPE-2893-hsd_baseline-enable-sinusoid-option to main
* commit 'a02fd8911995418b7e518da3232bd608c9c6f1b8': (26 commits)
Switching the order up in API call.
Remove a few unused imports and rearranged the import list to be better grouped and neat.
Addressing additional minor formatting suggestions.
More type-hint changes. List -> list, Dict -> dict
More type-hint changes.
Applied suggestion
Applied suggestion
More type-hint changes.
Add new test for wave_number and new sinusoid test to build_fitting_configuration() test.
Add default behavior in the build_fitting_configuration() function for when the fit_function is None.
Fixed _get_fir_param() function error or lack thereof and added new .is_sinusoid_fit()
Fixed _get_fir_param() function error or lack thereof and added new .is_sinusoid_fit()
Fixed _get_fir_param() function error or lack thereof and added new .is_sinusoid_fit()
Update type hint according to code review suggestion.
Update type hint according to code review suggestion.
fix issue with mapped memory in insgle fitfunction case.
Changes related to Takeshi's code review.
Refactor and change tests to match up with the current build_fitting_configuration() function.
Test changes to test file to find problem.
Test changes to test file to find problem.
... -
Rui Xue b691966bbd3884dcb41b45ab29a60970f2c08337 m
PIPE-3063: Update documentation in procedure_add_parallel.py to clarify task support for parallel execution
-
Rui Xue 759e9cea24c382968581f2db14b49dee6267bec1 m
PIPE-3063: Add script to inject `parallel=True` into procedure/PPR for faster development testing
-
Rui Xue eb7e76035f6b6ca3a7d9bb131dc988dc669d61d3 m
PIPE-3025: Remove serial model write enforcement logic in tclean for 'mosaic' gridder
-
Rui Xue d87a7d922af5cbaaa24e42f894012ceb3b9d604e m
PIPE-3061: Further improve memory management by triggering garbage collection after clearing caches and releasing context in `PipelineTester`
-
Rui Xue <rx.astro@gmail.com> ad99e6939dd46f3b43e47d6d9dd061d0b5908cbb m
PIPE-3027: Simplify MPI marker handling in pytest configuration and update description for clarity
-
Rui Xue <rx.astro@gmail.com> ce6a72e9f88b598c68279407e4d3d312d8d934f7 m
PIPE-3027: add `@pytest.mark.mpi` marker and `--ignore-mpi-markers` option
- Add `mpi` pytest marker to `pyproject.toml`
- Auto-skip `@pytest.mark.mpi` tests in pytest_collection_modifyitems
when `MPIEnvironment.is_mpi_enabled` is False
- Add `--ignore-mpi-markers` CLI flag to disable the auto-skip, allowing
mpi-marked tests to run in a serial session
- Apply `@pytest.mark.mpi` to tests that require an MPI-enabled CASA
session: two alma_if fast tests and one vla fast test- conftest.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
- pyproject.toml (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
- tests/regression/fast/alma_if_fast_test.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
- tests/regression/fast/vla_fast_test.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
-
Takeshi Nakazato 07f517743b331eed2d069619296b09d85dec3a2a m
Pull request #1782: PIPE-3035 bug fix to support "infiles" in VDPTaskFactory
Merge in PIPE/pipeline from PIPE-3035-paralleltemplate-doesn-t-distribute-vis-dependent-parameter-values-properly to main
* commit '7b27c5c12798e6f956051aa65083203fede4d714':
PIPE-3035 bug fix to support "infiles" in VDPTaskFactory -
Shawn Booth fba4e6ac1de89b456eb656aa416f36e615747f67 m
PIPE-2903: removed references to custom dictionaries in the all block that got reintroduced on merge with main
-
Rui Xue <rx.astro@gmail.com> 70972aee0d83b0a8be223cdeb50ddca4f96ff80e m
PIPE-2061: Add fixture to clear module-level caches between tests to reduce memory footprint
-
Rui Xue <rx.astro@gmail.com> 9e388ec091c0724e3181ba14affd6d25131a6290 m
PIPE-3061: Implement unsubscribe functionality in eventbus and improve the memory management for `Context` in `PipelineTester`
- pipeline/infrastructure/eventbus/__init__.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
- pipeline/infrastructure/eventbus/eventbus.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
- pipeline/infrastructure/timetracker.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
- tests/testing_utils.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
-
Rui Xue <rx.astro@gmail.com> 48578da916cdd083f98e572695bf6ed92de9d347 m
PIPE-3060: Refactor masking logic in syspower to ensure proper boolean array handling
-
Rui Xue 4b9c547dd168724e257904d81940e90c3f81db36 m
Pull request #1783: PIPE-3051: Add warning for nmajor limit in `CleanBase`
Merge in PIPE/pipeline from PIPE-3051-clone-hif_makeimages-stage-should-issue-warning-if-stopping-criterion-is-nmajor to main
* commit '4766493e7bd8415f96ec18d88a360ea247b71468':
PIPE-3051: Improve logging and error messages in `CleanBase`
PIPE-3051: Add warning for nmajor limit in `CleanBase` -
Rui Xue <rx.astro@gmail.com> 4766493e7bd8415f96ec18d88a360ea247b71468 m
PIPE-3051: Improve logging and error messages in `CleanBase`
-
Shawn Booth 3e3976b61f2b37a6824b68198f2d949e81a0ab55 m
Merge remote-tracking branch 'origin/main' into PIPE-2903-additional-refactoring-items-after-pr-1452
-
Takeshi Nakazato 7b27c5c12798e6f956051aa65083203fede4d714 m
Merge branch 'main' into PIPE-3035-paralleltemplate-doesn-t-distribute-vis-dependent-parameter-values-properly
-
Ajay Vibhute bc8bd7d374246913a5b0d0428dbf1b2a1db8b69e m
Pull request #1751: PIPE-2990: fixed leading ',' in warning weblog message for ignored antennas
Merge in PIPE/pipeline from PIPE-2990-fix-leading-comma-in-warning-antennas-to-be-ignored-weblog-messages to main
* commit 'deae224f069e5606542fd1f80980c48b3d4c49c8':
PIPE-2990: minor changes suggested during PR review
PIPE-2990: added build_refantignore to build ignore refant and added test for it
PIPE-2990: fix refantignore handling
PIPE-2990: fixed leading ',' in warning weblog message for ignored antennas -
Shawn Booth 4842d060901afcc09e61070a7f380c25346fa7f4 m
Merge remote-tracking branch 'origin/main' into PIPE-2903-additional-refactoring-items-after-pr-1452
-
Hajime Ezawa 1663d780bb56c494683e9272d1ad43fd2da66490 m
Pull request #1749: PIPE-2913 sdpl couldn t deal with pointing distribution intersecting ra 12h
Merge in PIPE/pipeline from PIPE-2913-sdpl-couldn-t-deal-with-pointing-distribution-intersecting-ra-12h to main
* commit 'e9f658e8262ee3dcc0358d11199f92b4311bd6a4':
PIPE-2913: additional fix to hsd_baseline stage
PIPE-2913: additional fix to hsd_imaging stage
Revert "PIPE-2491: additional fix to hsd_imaging stage"
Revert "PIPE-2491: additional fix to hsd_baseline stage"
PIPE-2491: additional fix to hsd_baseline stage
PIPE-2491: additional fix to hsd_imaging stage
PIPE-2913: move rewrap_angle() to hsd/tasks/common/utils.py
PIPE-2913: additional fix to rewrap_angle()
PIPE-2913: rewrap AZ related values before pushing into datatable -
Rui Xue 569696f90eeb3328f8bc566803c156ee7b578644 m
PIPE-3051: Add warning for nmajor limit in `CleanBase`
-
Shawn Booth 5a7209aabbcb235cd271c44472bae21935d7e416 m
PIPE-2903: fixed docstring reference to the correct Jira ticket
-
Shawn Booth ec6af9d454324357ee474cb23a3b529368a9db8d m
Merge remote-tracking branch 'origin/main' into PIPE-2903-additional-refactoring-items-after-pr-1452
-
Ajay Vibhute ec1ef9503af9617d2b0ac7cfb1a62df76f6278ae m
Pull request #1776: PIPE-3015: ensure file is closed while getting the num rows
Merge in PIPE/pipeline from PIPE-3015-refactor-rendererutils.num_lines to main
* commit 'cc7764ad524660dcd4422eb3f0ed8983a2d24d0e':
opening file with 'utf-8' encoding
PIPE-3015: ensure file is closed while getting the num rows -
Takeshi Nakazato 567235a4cb8564e27783af5d48c14da69bb42195 m
PIPE-3035 bug fix to support "infiles" in VDPTaskFactory
There was a bug in ParallelTemplate that per-EB parameter was not distributed properly for SD tasks that takes "infiles" instead of "vis". This fix switches scope attribute depending on the name of tha parameter. -
Takeshi Nakazato 2de77ead207e8e475103d59b7ce9f69d44a57917 m
Pull request #1773: PIPE-2946 hsd imaging ignore edge channels and channels overlapped with atm lines while examining qa
Merge in PIPE/pipeline from PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa to main
* commit '0fdb5963932f33ee2464003272cceb0652d3cfba':
compliance with PEP 8
Add more explanation on channel_mask parameter
fix too busy xaxis label in contamination plot
indicate edge/ATM region with different color in the plot
Fix for NRO Pipeline error
consistently update the condition to display warning text
PIPE-2946 ignore edge channels and ATM range in contamination analysis -
Shawn Booth 9c33ba790f7f9a54dfb054d19c213341559f14f1 m
Merge remote-tracking branch 'origin/main' into PIPE-2903-additional-refactoring-items-after-pr-1452
-
Ajay Vibhute cc7764ad524660dcd4422eb3f0ed8983a2d24d0e m
opening file with 'utf-8' encoding
-
Ajay Vibhute deae224f069e5606542fd1f80980c48b3d4c49c8 m
PIPE-2990: minor changes suggested during PR review
-
Hajime Ezawa e9f658e8262ee3dcc0358d11199f92b4311bd6a4 m
Merge branch 'main' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-2913-sdpl-couldn-t-deal-with-pointing-distribution-intersecting-ra-12h
-
Takeshi Nakazato 0fdb5963932f33ee2464003272cceb0652d3cfba m
Merge branch 'main' into PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
Takeshi Nakazato 4b5feeae87f2ef5ebf044820d526bf65cc7157a7 m
Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
-
Rui Xue 06261ca313d3e55c704716e9e6da34e2bd9ba910 m
Pull request #1672: PIPE-888: replace the use of `list(set(...))` with `utils.deduplicate(..)` to avoid random flagcmd orders.
Merge in PIPE/pipeline from PIPE-888-the-order-of-flagging-statements-in-flagdata-commands-differs-between-pipeline-runs-at to main
* commit '10211fe16b93c4089763a8242cf9250d38a3c94c':
PIPE-888: Refactor condition checks in FluxscaleInputs and SetModelsInputs for clarity; update deduplicate function type hints to accept Iterable
PIPE-1770: remove unnecessary `warnings.catch_warnings()` context manager clause.
PIPE-2865: ensure ordered `vdp` transfer values in `hif/fluxscale` and `hif/setmodel` inputs.
PIPE-1316: preserve the order of phase/target list for `wvrgcal/tie`.
PIPE-888: replace the use of `list(set(...))` with `utils.deduplicate(..)` to avoid random flagcmd orders. -
Rui Xue <rx.astro@gmail.com> 10211fe16b93c4089763a8242cf9250d38a3c94c m
PIPE-888: Refactor condition checks in FluxscaleInputs and SetModelsInputs for clarity; update deduplicate function type hints to accept Iterable
-
Rui Xue <rx.astro@gmail.com> e67a4dbf00b709517eb07779e659756019b228ef m
Merge remote-tracking branch 'origin/main' into PIPE-888-the-order-of-flagging-statements-in-flagdata-commands-differs-between-pipeline-runs-at
-
Takeshi Nakazato 0dae8624162ce754d1dccbfb5c26d71b70e5fe80 m
compliance with PEP 8
-
Takeshi Nakazato 11d9871595a6f22d0befdc5f8068d8cc6a0e1739 m
Merge branch 'main' into PIPE-2946-hsd_imaging-ignore-edge-channels-and-channels-overlapped-with-atm-lines-while-examining-qa
-
Ajay Vibhute e4000b70fcc588a0e70ecec252502bc40cf18c8c m
Pull request #1710: PIPE-1435 hifv testbpdcals should only flag the polarization affected by dts issues
Merge in PIPE/pipeline from PIPE-1435-hifv_testbpdcals-should-only-flag-the-polarization-affected-by-dts-issues to main
* commit '4dca9985aec72d0bb47917773ea11c5a247871c8':
PIPE-1435: minor changes suggested in PR review
PIPE-1435: avoided nested list used for weblogflagdict
PIPE-1435: showing correlation string on weblogs
PIPE-1435: displayed flagged correlation on weblogs
PIPE-1435: flagging only offending correlation per spw
PIPE-1435: flagging only offending correlation -
Ajay Vibhute 3ff4691f92f34997879e49a04e419d39f68f567f m
Pull request #1680: PIPE-2584 hifv fluxboot qa criteria
Merge in PIPE/pipeline from PIPE-2584-hifv_fluxboot-qa-criteria to main
* commit 'e247ba29224f31eb78fd7b8a81994a15b865e755':
PIPE-2584: using spws only in science scan and warning is displayed only if more than 50% science spws are missing
PIPE-2584: checking if spw is missing in all scans rather than each scan
PIPE-2584: updated matric score
PIPE-2584: added QA message when there are no rows for a given scan and spw
PIPE-2584: Checking model_data column is present and calibrator.ms is not empty before running visstat
PIPE-2584: added applies_to to the QA score
PIPE-2584: using visstat to check model column is set to 1 or not
PIPE-2584: minor changes suggested in PR
PIPE-2584: check to ensure flux density is measured
PIPE-2584: Add QA scoring checks for flagged SPWs, calibrator data, and spectral index limits -
Rui Xue <rx.astro@gmail.com> 9a44970a9ba0fa860d5209486a307e66f954920d m
PIPE-3034: Fix AQUA report formatting error due to single-string `vis` specifications of `TargetDataSelection`
-
Shawn Booth 48f6ccb438ddc048eed491ed1d5a8ab225fd50e3 m
Pull request #1758: PIPE-2320: hifa_flagdata heuristic for determining FDM spws should use msmd.almaspws
Merge in PIPE/pipeline from PIPE-2320-hifa_flagdata-heuristic-for-determining-fdm-spws-should-use-msmd.almaspws to main
* commit '84bbb0b3dd7e0e677537ac0c9a99f796ff390cc4':
PIPE-2320: removed unused import and added _fdm_spws default to class definition
PIPE-2320: added unit tests to exercise heuristics change
PIPE-2320: use CASA metadata for ALMA FDM detection -
ryanaloomis <ryan.a.loomis@gmail.com> 803f8d791bb8a562a28f97f032ba7939e678f16d m
PIPE-2617: make hif_findcont use uvrange
-
Dirk Muders 20cf895fc0ed76bdd1a7ba243718353b540d5eda m
PIPE-3018: Applied changes made in PIPE-3012 for the PL2025 release and changed the image library 'overwrite' parameter to 'overwrite_on_export' to clarify the meaning.
- pipeline/hif/tasks/makeimages/makeimages.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/hif/tasks/makeimages/resultobjects.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/hif/tasks/selfcal/selfcal.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/hif/tasks/tclean/cleanbase.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/hif/tasks/tclean/renderer.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/hif/tasks/tclean/resultobjects.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/hif/tasks/tclean/tclean.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
- pipeline/infrastructure/imagelibrary.py (version 20cf895fc0ed76bdd1a7ba243718353b540d5eda) (diffs)
-
Takeshi Nakazato 1c56a8aaaa26bc193a8fa718b5773dc9124f9652 m
Examine separate atmowpheric features individually
Previous impelentation combined all the detected atmospheric features
together to calculate metric values. This commit evaluates metric values
for each atmospheric feature individually and takes sum of them.