Code commits
Pipeline
-
Rui Xue 1fa18ea485c9483ae9961384aedc3e0d4ce45e92
Pull request #1790: PIPE-3061/PIPE-3027
Merge in PIPE/pipeline from PIPE-3061-examining-the-possible-memory-leak-when-running-multiple-regression-tests-on-one-pytest to main
* commit 'ebb6ced6fd1f23d977a302abef49c5d461feca85':
PIPE-3061: Update `pixi_tasks.md`
PIPE-3061: drop Python 3.10/3.11, add CASA 6.7.4 env, update docs theme
PIPE-3061: add pixi tasks for regression/unit tests and developer docs
PIPE-3061: Add `pytest-xvfb` to development requirements for headless testing support without `xvfb-run`
PIPE-3061: Update documentation to clarify xdist worker scaling and per-test timing details
PIPE-3061: Add MPI worker scaling recommendations and per-test timing details to documentation
PIPE-3061: Add usage examples for `@pytest.mark.mpi` in documentation
PIPE-3061: Further improve memory management by triggering garbage collection after clearing caches and releasing context in `PipelineTester`
PIPE-3027: Simplify MPI marker handling in pytest configuration and update description for clarity
PIPE-3027: add `@pytest.mark.mpi` marker and `--ignore-mpi-markers` option
PIPE-2061: Add fixture to clear module-level caches between tests to reduce memory footprint
PIPE-3061: Implement unsubscribe functionality in eventbus and improve the memory management for `Context` in `PipelineTester` -
Rui Xue <rx.astro@gmail.com> ebb6ced6fd1f23d977a302abef49c5d461feca85 m
PIPE-3061: Update `pixi_tasks.md`
-
Rui Xue <rx.astro@gmail.com> d42126852c0284c766a041f46c36e47382b81001 m
PIPE-3061: drop Python 3.10/3.11, add CASA 6.7.4 env, update docs theme
- Bump requires-python to >=3.12; remove 3.10/3.11 classifiers
- Drop casa666-py310 and casa671-py310 pixi environments
- Add casa674-py312 feature/environment (CASA 6.7.4, Python 3.12)
- Enable casa675-py313 on osx-arm64; guard bdsf via sys_platform
marker in requirements.txt instead of platform list restriction
- Bump macos system-requirement to 15.0
- Simplify astropy pin: drop python_version conditional (3.10 gone)
- Add build-docs-fast (incremental) and build-pdf pixi tasks
- Add furo Sphinx theme to requirements_docs.txt and docs environment -
Rui Xue <rx.astro@gmail.com> 87558d0b47039b0f84760dfe0c9eae09d184db12 m
PIPE-3061: add pixi tasks for regression/unit tests and developer docs
Add two pixi tasks to pyproject.toml:
- test-regression: runs tests/regression/fast/ with pytest-xdist
(worksteal, -m "not mpi") inside a plain Python session
- test-pltest1: runs a single small ALMA-IF regression test via `casashell`
Both tasks cd into PL_WORKDIR (default: ../working) before launching,
keeping CASA logs and pipeline output out of the source tree.
PL_WORKDIR is overridable at invocation time:
PL_WORKDIR=/zfs/scratch/myrun pixi run test-regression
Also add docs/source/develdocmd/pixi_tasks.md documenting all five
pixi tasks (test-unit, test-regression, test-pltest1,
fetch-casarundata, build-docs), the available CASA environments,
PL_WORKDIR usage, and per-environment invocation examples. -
Rui Xue <rx.astro@gmail.com> 7a18fb44737e7411b666b4d547fec735bb9e78f6 m
PIPE-3061: Add `pytest-xvfb` to development requirements for headless testing support without `xvfb-run`
-
Rui Xue <rx.astro@gmail.com> 1a2b9adcaa74775f5ed57162127b9132773f2488 m
PIPE-3061: Update documentation to clarify xdist worker scaling and per-test timing details
-
Rui Xue <rx.astro@gmail.com> 2b588848a18322c774aaa1984949cd5c8105be68 m
PIPE-3061: Add MPI worker scaling recommendations and per-test timing details to documentation
-
Rui Xue <rx.astro@gmail.com> a03d8c4a4d73e15e284dcdf7c14ab036edd35d73 m
PIPE-3061: Add usage examples for `@pytest.mark.mpi` in documentation
-
Rui Xue d87a7d922af5cbaaa24e42f894012ceb3b9d604e m
PIPE-3061: Further improve memory management by triggering garbage collection after clearing caches and releasing context in `PipelineTester`
-
Rui Xue <rx.astro@gmail.com> ad99e6939dd46f3b43e47d6d9dd061d0b5908cbb m
PIPE-3027: Simplify MPI marker handling in pytest configuration and update description for clarity
-
Rui Xue <rx.astro@gmail.com> ce6a72e9f88b598c68279407e4d3d312d8d934f7 m
PIPE-3027: add `@pytest.mark.mpi` marker and `--ignore-mpi-markers` option
- Add `mpi` pytest marker to `pyproject.toml`
- Auto-skip `@pytest.mark.mpi` tests in pytest_collection_modifyitems
when `MPIEnvironment.is_mpi_enabled` is False
- Add `--ignore-mpi-markers` CLI flag to disable the auto-skip, allowing
mpi-marked tests to run in a serial session
- Apply `@pytest.mark.mpi` to tests that require an MPI-enabled CASA
session: two alma_if fast tests and one vla fast test- conftest.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
- pyproject.toml (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
- tests/regression/fast/alma_if_fast_test.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
- tests/regression/fast/vla_fast_test.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
-
Rui Xue <rx.astro@gmail.com> 70972aee0d83b0a8be223cdeb50ddca4f96ff80e m
PIPE-2061: Add fixture to clear module-level caches between tests to reduce memory footprint
-
Rui Xue <rx.astro@gmail.com> 9e388ec091c0724e3181ba14affd6d25131a6290 m
PIPE-3061: Implement unsubscribe functionality in eventbus and improve the memory management for `Context` in `PipelineTester`
- pipeline/infrastructure/eventbus/__init__.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
- pipeline/infrastructure/eventbus/eventbus.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
- pipeline/infrastructure/timetracker.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
- tests/testing_utils.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)