Inna Muzychenko 5 days ago d78278d7aa74551b4b79d1db15e692c3946281c5

Pull request #1036: CAS-14750
Merge in CASA/casa6 from CAS-14750 to release/6.7.4

* commit '0067722df2fcc353574d2aa7a5d3e0b409c75c46': (34 commits)
  Fix discrepancies
  Changes according to the NAOJ code review Refs #2870
  Changes according to the NAOJ code review Refs #2869 #2870
  Changes according to the NAOJ code review Refs #2868
  Changes according to the NAOJ code review Refs #2866
  Changes according to the NAOJ code review Refs #2865
  Changes according to the NAOJ code review Refs #2864
  Changes according to the NAOJ code review
  Delete commented out lines
  Fix bugs, add tests
  Changes according to code review Refs #2858
  Changes according to code review Refs #2858
  Changes according to code review Refs #2846
  Changes according to the code review #Refs 2851
  Changes according to code review Refs #2843
  Changes according to code review Refs #2860
  Changes according to code review Refs #2859
  Changes according to code review Refs #2857
  Changes according to the code review #Refs 2854
  Changes according to code review Refs #2853
  ...

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 0067722df2fcc353574d2aa7a5d3e0b409c75c46

Fix discrepancies

• casatasks/src/private/task_getjyperkalma.py (version 0067722df2fcc353574d2aa7a5d3e0b409c75c46) (diffs)
• casatestutils/casatestutils/component_to_test_map.json (version 0067722df2fcc353574d2aa7a5d3e0b409c75c46) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 76b8f093f7fa731098181fd2a2504a325e1fbe01

Fix bugs, add tests

• casatasks/src/private/task_getjyperkalma.py (version 76b8f093f7fa731098181fd2a2504a325e1fbe01) (diffs)
• casatasks/tests/tasks/test_task_getjyperkalma.py (version 76b8f093f7fa731098181fd2a2504a325e1fbe01) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 96384ad4f0b431cfaa988726be12e2bf6100380f

Changes according to the NAOJ code review Refs #2869 #2870

• casatasks/tests/tasks/test_task_getjyperkalma.py (version 96384ad4f0b431cfaa988726be12e2bf6100380f) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 e67b065d9bff8ec199cfb6ab75e0974430c6da6d

Changes according to the NAOJ code review Refs #2870

• casatasks/tests/tasks/test_task_getjyperkalma.py (version e67b065d9bff8ec199cfb6ab75e0974430c6da6d) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 3d10f9a8f9254e49154304e11ddd4f63d85ccdb6

Changes according to the NAOJ code review Refs #2868

• casatasks/tests/tasks/test_task_getjyperkalma.py (version 3d10f9a8f9254e49154304e11ddd4f63d85ccdb6) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 46f53413606ab286c8f7f0ed498d9aeebae696fa

Changes according to the NAOJ code review Refs #2866

• casatasks/tests/tasks/test_task_getjyperkalma.py (version 46f53413606ab286c8f7f0ed498d9aeebae696fa) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 05429c6dbf64be94aaee7e7f6a33a5bb35e3bbba

Changes according to the NAOJ code review

• casatasks/tests/tasks/test_task_getjyperkalma.py (version 05429c6dbf64be94aaee7e7f6a33a5bb35e3bbba) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 b8a03c6fdfce01ed0c85244b869972482affcd21

Changes according to code review Refs #2858

• casatasks/src/private/task_getjyperkalma.py (version b8a03c6fdfce01ed0c85244b869972482affcd21) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 2a9796962f0b2f07056b17fd2ea18cadb153cad8

Delete commented out lines

• casatasks/tests/tasks/test_task_getjyperkalma.py (version 2a9796962f0b2f07056b17fd2ea18cadb153cad8) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 f3bb02e31efd5938d1f701a6c54ebcb45b63a8ed

Changes according to code review Refs #2858

• casatasks/src/private/task_getjyperkalma.py (version f3bb02e31efd5938d1f701a6c54ebcb45b63a8ed) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 ded1f15dea170cb6b1a0860f4a4c7e5056567af8

Changes according to the NAOJ code review Refs #2864

• casatasks/tests/tasks/test_task_getjyperkalma.py (version ded1f15dea170cb6b1a0860f4a4c7e5056567af8) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 4924feaff55488d34c1686a13375ae8a59f3f0e3

Changes according to code review Refs #2846

• casatasks/src/private/task_getjyperkalma.py (version 4924feaff55488d34c1686a13375ae8a59f3f0e3) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 2b349f830d032271bb3a03db25a4f9370adc40db

Changes according to the NAOJ code review Refs #2865

• casatasks/tests/tasks/test_task_getjyperkalma.py (version 2b349f830d032271bb3a03db25a4f9370adc40db) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 3a0cbf93163d78639b6c1a8a14157641a1b17a38

Changes according to code review Refs #2851

• casatasks/xml/getjyperkalma.xml (version 3a0cbf93163d78639b6c1a8a14157641a1b17a38) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 76d0f2fffc003b44dcc491841397f6c5417b361d

Base for getjyperkalma

• casatasks/setup.py (version 76d0f2fffc003b44dcc491841397f6c5417b361d) (diffs)
• casatasks/src/private/task_getjyperkalma.py (version 76d0f2fffc003b44dcc491841397f6c5417b361d) (diffs)
• casatasks/xml/getjyperkalma.xml (version 76d0f2fffc003b44dcc491841397f6c5417b361d) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 a43020380ae6fc7e38dfe1f1541250060a80356a

Changes according to code review Refs #2857

• casatasks/src/private/task_getjyperkalma.py (version a43020380ae6fc7e38dfe1f1541250060a80356a) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 a141ddd4ae3e6063ff1e7d92e14927bcfb9dab58

Changes according to code review Refs #2859

• casatasks/src/private/task_getjyperkalma.py (version a141ddd4ae3e6063ff1e7d92e14927bcfb9dab58) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 94cad210e5575c3dc4a7425b094d502c041cfb58

Prototype for test

• casatasks/src/private/task_getjyperkalma.py (version 94cad210e5575c3dc4a7425b094d502c041cfb58) (diffs)
• casatasks/xml/getjyperkalma.xml (version 94cad210e5575c3dc4a7425b094d502c041cfb58) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 c2c3567daa9528fae646d55e9846f520e4b69c5b

Changes according to code review Refs #2845

• casatasks/src/private/task_getjyperkalma.py (version c2c3567daa9528fae646d55e9846f520e4b69c5b) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 82558477b29aad7f502ace1eede4e5113bed1cd9

Remove env var usage

• casatasks/src/private/jyperk.py (version 82558477b29aad7f502ace1eede4e5113bed1cd9) (diffs)
• casatasks/src/private/task_getjyperkalma.py (version 82558477b29aad7f502ace1eede4e5113bed1cd9) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 fbeacb9df3c09322cf4137d6ce71f9b82dfbbda0

Changes according to code review Refs #2846

• casatasks/src/private/task_getjyperkalma.py (version fbeacb9df3c09322cf4137d6ce71f9b82dfbbda0) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 8d2ddfd0a3818bb49172c5c6439794be340ba6fc

Changes according to code review Refs #2843

• casatasks/src/private/jyperk.py (version 8d2ddfd0a3818bb49172c5c6439794be340ba6fc) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 e6230e75574298f923985adf476276c068c0c531

Ready for code review

• casatasks/src/private/task_getjyperkalma.py (version e6230e75574298f923985adf476276c068c0c531) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 41cea00a34f96dca48fe480d636e2bb758053efb

Changes according to code review Refs #2842

• casatasks/src/private/task_getjyperkalma.py (version 41cea00a34f96dca48fe480d636e2bb758053efb) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 5a3754908ffa2f0786abb34b33e95616c6b9de82

Changes according to code review Refs #2847

• casatasks/src/private/task_getjyperkalma.py (version 5a3754908ffa2f0786abb34b33e95616c6b9de82) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 673327422219fb48d9b601194f1a517f247f37ac

Changes according to code review Refs #2850

• casatasks/src/private/task_getjyperkalma.py (version 673327422219fb48d9b601194f1a517f247f37ac) (diffs)
• casatasks/xml/getjyperkalma.xml (version 673327422219fb48d9b601194f1a517f247f37ac) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 92d19d49c9d239d03164ab5ea48b2c5c3e295962

Changes according to the code review #Refs 2851

• casatasks/xml/getjyperkalma.xml (version 92d19d49c9d239d03164ab5ea48b2c5c3e295962) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 5ab36a1293b4543518ed7409c44239754440ad42

Fix xml file

• casatasks/src/private/task_getjyperkalma.py (version 5ab36a1293b4543518ed7409c44239754440ad42) (diffs)
• casatasks/xml/getjyperkalma.xml (version 5ab36a1293b4543518ed7409c44239754440ad42) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 d4a17c1c06e51535dfd03cd638ac1f8cdd157ee1

Changes according to code review Refs #2849

• casatasks/xml/getjyperkalma.xml (version d4a17c1c06e51535dfd03cd638ac1f8cdd157ee1) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 f2a841a69cf55ed3f4c876e62f736f00acf9876a

Changes according to code review Refs #2853

• casatasks/src/private/jyperk.py (version f2a841a69cf55ed3f4c876e62f736f00acf9876a) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 6f0a0fc656d79011126c52b702f7fb5eb54221b2

Changes according to code review Refs #2860

• casatasks/xml/getjyperkalma.xml (version 6f0a0fc656d79011126c52b702f7fb5eb54221b2) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 41eb9e0d3dca4163ba7f1eac1ba83473730f737f

Remove parameter

• casatasks/src/private/task_getjyperkalma.py (version 41eb9e0d3dca4163ba7f1eac1ba83473730f737f) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 f557e89adaf466157c5ce566dd01c4f2f709de09

Changes according to code review Refs #2841 #2844 #2848 #2852

• casatasks/src/private/task_getjyperkalma.py (version f557e89adaf466157c5ce566dd01c4f2f709de09) (diffs)

Muzychenko Inna <inna.muzychenko@ana01.alma.nao.ac.jp> 03 Apr 2026 f4c279c79b38037a3adc2bdbc7ed3548be60c4c6

Changes according to the code review #Refs 2854

• casatasks/src/private/jyperk.py (version f4c279c79b38037a3adc2bdbc7ed3548be60c4c6) (diffs)

Rui Xue 3 days ago 1fa18ea485c9483ae9961384aedc3e0d4ce45e92

Pull request #1790: PIPE-3061/PIPE-3027
Merge in PIPE/pipeline from PIPE-3061-examining-the-possible-memory-leak-when-running-multiple-regression-tests-on-one-pytest to main

* commit 'ebb6ced6fd1f23d977a302abef49c5d461feca85':
  PIPE-3061: Update `pixi_tasks.md`
  PIPE-3061: drop Python 3.10/3.11, add CASA 6.7.4 env, update docs theme
  PIPE-3061: add pixi tasks for regression/unit tests and developer docs
  PIPE-3061: Add `pytest-xvfb` to development requirements for headless testing support without `xvfb-run`
  PIPE-3061: Update documentation to clarify xdist worker scaling and per-test timing details
  PIPE-3061: Add MPI worker scaling recommendations and per-test timing details to documentation
  PIPE-3061: Add usage examples for `@pytest.mark.mpi` in documentation
  PIPE-3061: Further improve memory management by triggering garbage collection after clearing caches and releasing context in `PipelineTester`
  PIPE-3027: Simplify MPI marker handling in pytest configuration and update description for clarity
  PIPE-3027: add `@pytest.mark.mpi` marker and `--ignore-mpi-markers` option
  PIPE-2061: Add fixture to clear module-level caches between tests to reduce memory footprint
  PIPE-3061: Implement unsubscribe functionality in eventbus and improve the memory management for `Context` in `PipelineTester`

Rui Xue <rx.astro@gmail.com> 4 days ago ebb6ced6fd1f23d977a302abef49c5d461feca85 m

PIPE-3061: Update `pixi_tasks.md`

• docs/source/develdocmd/pixi_tasks.md (version ebb6ced6fd1f23d977a302abef49c5d461feca85) (diffs)

Rui Xue <rx.astro@gmail.com> 4 days ago d42126852c0284c766a041f46c36e47382b81001 m

PIPE-3061: drop Python 3.10/3.11, add CASA 6.7.4 env, update docs theme
- Bump requires-python to >=3.12; remove 3.10/3.11 classifiers
- Drop casa666-py310 and casa671-py310 pixi environments
- Add casa674-py312 feature/environment (CASA 6.7.4, Python 3.12)
- Enable casa675-py313 on osx-arm64; guard bdsf via sys_platform
  marker in requirements.txt instead of platform list restriction
- Bump macos system-requirement to 15.0
- Simplify astropy pin: drop python_version conditional (3.10 gone)
- Add build-docs-fast (incremental) and build-pdf pixi tasks
- Add furo Sphinx theme to requirements_docs.txt and docs environment

• pyproject.toml (version d42126852c0284c766a041f46c36e47382b81001) (diffs)
• requirements.txt (version d42126852c0284c766a041f46c36e47382b81001) (diffs)
• requirements_docs.txt (version d42126852c0284c766a041f46c36e47382b81001) (diffs)

Rui Xue <rx.astro@gmail.com> 4 days ago 87558d0b47039b0f84760dfe0c9eae09d184db12 m

PIPE-3061: add pixi tasks for regression/unit tests and developer docs
Add two pixi tasks to pyproject.toml:
- test-regression: runs tests/regression/fast/ with pytest-xdist
  (worksteal, -m "not mpi") inside a plain Python session
- test-pltest1: runs a single small ALMA-IF regression test via `casashell`

Both tasks cd into PL_WORKDIR (default: ../working) before launching,
keeping CASA logs and pipeline output out of the source tree.
PL_WORKDIR is overridable at invocation time:
  PL_WORKDIR=/zfs/scratch/myrun pixi run test-regression

Also add docs/source/develdocmd/pixi_tasks.md documenting all five
pixi tasks (test-unit, test-regression, test-pltest1,
fetch-casarundata, build-docs), the available CASA environments,
PL_WORKDIR usage, and per-environment invocation examples.

• docs/source/develdocmd/pixi_tasks.md (version 87558d0b47039b0f84760dfe0c9eae09d184db12) (diffs)
• pyproject.toml (version 87558d0b47039b0f84760dfe0c9eae09d184db12) (diffs)

Rui Xue <rx.astro@gmail.com> 4 days ago 7a18fb44737e7411b666b4d547fec735bb9e78f6 m

PIPE-3061: Add `pytest-xvfb` to development requirements for headless testing support without `xvfb-run`

• requirements_dev.txt (version 7a18fb44737e7411b666b4d547fec735bb9e78f6) (diffs)

Rui Xue <rx.astro@gmail.com> 4 days ago 1a2b9adcaa74775f5ed57162127b9132773f2488 m

PIPE-3061: Update documentation to clarify xdist worker scaling and per-test timing details

• docs/source/tickets/pipe3061.md (version 1a2b9adcaa74775f5ed57162127b9132773f2488) (diffs)

Rui Xue <rx.astro@gmail.com> 4 days ago 2b588848a18322c774aaa1984949cd5c8105be68 m

PIPE-3061: Add MPI worker scaling recommendations and per-test timing details to documentation

• docs/source/tickets/pipe3061.md (version 2b588848a18322c774aaa1984949cd5c8105be68) (diffs)

Rui Xue <rx.astro@gmail.com> 5 days ago a03d8c4a4d73e15e284dcdf7c14ab036edd35d73 m

PIPE-3061: Add usage examples for `@pytest.mark.mpi` in documentation

• docs/source/tickets/pipe3061.md (version a03d8c4a4d73e15e284dcdf7c14ab036edd35d73) (diffs)

Rui Xue 15 Apr 2026 d87a7d922af5cbaaa24e42f894012ceb3b9d604e m

PIPE-3061: Further improve memory management by triggering garbage collection after clearing caches and releasing context in `PipelineTester`

• conftest.py (version d87a7d922af5cbaaa24e42f894012ceb3b9d604e) (diffs)
• tests/testing_utils.py (version d87a7d922af5cbaaa24e42f894012ceb3b9d604e) (diffs)

Rui Xue <rx.astro@gmail.com> 15 Apr 2026 ad99e6939dd46f3b43e47d6d9dd061d0b5908cbb m

PIPE-3027: Simplify MPI marker handling in pytest configuration and update description for clarity

• conftest.py (version ad99e6939dd46f3b43e47d6d9dd061d0b5908cbb) (diffs)
• pyproject.toml (version ad99e6939dd46f3b43e47d6d9dd061d0b5908cbb) (diffs)

Rui Xue <rx.astro@gmail.com> 15 Apr 2026 ce6a72e9f88b598c68279407e4d3d312d8d934f7 m

PIPE-3027: add `@pytest.mark.mpi` marker and `--ignore-mpi-markers` option
- Add `mpi` pytest marker to `pyproject.toml`
- Auto-skip `@pytest.mark.mpi` tests in pytest_collection_modifyitems
  when `MPIEnvironment.is_mpi_enabled` is False
- Add `--ignore-mpi-markers` CLI flag to disable the auto-skip, allowing
  mpi-marked tests to run in a serial session
- Apply `@pytest.mark.mpi` to tests that require an MPI-enabled CASA
  session: two alma_if fast tests and one vla fast test

• conftest.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
• pyproject.toml (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
• tests/regression/fast/alma_if_fast_test.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)
• tests/regression/fast/vla_fast_test.py (version ce6a72e9f88b598c68279407e4d3d312d8d934f7) (diffs)

Rui Xue <rx.astro@gmail.com> 14 Apr 2026 70972aee0d83b0a8be223cdeb50ddca4f96ff80e m

PIPE-2061: Add fixture to clear module-level caches between tests to reduce memory footprint

• conftest.py (version 70972aee0d83b0a8be223cdeb50ddca4f96ff80e) (diffs)

Rui Xue <rx.astro@gmail.com> 14 Apr 2026 9e388ec091c0724e3181ba14affd6d25131a6290 m

PIPE-3061: Implement unsubscribe functionality in eventbus and improve the memory management for `Context` in `PipelineTester`

• pipeline/infrastructure/eventbus/__init__.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
• pipeline/infrastructure/eventbus/eventbus.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
• pipeline/infrastructure/timetracker.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)
• tests/testing_utils.py (version 9e388ec091c0724e3181ba14affd6d25131a6290) (diffs)