Pipeline

• 

  Rui Xue <rx.astro@gmail.com> 2 days ago 4a1a224fd92719831ddabd64801f32cf4fffd183

  PIPE-2026: Add pclean subprocess wrapper for parallel tclean
  Introduce pipeline/infrastructure/utils/pclean.py, a new utility
  that wraps casatasks.tclean with transparent support for both
  serial (in-process) and MPI-parallel (subprocess) execution.
  This allows parallel tclean runs to be dispatched from a pipeline
  process that was not launched under MPI.
  
  Modernize datetime parsing in display.py, tablereader.py, and
  conversion.py: replace strptime with fromisoformat and rewrite
  mjd_seconds_to_datetime using the MJD epoch directly, removing
  the intermediate unix_seconds_to_datetime dependency.
  
  Fix lazy logging format strings in renderer/logger.py to use
  %-style lazy evaluation instead of % string interpolation.
  
  Bump casatools/casatasks minimum version to >=6.7.1 and update
  setup-pixi action to v0.9.4. Disable pytest-xdist parallelism
  (-n 0) to accommodate subprocess-based integration tests.
  
  Files changed:
  - pipeline/infrastructure/utils/pclean.py (new)
  - pipeline/infrastructure/utils/pclean_test.py (new)
  - pipeline/infrastructure/utils/conversion.py
  - pipeline/infrastructure/renderer/logger.py
  - pipeline/infrastructure/tablereader.py
  - pipeline/hifv/tasks/syspower/display.py
  - pyproject.toml
  - .github/workflows/
• 

  Rui Xue <rx.astro@gmail.com> 24 Feb 2026 03edbbcec7a2e635cd0b9db1816bfacd6e02ed7a m

  PIPE-2926: CI/CD workarounds
  - Target macOS 15+ in pixi system-requirements
  
      Set macos = "15.0" so pixi prefers the latest `casatools``
      wheels on `osx-arm64``. `uv`` may still fall back to a 14.0
      wheel when no 15.0 build is available.
  
  - Update `Pixi` setup action to version `0.9.4` and adjust `Pixi`` version to `0.62.2`
  
  - Disable `pytest-xdist` for parallel workers with '-n 0' to avoid
    resource contention on the GitHub macOS runners.

  • .github/workflows/env-setup-run-template-pixi.yml (version 03edbbcec7a2e635cd0b9db1816bfacd6e02ed7a) (diffs)
  • .github/workflows/test-unit.yml (version 03edbbcec7a2e635cd0b9db1816bfacd6e02ed7a) (diffs)
  • pipeline/infrastructure/utils/pclean_test.py (version 03edbbcec7a2e635cd0b9db1816bfacd6e02ed7a) (diffs)
  • pyproject.toml (version 03edbbcec7a2e635cd0b9db1816bfacd6e02ed7a) (diffs)
• 

  Rui Xue <rx.astro@gmail.com> 22 Feb 2026 a989bc2a24aa28281d84eb04078a4c5a56ba04a3 m

  PIPE-2926: Update `pclean.py` with improved docstrings

  • pipeline/infrastructure/utils/pclean.py (version a989bc2a24aa28281d84eb04078a4c5a56ba04a3) (diffs)
  • pipeline/infrastructure/utils/pclean_test.py (version a989bc2a24aa28281d84eb04078a4c5a56ba04a3) (diffs)
• 

  Rui Xue <rx.astro@gmail.com> 22 Feb 2026 333dc0b13db55afd3c0c58e1cf3ba5a4dde1f72c m

  Merge remote-tracking branch 'origin/main' into `pclean`:
  Resolved conflicts:
  - `pipeline/infrastructure/renderer/htmlrenderer.py`
  - `pipeline/infrastructure/renderer/logger.py`
• 

  Rui Xue 29 Jan 2026 9431f9e3e45d078417792547a814346acc4eed35 m

  Merge remote-tracking branch 'origin/main' into pclean:
  Resolve conflicts:
  - pipeline/domain/state.py
  - pipeline/infrastructure/utils/conversion_test.py
• 

  Rui Xue 10 Jan 2026 42a23b751b755a5c448e780dc98b93897962c686 m

  Merge branch 'PIPE-2935-add-custom-copilot-instructions' into pclean
• 

  Rui Xue 16 Dec 2025 21816c5e94a62e66cc473fec5a40d55c501ad12f m

  Merge remote-tracking branch 'gh/main' into pclean
• 

  Rui Xue 13 Dec 2025 75bb79f1f062683c831fd4fb9080fd94f7565119 m

  PIPE-1836: Update datetime handling to use timezone-aware UTC timestamps across multiple modules.

  • pipeline/domain/measurementset.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/domain/measures.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/domain/state.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/h/tasks/exportdata/aqua.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/hifa/tasks/importdata/dbfluxes.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/hifv/tasks/flagging/checkflag.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/hifv/tasks/syspower/display.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/basetask.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/callibrary.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/launcher.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/pipeline_statistics.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/renderer/htmlrenderer.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/tablereader.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
  • pipeline/infrastructure/utils/ppr.py (version 75bb79f1f062683c831fd4fb9080fd94f7565119) (diffs)
• 

  Rui Xue <r-xue@users.noreply.github.com> 12 Dec 2025 c2fc77f2330cbf4adcf6634f7a1ddfd9d7043b65 m

  PIPE-2926: Apply suggestions from code review
  Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

  • pipeline/infrastructure/utils/pclean.py (version c2fc77f2330cbf4adcf6634f7a1ddfd9d7043b65) (diffs)
• 

  Rui Xue 12 Dec 2025 9e8006b86828274f27fe3911aa4b617546c56eb4 m

  Merge in upstream: `update-docs-build-and-packaging-setup`
• 

  Rui Xue 11 Dec 2025 a77948d325af1929dff1db6fa878cf84e174ddca m

  PIPE-1836: additional removal of naive datetime objects.

  • pipeline/infrastructure/utils/casa_data_test.py (version a77948d325af1929dff1db6fa878cf84e174ddca) (diffs)
• 

  Rui Xue 11 Dec 2025 ff549d86a2c40ec5e3dcebc785489336d5bea1eb m

  Merge branch 'pclean' of https://github.com/r-xue/pipeline into pclean
• 

  Rui Xue 11 Dec 2025 7fe8f805b5dd41cec58320eebf0771cd4f4cbb44 m

  PIPE-1836: Swicth to use timezone-aware `datetime` objects; remove `unix_seconds_to_datetime` and the associated test.

  • pipeline/infrastructure/utils/conversion.py (version 7fe8f805b5dd41cec58320eebf0771cd4f4cbb44) (diffs)
  • pipeline/infrastructure/utils/conversion_test.py (version 7fe8f805b5dd41cec58320eebf0771cd4f4cbb44) (diffs)
• 

  Rui Xue <r-xue@users.noreply.github.com> 11 Dec 2025 bef1b696b5f2a33a509600502b548e1960b41e01 m

  PIPE-2926: Apply suggestions from code review
  * Fix typos
  
  Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

  • pipeline/infrastructure/renderer/logger.py (version bef1b696b5f2a33a509600502b548e1960b41e01) (diffs)
  • pipeline/infrastructure/utils/pclean.py (version bef1b696b5f2a33a509600502b548e1960b41e01) (diffs)
  • pipeline/infrastructure/utils/pclean_test.py (version bef1b696b5f2a33a509600502b548e1960b41e01) (diffs)
• 

  Rui Xue 11 Dec 2025 d30c6812f7496c49f6fb3581a6e32c6cfc375679 m

  PIPE-2924: Run unit tests for all branches

  • .github/workflows/test-unit.yml (version d30c6812f7496c49f6fb3581a6e32c6cfc375679) (diffs)
• 

  Rui Xue 11 Dec 2025 bba8a9ec36789ba1a7ed86b5daeecc4b6fe1d27a m

  PIPE-2926: Add the `utils.pclean` utility helper and corresponding tests for `CASA6` executable search and tclean/parallel execution in an independent subprocess.

  • pipeline/infrastructure/utils/pclean.py (version bba8a9ec36789ba1a7ed86b5daeecc4b6fe1d27a) (diffs)
  • pipeline/infrastructure/utils/pclean_test.py (version bba8a9ec36789ba1a7ed86b5daeecc4b6fe1d27a) (diffs)
• 

  Rui Xue 11 Dec 2025 f50a992f3c5046a802c5401958e3b63ee0873e37 m

  PIPE-1836: Replace deprecated `datetime` and `spawn` APIs and clean up deprecation warnings.

  • pipeline/infrastructure/casa_tools.py (version f50a992f3c5046a802c5401958e3b63ee0873e37) (diffs)
  • pipeline/infrastructure/renderer/logger.py (version f50a992f3c5046a802c5401958e3b63ee0873e37) (diffs)
  • pipeline/infrastructure/utils/conversion.py (version f50a992f3c5046a802c5401958e3b63ee0873e37) (diffs)