Skip to navigation
Skip to content

Code commits

Pipeline

Takeshi Nakazato Yesterday 60a4c0de699922601dcb4adecc5377495d6b9989

Pull request #1762: PIPE-2945 hsd_skycal should not crash if it failed to generate sky caltable for only one
Merge in PIPE/pipeline from PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one to main

* commit '16ce874a58991b45f3955a2b0924440c2e5becae':
  Skip generating elevation plot if the data is empty
  Bug fix on removing extra files created by plotbandpass
  Fix wrong scan number issue in amp vs freq summary plot
  Skip computing elevation difference when no valid skycal solution exists
  Improvement of warning message
  refactoring
  Remove obsolete debug log
  Simply the implementation
  Remove unused class
  Refactoring
  Fix typo
  Error accurate error handling
  PIPE-2945 consolidate per-fields sdcal calls into just a single call
Rui Xue 2 days ago b49d03f06a1a212024a52fada5fa3e60699a3099

Pull request #1767: PIPE-2947: Implement NaN handling for `savgol_filter` and update requirements to unpin scipy version
Merge in PIPE/pipeline from PIPE-2947-update-heuristics to main

* commit '0c9b827f1b746ffb8167e59bff1ef6824776157f':
PIPE-2947: Implement NaN handling for `savgol_filter` and update requirements to unpin scipy version
Rui Xue 2 days ago 0c9b827f1b746ffb8167e59bff1ef6824776157f

Merge remote-tracking branch 'origin/main' into PIPE-2947-update-heuristics
Shawn Booth 2 days ago 5d62817fa7d0d41f848349fcf5ca3d7e2962cc02

Pull request #1736: PIPE-1787: Integrating Regression Test Documentation into RTD Source Code
Merge in PIPE/pipeline from integrate-docs-to-source-code to main

* commit 'e72af9e9f6dc3cdcab1f3251c0b9ae662207d915':
PIPE-1787: move table of contents to top of page
PIPE-1787: integrated regression testing instructions from confluence; updated to include information on component and unit tests
Shawn Booth 2 days ago e72af9e9f6dc3cdcab1f3251c0b9ae662207d915

Merge remote-tracking branch 'origin/main' into integrate-docs-to-source-code
Takeshi Nakazato 2 days ago 16ce874a58991b45f3955a2b0924440c2e5becae

Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
Takeshi Nakazato 2 days ago 20c1fde25f0a690cb78314659b1e9a8ed2020392 m

Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
Takeshi Nakazato 03 Apr 2026 4b5feeae87f2ef5ebf044820d526bf65cc7157a7 m

Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
Rui Xue 06 Mar 2026 7f3794e7df2628a7b1b716a29ae7e232c328edcf m

PIPE-2947: Implement NaN handling for `savgol_filter` and update requirements to unpin scipy version
- pipeline/extern/tsys_contamination.py (version 7f3794e7df2628a7b1b716a29ae7e232c328edcf) (diffs)
- requirements.txt (version 7f3794e7df2628a7b1b716a29ae7e232c328edcf) (diffs)
Takeshi Nakazato 05 Mar 2026 6bd6eda69c28b5462468ef6a5e50bf6ecf98991f m

Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
Takeshi Nakazato 05 Mar 2026 ec6fb94ba469edc29e641489465e6dba53d54d3e m

Skip generating elevation plot if the data is empty
Also skip computation of QA score when no valid elevation data exists
- pipeline/hsd/tasks/skycal/display.py (version ec6fb94ba469edc29e641489465e6dba53d54d3e) (diffs)
- pipeline/hsd/tasks/skycal/qa.py (version ec6fb94ba469edc29e641489465e6dba53d54d3e) (diffs)
- pipeline/qa/scorecalculator.py (version ec6fb94ba469edc29e641489465e6dba53d54d3e) (diffs)
Takeshi Nakazato 02 Mar 2026 ce83f32506e9b4e7e8350a4aae4e307df950093c m

Bug fix on removing extra files created by plotbandpass
- pipeline/hsd/tasks/skycal/display.py (version ce83f32506e9b4e7e8350a4aae4e307df950093c) (diffs)
Takeshi Nakazato 01 Mar 2026 618496ee619b22d60aee52952697a1eb043b2d08 m

Fix wrong scan number issue in amp vs freq summary plot
- pipeline/hsd/tasks/skycal/display.py (version 618496ee619b22d60aee52952697a1eb043b2d08) (diffs)
Takeshi Nakazato 27 Feb 2026 6de8e305cd541b4e45118553402b67f9c4e58203 m

Merge branch 'main' into PIPE-2945-hsd_skycal-sdpl-should-not-crash-if-it-failed-to-generate-sky-caltable-for-only-one
Takeshi Nakazato 26 Feb 2026 c61b8fd053fa577510c499c7e6c3a596d0725301 m

Skip computing elevation difference when no valid skycal solution exists
- pipeline/hsd/tasks/skycal/skycal.py (version c61b8fd053fa577510c499c7e6c3a596d0725301) (diffs)
Takeshi Nakazato 26 Feb 2026 ad18b5d72cb8640e85b493e2f57a80f09c22a921 m

Improvement of warning message
- pipeline/hsd/tasks/skycal/qa.py (version ad18b5d72cb8640e85b493e2f57a80f09c22a921) (diffs)
- pipeline/hsd/tasks/skycal/skycal.py (version ad18b5d72cb8640e85b493e2f57a80f09c22a921) (diffs)
Takeshi Nakazato 26 Feb 2026 2c4b2e3fb7ba86e1e1946f99ef4bba4460df2330 m

refactoring
- pipeline/hsd/tasks/skycal/skycal.py (version 2c4b2e3fb7ba86e1e1946f99ef4bba4460df2330) (diffs)
Takeshi Nakazato 26 Feb 2026 2845e289ea7ca05db4755a0d20595aa92ce671b5 m

Remove obsolete debug log
This was introduced in PIPE-273/CAS-11784 to check if there is tables left open after task execution. Since the issue has been solved already, there is no need to check table cache any more.
- pipeline/hsd/tasks/skycal/skycal.py (version 2845e289ea7ca05db4755a0d20595aa92ce671b5) (diffs)
Takeshi Nakazato 26 Feb 2026 f65ae8e2be7e0c42c8ef1fba9052735e76e6e91d m

Simply the implementation
This is possible because per-field loop disappeared so that we no longer need to reuse args in the loop.
- pipeline/hsd/tasks/skycal/skycal.py (version f65ae8e2be7e0c42c8ef1fba9052735e76e6e91d) (diffs)
Takeshi Nakazato 26 Feb 2026 c262e3cf0a5a8e0dad6620541472e96a348eece0 m

Remove unused class
- pipeline/hsd/tasks/skycal/display.py (version c262e3cf0a5a8e0dad6620541472e96a348eece0) (diffs)
Takeshi Nakazato 26 Feb 2026 ecfb0f7083fe5b16e83ec5a9ce2da6f5de910dab m

Refactoring
- pipeline/hsd/tasks/skycal/display.py (version ecfb0f7083fe5b16e83ec5a9ce2da6f5de910dab) (diffs)
Takeshi Nakazato 25 Feb 2026 b0617c27b778bdbb8c56a528b7e2020428a73ce4 m

Fix typo
- pipeline/hsd/tasks/applycal/applycal.py (version b0617c27b778bdbb8c56a528b7e2020428a73ce4) (diffs)
Takeshi Nakazato 25 Feb 2026 0c79928eb4ca0732b58bfcf070f5f04db1e6c5b4 m

Error accurate error handling
When a certain field cannot be calibrated (because caltable is empty or
it doesn't have corresponding calibration data), warning message will be
emitted. In that case, QA calculation and elevation plots are skipped.

Currently, no additional flagging is made to ON_SOURCE data without sky calibration data.
Therefore, uncalibrated data might contaminate to the final cube image.
- pipeline/hsd/tasks/skycal/qa.py (version 0c79928eb4ca0732b58bfcf070f5f04db1e6c5b4) (diffs)
- pipeline/hsd/tasks/skycal/renderer.py (version 0c79928eb4ca0732b58bfcf070f5f04db1e6c5b4) (diffs)
- pipeline/hsd/tasks/skycal/skycal.py (version 0c79928eb4ca0732b58bfcf070f5f04db1e6c5b4) (diffs)
- pipeline/hsd/templates/skycal.mako (version 0c79928eb4ca0732b58bfcf070f5f04db1e6c5b4) (diffs)
Takeshi Nakazato 24 Feb 2026 99693dcd6b6192d40ed9768e16f6383728c51cb8 m

PIPE-2945 consolidate per-fields sdcal calls into just a single call
By doing that, resulting caltable will also be consolidated. In addition, exception from sdcal task has been captured by pipeline and turned into warning message.
- pipeline/h/heuristics/caltable.py (version 99693dcd6b6192d40ed9768e16f6383728c51cb8) (diffs)
- pipeline/hsd/tasks/skycal/display.py (version 99693dcd6b6192d40ed9768e16f6383728c51cb8) (diffs)
- pipeline/hsd/tasks/skycal/skycal.py (version 99693dcd6b6192d40ed9768e16f6383728c51cb8) (diffs)
Shawn Booth 29 Jan 2026 44099bd22537df3f642d3fc5d2b47ac0c446ab6d m

PIPE-1787: move table of contents to top of page
- docs/source/testing_docs/index.rst (version 44099bd22537df3f642d3fc5d2b47ac0c446ab6d) (diffs)
Shawn Booth 27 Jan 2026 0800ae57405941e700aa0cab5e59c6d95ac24513 m

PIPE-1787: integrated regression testing instructions from confluence; updated to include information on component and unit tests
- docs/source/index.rst (version 0800ae57405941e700aa0cab5e59c6d95ac24513) (diffs)
- docs/source/testing_docs/automated_testing.rst (version 0800ae57405941e700aa0cab5e59c6d95ac24513) (diffs)
- docs/source/testing_docs/index.rst (version 0800ae57405941e700aa0cab5e59c6d95ac24513) (diffs)
- docs/source/testing_docs/unit_testing.rst (version 0800ae57405941e700aa0cab5e59c6d95ac24513) (diffs)