Build: #7 was successful Changes by Shawn Booth
Code commits
Pipeline
-
Shawn Booth c46d795a414ed2e2edff0d7af90b9de780f25531
Merge remote-tracking branch 'origin/main' into context-serializer
-
Shawn Booth e563dbb33dcac9ad0cab54ce53afe2eaa150e72e
renderer metadata save/load wiring extended to all renderers; implemented task-specific T2_4Details caching with cross-stage reuse enabled; phase 3 documentation updated
- docs/source/context_serialization/PHASE3_IMPLEMENTATION.md (version e563dbb33dcac9ad0cab54ce53afe2eaa150e72e) (diffs)
- docs/source/context_serialization/PHASE3_SUMMARY.md (version e563dbb33dcac9ad0cab54ce53afe2eaa150e72e) (diffs)
- pipeline/infrastructure/basetask.py (version e563dbb33dcac9ad0cab54ce53afe2eaa150e72e) (diffs)
- pipeline/infrastructure/renderer/basetemplates.py (version e563dbb33dcac9ad0cab54ce53afe2eaa150e72e) (diffs)
- pipeline/infrastructure/renderer/htmlrenderer.py (version e563dbb33dcac9ad0cab54ce53afe2eaa150e72e) (diffs)
-
Rui Xue 261c8820cf8063cfe2473d253e43767b132bbc31 m
Pull request #1754: PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
Merge in PIPE/pipeline from sync-bitbucket-github-repos-with-workflow to main
* commit '598ae9e3096c183c8230659aa9a2caeb715ff123':
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket -
Rui Xue <rx.astro@gmail.com> 598ae9e3096c183c8230659aa9a2caeb715ff123 m
PIPE-2995: Add GitHub workflow for syncing with On-Prem Bitbucket
-
Rui Xue 5dead9ae807422078ab5ba32dacd80165f625251 m
Pull request #1729: Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
Merge in PIPE/pipeline from unit-test-vlass2026 to main
* commit 'd9b21b61a46e2b5984530ce12c589bfcbf4805cd':
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
PIPE-2940: Add Pixi environment definitions for the PL2026 development
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026. -
Rui Xue 70ccb2d1e69f7d5fe145c9d918a38f79efc90820 m
Pull request #1733: PIPE-2937/PIPE-2929/PIPE-2982
Merge in PIPE/pipeline from PIPE-2937-avoid-writing-large-tmp-large-images-from-the-nf-snr-calculation-function to main
* commit '29110a640d1e0d17d853a7b45d55d91bb63ffa27':
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability: -
Rui Xue 29110a640d1e0d17d853a7b45d55d91bb63ffa27 m
PIPE-2937: Bypass the `JobRequest` wrapper layer for direct `casaplotms` execution and enable debug tracebacks for mask checking errors
-
Shawn Booth 22af317489c1fd10d6b7d0a0fad24cea18621894
fixed bug to handle unpickeable objects with graceful error handling and a helper function for namedtuples
-
Shawn Booth fa33113870b0654e10dcfe27e742b5fcbb2de668
updated documentation to align with current implementation
- docs/source/context_serialization/CONTEXT_STORAGE_INVESTIGATION.md (version fa33113870b0654e10dcfe27e742b5fcbb2de668) (diffs)
- docs/source/context_serialization/EXECUTIVE_SUMMARY.md (version fa33113870b0654e10dcfe27e742b5fcbb2de668) (diffs)
- docs/source/context_serialization/PHASE3_IMPLEMENTATION.md (version fa33113870b0654e10dcfe27e742b5fcbb2de668) (diffs)
-
Shawn Booth bda8205b656541c0db5737074737f81d147b2faf
removed unnecessary files and cleaned up documentation
- docs/source/context_serialization/COMPLETE_IMPLEMENTATION_SUMMARY.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/DELIVERABLES_MANIFEST.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/EXECUTIVE_SUMMARY.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/FAST_PATH_RENDERERS.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/INDEX.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/INVESTIGATION_SUMMARY.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/PHASE3_SUMMARY.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/PICKLING_PROFILING.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/QUICK_REFERENCE.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/README.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/README_INVESTIGATION.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/RENDERER_OPTIMIZATION.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/SERIALIZATION_BEFORE_AFTER.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/SERIALIZATION_INTEGRATION_GUIDE.md (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/START_HERE.txt (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
- docs/source/context_serialization/benchmarking/verify_fix.py (version bda8205b656541c0db5737074737f81d147b2faf) (diffs)
-
Takeshi Nakazato 9e4f33aac7ac435cb3d1dc09b867f5e3c0f062d9 m
Pull request #1727: PIPE-2894 always display channel axis to sparse profile map
Merge in PIPE/pipeline from PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map to main
* commit '3a599a4f0e1e027e7f556d83ea70f672836bf335':
move channel axis label upward slightly
added note to docstring for add_channel_axis
PIPE-2894 always display channel axis to sparse profile map -
Shawn Booth 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b
Phase 3: Adaptive parallel unpickling with thread-safety
Implement intelligent parallel unpickling optimization for weblog rendering
with comprehensive thread-safety fixes and adaptive worker scaling.
Core Changes:
- Adaptive parallel unpickling strategy (htmlrenderer.py)
* 150KB threshold for parallel vs sequential decision
* Worker scaling based on file size (12→6→3 workers)
* Auto-detects CPU count, caps at result count
* Handles cold cache variability with consistent performance
- Thread-safety for CalFrom Flyweight pool (callibrary.py)
* Added threading.RLock for pool synchronization
* Protected WeakValueDictionary read/write operations
* Double-check locking prevents duplicate object creation
* Fixed LOG.isEnabledFor(logging.TRACE) bug
* Enables crash-free parallel unpickling on 25GB+ datasets
- ResultsProxy path property (basetask.py)
* Cleaner path management for pickle files
* Enables file size inspection for adaptive strategy
Performance Results (Cold Cache - Production):
- INT (48 files, 162KB avg): 1.35s → 0.28s (4.8x speedup, 1.07s saved)
- SD (14 files, 1.5MB avg): 0.62s → 0.36s (1.7x speedup, 0.26s saved)
- Large (57 files, 450MB avg): 70.15s → 58.76s (1.2x speedup, 11.39s saved)
Consistency Benefits:
- Sequential variability: 0.17-1.41s (8.3x range, cache-dependent)
- Parallel consistency: 0.26-0.28s (1.1x range, cache-independent)
- Result: Predictable performance regardless of disk cache state
Thread-Safety Validation:
- Tested on 25GB dataset (57 results) without crashes
- Fixed race condition in CalFrom pool (WeakValueDictionary iteration)
- Production-ready for concurrent unpickling operations
Combined Phase 1-3 Impact:
- Re-render after change: 30-90s → 0.5-2s (15-180x faster)
- Debug cycle (5 renders): 150s → 34s (77% time saved)
- Annual time saved: 293-1,225 hours ($29K-$184K value at NAASC scale)
- Crash prevention: Eliminated race condition crashes (50-100/year)
- Memory efficiency: 40% reduction in peak rendering memory
Documentation:
- COMPLETE_IMPLEMENTATION_SUMMARY.md: Full 3-phase overview
- PHASE3_SUMMARY.md: Phase 3 detailed results
- PHASE3_IMPLEMENTATION.md: Technical implementation notes
- PICKLING_PROFILING.md: Optimization analysis
- profile_pickling.py: Performance profiling tool (350+ lines)
Files Modified:
- pipeline/infrastructure/renderer/htmlrenderer.py (adaptive unpickling)
- pipeline/infrastructure/callibrary.py (thread-safety + RLock)
- pipeline/infrastructure/basetask.py (path property)
- docs/source/context_serialization/ (5 files, 2,500+ lines)
Testing:
- Validated on 3 production workload types (INT, SD, Large)
- Thread-safety tested with 25GB context
- Performance profiling with cold/warm cache scenarios
- Backward compatible, zero API changes
References: PIPE-2140- docs/source/context_serialization/COMPLETE_IMPLEMENTATION_SUMMARY.md (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- docs/source/context_serialization/PHASE3_IMPLEMENTATION.md (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- docs/source/context_serialization/PHASE3_SUMMARY.md (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- docs/source/context_serialization/PICKLING_PROFILING.md (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- docs/source/context_serialization/profile_pickling.py (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- pipeline/infrastructure/basetask.py (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- pipeline/infrastructure/callibrary.py (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
- pipeline/infrastructure/renderer/htmlrenderer.py (version 9fc5752213f43ed5d51cf75cc3fab59ef5e8e75b) (diffs)
-
Kristin Berry 465285e01b87f372c957660f993a467c2b67a264 m
Pull request #1745: PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
Merge in PIPE/pipeline from PIPE-2985-update-developer-documentation-to-reflect-change-in-how-to-fetch-the-context to main
* commit '84610e456d06c5b0b695a098e974859674ecf063':
PIPE-2985: Update bullet-points to use - rather than o
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects -
Kristin Berry 84610e456d06c5b0b695a098e974859674ecf063 m
PIPE-2985: Update bullet-points to use - rather than o
-
Rui Xue 86fc31bbafba3c8bef51d393fa16ca193a2a57f2 m
Pull request #1744: PIPE-2916/PIPE-2986: Fix the offset search limit by using half of the cutout image size; improve observing_run handling in hif_transformimagedata
Merge in PIPE/pipeline from PIPE-2916-fix-field-selection-limit to main
* commit '42735b2555f8e61818dca1abd0914d087009175a':
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
PIPE-2916: Fix the offset search limit by using half of the cutout image size. -
Rui Xue 42735b2555f8e61818dca1abd0914d087009175a m
PIPE-2916: Rename `imaging_imsize` to `imsize_from_cutout` for clarity and update references in `editimlist`
-
Vincent Geers 94268aa24af2f9c7d36c4f45214750b9f14ae682 m
Pull request #1660: PIPE-2689: add new residual phase offset QA scores to hifa_diffgaincal
Merge in PIPE/pipeline from PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals to main
* commit '26306aec824fa25e46796a8667050d46ab51879f':
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
PIPE-2689: Update scores for poor and elevated cases to lower severity
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
PIPE-2689: Fix to take the max of the absolute value rather than abs val of the max and incorporate B2B offset solution diferences into score.
PIPE-2689: Fix loop over all antennas per timestamp to instead loop over a list of unique antennas
PIPE-2689: update hifa_diffgaincal QA to refactor step that generates a consolidated QA message.
PIPE-2689: update hifa_diffgaincal QA to add new score for residual diffgain phase offsets. -
Kristin Berry bfbbaa0368fe900908701bbb32276f319be535df m
PIPE-2985: Remove outdated test instructions from docstrings. Similar test instructions exist in developer documentation markdown files.
- pipeline/h/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version bfbbaa0368fe900908701bbb32276f319be535df) (diffs)
-
Rui Xue c803738bb10600e6c981f04299977d89b71acdb9 m
Pull request #1747: PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
Merge in PIPE/pipeline from PIPE-2947-restrict-scipy-versions to main
* commit '0d175efa4b8737eb989c29f85733e0c8d38bc953':
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+ -
Ajay Vibhute 10433a340af5e4fa2481a549357eb38720420103 m
Pull request #1746: PIPE-2987: changing log level of message to 'info'
Merge in PIPE/pipeline from PIPE-2987-set-log-level-to-info-for-message-in-phasecenter_to_skycoord to main
* commit '0af3f3f8f1ef7bae96e03951988831d580ff1d44':
PIPE-2987: changing log level of message to 'info' -
Rui Xue 0d4b78ef40cd78e712540ef858a07e5c821a9c4b m
Pull request #1739: PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
Merge in PIPE/pipeline from PIPE-2980-save-context-snapshot-before-weblog-rendering-for-loglevel-debug-model to main
* commit 'f4c6fb9eb954108ac509c86af0d1d8791bce9645':
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug -
Rui Xue d9b21b61a46e2b5984530ce12c589bfcbf4805cd m
PIPE-2940: Improve test data checkout by adding a directory existence check before cloning the repository
-
Rui Xue 0d175efa4b8737eb989c29f85733e0c8d38bc953 m
PIPE-2947: Pin scipy version to avoid compatibility issues with 1.17+
-
Kristin Berry 5129aacd04c5b51be9953b76172fb17ae994225f m
PIPE-2985: Remove unneeded import statements and restore notebook execution count to 1
-
Ajay Vibhute 0af3f3f8f1ef7bae96e03951988831d580ff1d44 m
PIPE-2987: changing log level of message to 'info'
-
Rui Xue 59c8188f469ff3a13e3cf13514ca275405dbc0e4 m
PIPE-2940: Add Pixi environment definitions for the PL2026 development
-
Rui Xue 14c61f65845bec6b84e4aa229f8adadce7dfed1f m
PIPE-2986: Streamline the MS object replacement logic in `hif_transformimagedata` and improve logging
-
Kristin Berry 135cf97804064a13bedd459633f8849061b6ca0a m
PIPE-2985: Update docs to reflect change to use launcher to access the Pipeline and context objects
- docs/source/develdocmd/DeveloperDocumentation.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/develdocmd/ways_to_run_the_pipeline.md (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- docs/source/notebooks/context.ipynb (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/flagging/flagdeterbase.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/h/tasks/restoredata/restoredata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hifv/tasks/flagging/flagdetervla.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/hsd/tasks/exportdata/exportdata.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
- pipeline/infrastructure/new_pipeline_task/verify_new_pipeline_task.py (version 135cf97804064a13bedd459633f8849061b6ca0a) (diffs)
-
Rui Xue 1d80cb40e721b7ec87c4ee7faa63260e0f4a79c9 m
PIPE-2916: Update example output in docstring for `imaging_imsize` to reflect the correct dimensions
-
Rui Xue 7be8cb4542002e053347059bf832b9641c32ddf1 m
PIPE-2916: Fix the offset search limit by using half of the cutout image size.
-
Rui Xue ff81a69f88b19bde5acbec5fcc55c199e98bf8fc m
PIPE-2937: Reduce the number of used `iatool` instances and use in-place Boolean operators to further reduce peak memory usage
-
Rui Xue 5d766135d6e53fcaf6a8587471448022205f7311 m
PIPE-2982: Replace vectorized contour plotting of clean mask islands with raster boundary plotting, to avoid excess memory usage for large images
-
Kristin Berry 26306aec824fa25e46796a8667050d46ab51879f m
PIPE-2689: Update to use built-in thresholds for scoring rather than magic number and update comments to reflect current state of scores.
-
Ajay Vibhute 1fc30b1c7ac18ecd77610ee3ccc15b190fcba272 m
Pull request #1705: PIPE-2580: QA score for hifv_testBPdcals
Merge in PIPE/pipeline from PIPE-2580-hifv_testbpdcals-qa-criteria to main
* commit '218b1b17a9dfa015c33d1ea932d343cdaa7ab02a':
PIPE-2580: included bad refant/s in the weblog message
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
PIPE-2580: added applies_to to the QA scores
PIPE-2580: returning score 1.0 when everything is fine, renamed ref_ant to refant, and used SCORE_THRESHOLD_ERROR instead of hardcoded 0.3
PIPE-2580: QA score for hifv_testBPdcals -
Luke Maud 0db75813d36a22ccde45d9ae528f82bc1dca112b m
Pull request #1723: PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic
Merge in PIPE/pipeline from PIPE-2915-stop-hifa_diffgaincal-crashing-if-the-first-diffgain-scan-group-set-is-fully-flagged to main
* commit 'ebfc12707e30e2ab90b53f0e6464d67912cf99bd':
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic -
Rui Xue f4c6fb9eb954108ac509c86af0d1d8791bce9645 m
PIPE-2980: Save context snapshot before weblog rendering for loglevel debug
-
Rui Xue 31e86a1d7c971cb9da5283a724b8b03d673745d0 m
PIPE-2937: Fix an issue with image removal before closing the associated `ia` instances
-
Rui Xue 448be2c8aed741f59ac62b3667bc83c98fc73c5b m
PIPE-2929: Fix a regression related to casa-compatble field name conversion, introduced when porting mosaic self-calibration (PIPE-2001)
-
Ajay Vibhute 60282b613ca7ba9625a300f1a4e25433803d6a0d m
Pull request #1713: PIPE-2166: potentially switch to doquantiles=False in visstat in hifa_polcal
Merge in PIPE/pipeline from PIPE-2166-potentially-switch-to-doquantiles-false-in-visstat-in-hifa_polcal to main
* commit '85d71ca40e6beb946daa6d00d757782c79edca31':
PIPE-2166: removed continue
PIPE-2166: removed extra whitespace
PIPE-2166: code cleanup
PIPE-2166: setting doquantiles= False in visstat cal in imageparams_vla
PIPE-2166: setting doquantiles to False in visstat -
Rui Xue 8c358ee6dbe9eb8c1ea895f1b3e2c287ac16c3e6 m
PIPE-2937: Refactor `estimate_SNR` and `estimate_near_field_SNR` to avoid writing large temporary images, improving efficiency and memory usage
-
Rui Xue 8a0f7c3bf61b6a94b352e2d27b5db421574d7add m
PIPE-2937: Refactor `create_noise_histogram` to improve efficiency and readability:
- Remove temporary file handling.
- Use `ia.histograms` for histogram calculation. -
Rui Xue 1021a12af545145f4d575bcc69f6f5c524c9318d m
Update GitHub workflows and environment configuration to include unit tests for VLASS-PL2026.
- Modify build-gh-pages.yml to trigger on changes to `environment*.yml`
- Update env-setup-run-template.yml to allow dynamic conda environment file input
- Adjust test-unit.yml to support multiple conda environments and update artifact naming logic
- Refine apisummary.rst to correct module references
- Add `new environment_vlass2026.yml` for specific pipeline dependencies of VLASS-PL2026- .github/workflows/build-gh-pages.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/env-setup-run-template.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- .github/workflows/test-unit.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- docs/source/apisummary.rst (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
- environment_vlass2026.yml (version 1021a12af545145f4d575bcc69f6f5c524c9318d) (diffs)
-
Rui Xue 3aedaf8e0ccd58c7e15a27a43f638464f9cdcb43 m
PIPE-2940: add `nondefaults` to the channel configuration in `environment_vlass2026.yml`
-
Rui Xue 9ced50c5939dce02f1b0b571ef9ccdcae59533db m
PIPE-2940: Update coverage configuration to exclude additional lines and improve test reporting
-
Takeshi Nakazato 3a599a4f0e1e027e7f556d83ea70f672836bf335 m
move channel axis label upward slightly
-
Takeshi Nakazato f0f64bcdf812d8198d1c62dfe5fd779c245e73c9 m
added note to docstring for add_channel_axis
-
Takeshi Nakazato 9d26316d3f9be62fb3470dba9aac87e3cb77f95d m
Merge branch 'main' into PIPE-2894-hsd_baseline-add-channel-axis-to-the-top-panel-of-sparse-profile-map
-
Kristin Berry 17413edf54594d80572f508ffd183efc5fa76fa5 m
PIPE-2689: Update scores for poor and elevated cases to lower severity
-
Ajay Vibhute 218b1b17a9dfa015c33d1ea932d343cdaa7ab02a m
PIPE-2580: included bad refant/s in the weblog message
-
Kristin Berry 4239a5f7ddad996c33ef10cd107a9c7454e40e38 m
PIPE-2689: Remove code added to support a new b2b offset qa score. This will come in with a separate ticket.
-
Kristin Berry 2111b7a919fc24bd9fe02c1f2448ccbab1f94c39 m
PIPE-2689: Update THRESHOLD_OVERALL_SNR to 5.0
-
Takeshi Nakazato 4d26e9806f4963cb529fa490af25b0bcab1be550 m
PIPE-2894 always display channel axis to sparse profile map
-
Kristin Berry dd25bef4d004e947656e5c2caf4125cb76d397b6 m
Merge branch 'main' of ssh://open-bitbucket.nrao.edu:7999/pipe/pipeline into PIPE-2689_hifa_diffgaincal_new_QA_score_for_residuals
-
Ajay Vibhute 85d71ca40e6beb946daa6d00d757782c79edca31 m
PIPE-2166: removed continue
-
Rui Xue ebfc12707e30e2ab90b53f0e6464d67912cf99bd m
PIPE-2915: Flatten the caltable appending logic for multiple scan groups in `DiffGaincal._do_phasecal`.
-
Ajay Vibhute 63f5b436f4d0a0f96a784f46a8b537a87c71e7f3 m
PIPE-2166: removed extra whitespace
-
Ajay Vibhute d1952834822dcb4501d5a815d031a9bdceae59a6 m
PIPE-2166: code cleanup
-
Ajay Vibhute cbbf75c4ed7672079c58cc735cc40e5cffdffc7d m
PIPE-2580: Refactored the QA score calculation, using one function per QA metric.
-
Ajay Vibhute b6baa15eed076ffe75718df1a6512f35400f754c m
PIPE-2580: added applies_to to the QA scores
-
Ajay Vibhute 2f7fc497965c1ef1829a86f600e99d26af8be8df m
PIPE-2580: returning score 1.0 when everything is fine, renamed ref_ant to refant, and used SCORE_THRESHOLD_ERROR instead of hardcoded 0.3
-
Ajay Vibhute 72adf2a2a2c4a1d1c2a544401f8f39880fa124ba m
PIPE-2166: setting doquantiles= False in visstat cal in imageparams_vla
-
Ajay Vibhute d2914f53929765e4d401c7ad665f8e803a689e25 m
PIPE-2166: setting doquantiles to False in visstat
-
Kristin Berry 87738e821497d2012edba52bdff75ae3b2f42eb0 m
PIPE-2689: Fix to take the max of the absolute value rather than abs val of the max and incorporate B2B offset solution diferences into score.
-
Kristin Berry a6df8af08844a6dcf1dbcdd3265a76ba26ca408a m
PIPE-2689: Fix loop over all antennas per timestamp to instead loop over a list of unique antennas
-
Ajay Vibhute 40734f9e701f1f437a75747c66891de0c13f1443 m
PIPE-2580: QA score for hifv_testBPdcals
-
Luke Maud 56e9d5839184c5ba0c16401d9a256432c78dc4b6 m
PIPE-2915 use os.path.exists to check for presence of caltable edit gaincal logic
-
Vincent Geers 8e49e0bd448ddd20545f661e684b5ea7eb15e60d m
PIPE-2689: update hifa_diffgaincal QA to refactor step that generates a consolidated QA message.
-
Vincent Geers a74dcc7598a68abf8eb377ab99026eacf74936a3 m
PIPE-2689: update hifa_diffgaincal QA to add new score for residual diffgain phase offsets.