Pipeline

• 

  Rui Xue 2 hours ago 9aafa49b7e352d69ed0e039f4aabb908e3f462a2

  Merge branch 'PIPE-3269-add-parsl-adaptation-layer-in-pipeline' of https://open-bitbucket.nrao.edu/scm/pipe/pipeline into PIPE-3269-add-parsl-adaptation-layer-in-pipeline
• 

  Rui Xue 2 hours ago 48abf28fb53e417a2673519c8cd010c403557aab m

  PIPE-3269: pre-compute importdata flag summaries
  - Pre-compute baseline flagdata summaries across imported MeasurementSets during ImportData.prepare() using parallel_map, and store them directly on ImportDataResults.
  - Update ImportDataQAHandler to passively consume the cached flag summaries and model data columns rather than issuing redundant disk queries against vis.ms. This decouples background QA rendering from subsequent in-place MS mutations, preventing table lock contention.

  • pipeline/h/tasks/importdata/importdata.py (version 48abf28fb53e417a2673519c8cd010c403557aab) (diffs)
  • pipeline/h/tasks/importdata/qa.py (version 48abf28fb53e417a2673519c8cd010c403557aab) (diffs)
  • pipeline/qa/scorecalculator_test.py (version 48abf28fb53e417a2673519c8cd010c403557aab) (diffs)