Skip to navigation
Skip to content

Code commits

Pipeline

Takeshi Nakazato 29 May 2026 7b6ed11fe0d40a1e5a88cbbd8166bccb64cf8e3d

Pull request #1808: PIPE-2959 / PIPE-2964 hsd_baseline use 75 quantile as a representative line width of the detected cluster & take into account flagged edge channels
Merge in PIPE/pipeline from PIPE-2964-hsd_baseline-use-75-quantile-as-a-representative-line-width-of-the-detected-cluster to main

* commit '2ac046968e0a967aa527bda4a46466a7a310ab24':
  PIPE-2959/PIPE-2964 refactoring
  PIPE-2959/PIPE-2964 avoid hard-coded value
  Inherit function attributes (docstrings, type annotations, etc.) from wrapped function
  Improve type annotation
  PIPE-2959/PIPE-2964 tweak comments
  PIPE-2959/PIPE-2964 remove context from the arg for score_sd_line_detection
  PIPE-2959/PIPE-2964 use channelmap_range for wide line/edge line/deviation mask QA evaluation
  PIPE-2959/PIPE-2964 Check *actual* flag status to obtain flagged edge channels
  import numpy as np
  adjust the formatting of log message
  improvement of log message
  fix bug in resolving conflict
  Updated edge channel QA to take into account edge channels flagged by edgespw heuristic in hsd_flagdata stage
  additional change for clustering property plot
  import numpy as np
  replace representative line with 75% percentile
  remove set_data method
  PIPE-2964 use 75% percentile value as representative line width
Takeshi Nakazato 21 May 2026 2ac046968e0a967aa527bda4a46466a7a310ab24 m

Merge branch 'main' into PIPE-2964-hsd_baseline-use-75-quantile-as-a-representative-line-width-of-the-detected-cluster
Takeshi Nakazato 21 May 2026 c1912973d1e9f87d675ce4ce53d931f250e6f56e m

PIPE-2959/PIPE-2964 refactoring
- pipeline/hsd/tasks/baseline/maskline.py (version c1912973d1e9f87d675ce4ce53d931f250e6f56e) (diffs)
Takeshi Nakazato 20 May 2026 83b30117a0034d964028bc6114af09c841930a29 m

PIPE-2959/PIPE-2964 avoid hard-coded value
- pipeline/hsd/tasks/baseline/detection.py (version 83b30117a0034d964028bc6114af09c841930a29) (diffs)
Takeshi Nakazato 10 May 2026 bb5df017af018e4a8dfaa091e224a86bf93c1af9 m

Inherit function attributes (docstrings, type annotations, etc.) from wrapped function
- pipeline/qa/scorecalculator.py (version bb5df017af018e4a8dfaa091e224a86bf93c1af9) (diffs)
Takeshi Nakazato 10 May 2026 8976d5167a39d48a9c0e3ecb81d53955e920e309 m

Improve type annotation
- pipeline/qa/scorecalculator.py (version 8976d5167a39d48a9c0e3ecb81d53955e920e309) (diffs)
Takeshi Nakazato 30 Apr 2026 5fa30ee508f9713373861e2bd06fe832eb0d7cfc m

Merge branch 'main' into PIPE-2964-hsd_baseline-use-75-quantile-as-a-representative-line-width-of-the-detected-cluster
Takeshi Nakazato 30 Apr 2026 9ca6f97661adb8923356be7ad453985369b9e8a0 m

PIPE-2959/PIPE-2964 tweak comments
- pipeline/qa/scorecalculator.py (version 9ca6f97661adb8923356be7ad453985369b9e8a0) (diffs)
Takeshi Nakazato 30 Apr 2026 c78e78fb6ca9ac74e429509d9c1d4edf1ca94c63 m

PIPE-2959/PIPE-2964 remove context from the arg for score_sd_line_detection
- pipeline/hsd/tasks/baseline/qa.py (version c78e78fb6ca9ac74e429509d9c1d4edf1ca94c63) (diffs)
- pipeline/qa/scorecalculator.py (version c78e78fb6ca9ac74e429509d9c1d4edf1ca94c63) (diffs)
Takeshi Nakazato 29 Apr 2026 961d5948a360f1b4d61f0e86bf2100d507062913 m

PIPE-2959/PIPE-2964 use channelmap_range for wide line/edge line/deviation mask QA evaluation
- pipeline/qa/scorecalculator.py (version 961d5948a360f1b4d61f0e86bf2100d507062913) (diffs)
Takeshi Nakazato 29 Apr 2026 f442d3bf94bf60158cc4dd36bc19384b14784f49 m

PIPE-2959/PIPE-2964 Check *actual* flag status to obtain flagged edge channels
Previous version inferred flagged channels from the processing log of hsd_flagdata stage. But it may miss additional flagging in hsd_tsysflag and hsd_applycal. The new method checks actual data in the line detection stage so it should be more robust.
- pipeline/hsd/tasks/baseline/baseline.py (version f442d3bf94bf60158cc4dd36bc19384b14784f49) (diffs)
- pipeline/hsd/tasks/baseline/detection.py (version f442d3bf94bf60158cc4dd36bc19384b14784f49) (diffs)
- pipeline/hsd/tasks/baseline/maskline.py (version f442d3bf94bf60158cc4dd36bc19384b14784f49) (diffs)
- pipeline/qa/scorecalculator.py (version f442d3bf94bf60158cc4dd36bc19384b14784f49) (diffs)
Takeshi Nakazato 28 Apr 2026 9094b50d9351ad4395fa4560f2ddc754c5bf9d40 m

import numpy as np
- pipeline/hsd/tasks/baseline/detection.py (version 9094b50d9351ad4395fa4560f2ddc754c5bf9d40) (diffs)
Takeshi Nakazato 28 Apr 2026 faf9a1a001b7972ec114786826dcdb1a2d9eda13 m

adjust the formatting of log message
- pipeline/qa/scorecalculator.py (version faf9a1a001b7972ec114786826dcdb1a2d9eda13) (diffs)
Takeshi Nakazato 28 Apr 2026 b2387070aec74851925e311e4f91f292f04d665a m

improvement of log message
Co-authored-by: Copilot <copilot@github.com>
- pipeline/qa/scorecalculator.py (version b2387070aec74851925e311e4f91f292f04d665a) (diffs)
Takeshi Nakazato 27 Apr 2026 a687fc9a3c0836f278a85efd0ee338b8fdea87de m

fix bug in resolving conflict
- pipeline/hsd/tasks/baseline/validation.py (version a687fc9a3c0836f278a85efd0ee338b8fdea87de) (diffs)
Takeshi Nakazato 27 Apr 2026 a4a4a9eb7293d550994f6a784912df51ccce426e m

Merge branch 'main' into PIPE-2964-hsd_baseline-use-75-quantile-as-a-representative-line-width-of-the-detected-cluster
Takeshi Nakazato 24 Apr 2026 896fdfc4cc7a1f938804b740b0f5a2a30a2e2073 m

Updated edge channel QA to take into account edge channels flagged by edgespw heuristic in hsd_flagdata stage
Co-authored-by: Copilot <copilot@github.com>
- pipeline/hsd/tasks/baseline/qa.py (version 896fdfc4cc7a1f938804b740b0f5a2a30a2e2073) (diffs)
- pipeline/qa/scorecalculator.py (version 896fdfc4cc7a1f938804b740b0f5a2a30a2e2073) (diffs)
Takeshi Nakazato 22 Apr 2026 c3c19c89612f6c224e526b3507c1832e860370e7 m

additional change for clustering property plot
- pipeline/hsd/tasks/baseline/display.py (version c3c19c89612f6c224e526b3507c1832e860370e7) (diffs)
- pipeline/hsd/tasks/baseline/validation.py (version c3c19c89612f6c224e526b3507c1832e860370e7) (diffs)
Takeshi Nakazato 22 Apr 2026 a071dda9b52e38dc655008759133b37e7b8df50c m

import numpy as np
- pipeline/hsd/tasks/baseline/validation.py (version a071dda9b52e38dc655008759133b37e7b8df50c) (diffs)
Takeshi Nakazato 22 Apr 2026 bce74cee73ae49d7c21906943beed20a430b5a65 m

replace representative line with 75% percentile
original representative line width is mean
- pipeline/hsd/tasks/baseline/validation.py (version bce74cee73ae49d7c21906943beed20a430b5a65) (diffs)
Takeshi Nakazato 21 Apr 2026 d3b14720d278005816a85f5d7ed7392a642580fa m

remove set_data method
- pipeline/hsd/tasks/baseline/validation.py (version d3b14720d278005816a85f5d7ed7392a642580fa) (diffs)
Takeshi Nakazato 21 Apr 2026 eb0d743dc7cb55c750510ef1585cc3126a5f8973 m

PIPE-2964 use 75% percentile value as representative line width
- pipeline/hsd/tasks/baseline/validation.py (version eb0d743dc7cb55c750510ef1585cc3126a5f8973) (diffs)