Build: #60 failed
Job: Test ManyLinux 2.28 Python 3.12 failed
uid a002 x85c183 x36f procedure hsd calimage regression: Test case result
The below summarizes the result of the test " uid a002 x85c183 x36f procedure hsd calimage regression" in build 60 of PIPESPECS - Test Pipeline main with Casa master - Test ManyLinux 2.28 Python 3.12.
- Description
- uid a002 x85c183 x36f procedure hsd calimage regression
- Test class
- tests.regression.fast.alma_sd_fast_test
- Method
- test_uid___A002_X85c183_X36f__procedure_hsd_calimage__regression
- Duration
- 78 mins
- Status
- Failed (New Failure)
Error Log
AssertionError: Expected key s13.hsd_imaging.uid___A002_X85c183_X36f.ms.atmcor.field_1.spw_17.qa.metric.line_emission_off_range_at_peak does not match new key s13.hsd_imaging.uid___A002_X85c183_X36f.ms.atmcor.field_1.spw_17.qa.metric.score_sd_line_emission_off_range_at_peak.
def test_uid___A002_X85c183_X36f__procedure_hsd_calimage__regression():
"""Run ALMA single-dish cal+image regression on the observation data of M100.
Recipe name: procedure_hsd_calimage
Dataset: uid___A002_X85c183_X36f
"""
ref_directory = 'pl-regressiontest/uid___A002_X85c183_X36f'
pt = PipelineTester(
visname=['uid___A002_X85c183_X36f'],
recipe='procedure_hsd_calimage.xml',
input_dir=ref_directory,
expectedoutput_dir=ref_directory,
)
> pt.run()
tests/regression/fast/alma_sd_fast_test.py:22:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
tests/testing_utils.py:376: in run
self.__compare_results(new_file, default_relative_tolerance)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <tests.testing_utils.PipelineTester object at 0x7f9c79fcf320>
new_file = 'uid___A002_X85c183_X36f.NEW.results.txt', relative_tolerance = 1e-07
def __compare_results(self, new_file: str, relative_tolerance: float) -> None:
"""
Compare results between new one loaded from file and old one.
Args:
new_file : file path of new results
relative_tolerance : relative tolerance of output value
"""
with open(self.expectedoutput_file) as expected_fd, open(new_file) as new_fd:
expected_results = expected_fd.readlines()
new_results = new_fd.readlines()
errors = []
worst_diff = (0, 0)
worst_percent_diff = (0, 0)
for old, new in zip(expected_results, new_results):
try:
oldkey, oldval, tol = self.__sanitize_results_string(old)
newkey, newval, _ = self.__sanitize_results_string(new)
except ValueError as e:
errorstr = "The results: {0} could not be parsed. Error: {1}".format(new, str(e))
errors.append(errorstr)
continue
> assert oldkey == newkey, f"Expected key {oldkey} does not match new key {newkey}."
^^^^^^^^^^^^^^^^
E AssertionError: Expected key s13.hsd_imaging.uid___A002_X85c183_X36f.ms.atmcor.field_1.spw_17.qa.metric.line_emission_off_range_at_peak does not match new key s13.hsd_imaging.uid___A002_X85c183_X36f.ms.atmcor.field_1.spw_17.qa.metric.score_sd_line_emission_off_range_at_peak.
tests/testing_utils.py:409: AssertionError