mg2 20170525142607 180419 PPr regression: Test case result

The below summarizes the result of the test " mg2 20170525142607 180419 PPr regression" in build 60 of PIPESPECS - Test Pipeline main with Casa master - Test ManyLinux 2.28 Python 3.12.

• Description: mg2 20170525142607 180419 PPr regression
• Test class: tests.regression.fast.nobeyama_sd_fast_test
• Method: test_mg2_20170525142607_180419__PPR__regression

• Duration: 40 mins
• Status: Failed (New Failure)

Error Log

AssertionError: Expected key s6.hsd_imaging.mg2-20170525142607-180419.field_0.spw_0.qa.metric.line_emission_off_range_at_peak does not match new key s6.hsd_imaging.mg2-20170525142607-180419.field_0.spw_0.qa.metric.score_sd_line_emission_off_range_at_peak.
def test_mg2_20170525142607_180419__PPR__regression():
        """Run ALMA single-dish cal+image regression for restore nobeyama recipe.
    
        PPR:                        pl-regressiontest/mg2-20170525142607-180419_PPR/PPR.xml
        Dataset:                    mg2-20170525142607-180419_PPR
        """
        ref_directory = 'pl-regressiontest/mg2-20170525142607-180419_PPR'
    
        pt = PipelineTester(
            visname=['mg2-20170525142607-180419.ms'],
            ppr=f'{ref_directory}/PPR.xml',
            input_dir=ref_directory,
            output_dir='mg2-20170525142607-180419_PPR',
            expectedoutput_dir=ref_directory,
            )
    
        # copy files use restore task into products folder
        if not pt.compare_only:
            input_products = casa_tools.utils.resolve(f'{ref_directory}/products')
            shutil.copytree(input_products, f'{pt.output_dir}/products')
    
>       pt.run()

tests/regression/fast/nobeyama_sd_fast_test.py:45: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/testing_utils.py:376: in run
    self.__compare_results(new_file, default_relative_tolerance)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <tests.testing_utils.PipelineTester object at 0x7fa73a6ecbf0>
new_file = 'mg2-20170525142607-180419.ms.NEW.results.txt'
relative_tolerance = 1e-07

    def __compare_results(self, new_file: str, relative_tolerance: float) -> None:
        """
        Compare results between new one loaded from file and old one.
    
        Args:
            new_file : file path of new results
            relative_tolerance : relative tolerance of output value
        """
        with open(self.expectedoutput_file) as expected_fd, open(new_file) as new_fd:
            expected_results = expected_fd.readlines()
            new_results = new_fd.readlines()
            errors = []
            worst_diff = (0, 0)
            worst_percent_diff = (0, 0)
            for old, new in zip(expected_results, new_results):
                try:
                    oldkey, oldval, tol = self.__sanitize_results_string(old)
                    newkey, newval, _ = self.__sanitize_results_string(new)
                except ValueError as e:
                    errorstr = "The results: {0} could not be parsed. Error: {1}".format(new, str(e))
                    errors.append(errorstr)
                    continue
    
>               assert oldkey == newkey, f"Expected key {oldkey} does not match new key {newkey}."
                       ^^^^^^^^^^^^^^^^
E               AssertionError: Expected key s6.hsd_imaging.mg2-20170525142607-180419.field_0.spw_0.qa.metric.line_emission_off_range_at_peak does not match new key s6.hsd_imaging.mg2-20170525142607-180419.field_0.spw_0.qa.metric.score_sd_line_emission_off_range_at_peak.

tests/testing_utils.py:409: AssertionError