Test results

  • 787 tests in total
  • 5 tests failed
  • 3 tests were fixed
  • 12 tests were quarantined / skipped
  • 2030 minutes taken in total.
Existing test failures 5
Status Test Failing since View job Duration
Failed: pipeline_manifest.xml is not present under the products directory
@pytest.mark.seven
    def test_uid___A002_Xc845c0_X7366__cycle5_restore_procedure_hifa_image__regression():
        """
        Restore from Cycle 5 (with current pipeline)
    
        Recipe name:                procedure_hifa_image
        Dataset:                    uid___A002_Xc845c0_X7366
(62 more lines...)
Failed: Failed to match 6 result values within tolerances :
s21.hifa_gfluxscale.uid___A002_X10b6f7c_X46cc.field_3.spw_10.qa.metric.score_gfluxscale_k_spw
	values differ by > a relative difference of 1e-07
	expected: 1.0129262614066323
	new:      1.3799197944259296
	diff: -0.36699353301929727
	percent_diff: -36.23102164511561%
s21.hifa_gfluxscale.uid___A002_X10b6f7c_X46cc.field_3.spw_10.qa.score.score_gfluxscale_k_spw
(155 more lines...)
Failed: pipeline_manifest.xml is not present under the products directory
@pytest.mark.seven
    def test_uid___A002_Xc46ab2_X15ae__selfcal_restore_procedure_hifa_image__regression():
        """Restore selfcal from Cycle 10 (with current pipeline)
    
        Recipe name:                procedure_hifa_image
        Dataset:                    uid___A002_Xc46ab2_X15ae
        """
(61 more lines...)
Failed: pipeline_manifest.xml is not present under the products directory
@pytest.mark.seven
    def test_uid___A002_Xef72bb_X9d29__renorm_restore_procedure_hifa_image__regression():
        """Restore renorm from Cycle 8 (with current pipeline)
    
        Recipe name:                procedure_hifa_image
        Dataset:                    uid___A002_Xef72bb_X9d29
        """
(61 more lines...)
Failed: pipeline_manifest.xml is not present under the products directory
def test_TSKY0001__vlass_quicklook_regression():
        """Run VLASS quicklook regression
    
        Recipe name:                procedure_vlassQLIP.xml
        Dataset:                    TSKY0001.sb32295801.eb32296475.57549.31722762731_split_withcorrectdata.ms
        """
        ref_directory = 'pl-regressiontest/vlass_quicklook'
(60 more lines...)
Fixed tests 3
Status Test Failing since View job Duration
Successful alma_if_fast_test test_2023_1_00228_S__uid___A002_X1199f9e_X7c24__procedure_hifa_calimage_diffgain__regression
Test ManyLinux 2.28 Python 3.12 338 mins
Successful alma_if_fast_test test_csv_3899_eb2_small__procedure_hifa_calimage__regression
Test ManyLinux 2.28 Python 3.12 57 mins
Successful alma_if_fast_test test_E2E6_1_00010_S__uid___A002_Xd0a588_X2239__procedure_hifa_image__regression
Test ManyLinux 2.28 Python 3.12 95 mins
Skipped tests 12
Status Test Failing since View job
Skipped atmutil_test test_get_transmission[1-17-0.9685033492155325]
Test ManyLinux 2.28 Python 3.12
Skipped atmutil_test test_get_median_elevation[0-51.137000119425466]
Test ManyLinux 2.28 Python 3.12
Skipped atmutil_test test_get_spw_spec[15-expected0]
Test ManyLinux 2.28 Python 3.12
Skipped atmutil_test test_get_median_elevation[1-51.13678069960953]
Test ManyLinux 2.28 Python 3.12
Skipped atmutil_test test_get_transmission[0-15-0.8427800044848566]
Test ManyLinux 2.28 Python 3.12
Skipped atmutil_test test_get_median_elevation[2-51.13635643503322]
Test ManyLinux 2.28 Python 3.12
Skipped atmutil_test test_get_spw_spec[17-expected1]
Test ManyLinux 2.28 Python 3.12
Skipped daskhelpers_test test_parallel_map
Test ManyLinux 2.28 Python 3.12
Skipped daskhelpers_test test_parallel_processing
Test ManyLinux 2.28 Python 3.12
Skipped daskhelpers_test test_parallel_task_performance
Test ManyLinux 2.28 Python 3.12
Skipped recipe_converter_test test_main
Test ManyLinux 2.28 Python 3.12
Skipped recipe_converter_test test_generate_all
Test ManyLinux 2.28 Python 3.12