simple 29-Oct-2026 08:28:54 Build CASASPECS - Master Test GPU 3.12 - Test Casalith Many Linux 2.28 Py3.12 #191 (CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191) is being prepared for building on agent cvpost135.cv.nrao.edu, bamboo version: 9.6.26 simple 29-Oct-2026 08:28:54 Remote agent on host cvpost135.cv.nrao.edu simple 29-Oct-2026 08:28:54 Build working directory is /export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312 simple 29-Oct-2026 08:28:54 Executing build CASASPECS - Master Test GPU 3.12 - Test Casalith Many Linux 2.28 Py3.12 #191 (CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191) simple 29-Oct-2026 08:28:54 Starting task 'Source Code Checkout' of type 'com.atlassian.bamboo.plugins.vcs:task.vcs.checkout' simple 29-Oct-2026 08:28:54 Build always requires a clean checkout simple 29-Oct-2026 08:28:54 Cleaning build directory '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312' simple 29-Oct-2026 08:28:55 Checking out into /export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312 simple 29-Oct-2026 08:28:55 Updating source code to revision: 4a3321b72f1600f874dc362479609743a47ce11c simple 29-Oct-2026 08:28:55 Fetching 'refs/heads/master' from 'ssh://git@open-bitbucket.nrao.edu:7999/casa/casa6.git'. simple 29-Oct-2026 08:28:55 Warning: Permanently added '[127.0.0.1]:33093' (RSA) to the list of known hosts. simple 29-Oct-2026 08:28:55 X11 forwarding request failed on channel 0 simple 29-Oct-2026 08:29:01 Checking out revision 4a3321b72f1600f874dc362479609743a47ce11c. simple 29-Oct-2026 08:29:01 Creating local git repository in '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/.git'. simple 29-Oct-2026 08:29:01 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312'... simple 29-Oct-2026 08:29:01 done. simple 29-Oct-2026 08:29:03 Already on 'master' simple 29-Oct-2026 08:29:03 Your branch is up to date with 'origin/master'. simple 29-Oct-2026 08:29:03 Submodule 'casatools/casacore' (https://github.com/casacore/casacore.git) registered for path 'casatools/casacore' simple 29-Oct-2026 08:29:03 Submodule 'casatools/grpc-source' (https://github.com/grpc/grpc) registered for path 'casatools/grpc-source' simple 29-Oct-2026 08:29:03 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/casacore'... simple 29-Oct-2026 08:29:14 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source'... simple 29-Oct-2026 08:29:41 Submodule path 'casatools/casacore': checked out 'aaf72eb7edd5a5fecefa78ca04713233b7b6ffd6' simple 29-Oct-2026 08:29:42 Submodule path 'casatools/grpc-source': checked out 'cca868ac8f3641df4003a82b7fc54c921e14f765' simple 29-Oct-2026 08:29:42 Submodule 'third_party/abseil-cpp' (https://github.com/abseil/abseil-cpp) registered for path 'casatools/grpc-source/third_party/abseil-cpp' simple 29-Oct-2026 08:29:42 Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'casatools/grpc-source/third_party/benchmark' simple 29-Oct-2026 08:29:42 Submodule 'third_party/bloaty' (https://github.com/google/bloaty.git) registered for path 'casatools/grpc-source/third_party/bloaty' simple 29-Oct-2026 08:29:42 Submodule 'third_party/boringssl' (https://github.com/google/boringssl.git) registered for path 'casatools/grpc-source/third_party/boringssl' simple 29-Oct-2026 08:29:42 Submodule 'third_party/boringssl-with-bazel' (https://github.com/google/boringssl.git) registered for path 'casatools/grpc-source/third_party/boringssl-with-bazel' simple 29-Oct-2026 08:29:42 Submodule 'third_party/cares/cares' (https://github.com/c-ares/c-ares.git) registered for path 'casatools/grpc-source/third_party/cares/cares' simple 29-Oct-2026 08:29:42 Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'casatools/grpc-source/third_party/gflags' simple 29-Oct-2026 08:29:42 Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'casatools/grpc-source/third_party/googletest' simple 29-Oct-2026 08:29:42 Submodule 'third_party/protobuf' (https://github.com/google/protobuf.git) registered for path 'casatools/grpc-source/third_party/protobuf' simple 29-Oct-2026 08:29:42 Submodule 'third_party/zlib' (https://github.com/madler/zlib) registered for path 'casatools/grpc-source/third_party/zlib' simple 29-Oct-2026 08:29:42 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/abseil-cpp'... simple 29-Oct-2026 08:29:44 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/benchmark'... simple 29-Oct-2026 08:29:44 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/bloaty'... simple 29-Oct-2026 08:29:45 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/boringssl'... simple 29-Oct-2026 08:29:58 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/boringssl-with-bazel'... simple 29-Oct-2026 08:30:11 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/cares/cares'... simple 29-Oct-2026 08:30:12 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/gflags'... simple 29-Oct-2026 08:30:12 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/googletest'... simple 29-Oct-2026 08:30:13 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/protobuf'... simple 29-Oct-2026 08:30:24 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/zlib'... simple 29-Oct-2026 08:30:24 Submodule path 'casatools/grpc-source/third_party/abseil-cpp': checked out 'cc4bed2d74f7c8717e31f9579214ab52a9c9c610' simple 29-Oct-2026 08:30:25 Submodule path 'casatools/grpc-source/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' simple 29-Oct-2026 08:30:25 Submodule path 'casatools/grpc-source/third_party/bloaty': checked out '73594cde8c9a52a102c4341c244c833aa61b9c06' simple 29-Oct-2026 08:30:25 Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'casatools/grpc-source/third_party/bloaty/third_party/googletest' simple 29-Oct-2026 08:30:25 Submodule 'third_party/libFuzzer' (https://chromium.googlesource.com/chromium/llvm-project/llvm/lib/Fuzzer) registered for path 'casatools/grpc-source/third_party/bloaty/third_party/libFuzzer' simple 29-Oct-2026 08:30:25 Submodule 'third_party/re2' (https://github.com/google/re2) registered for path 'casatools/grpc-source/third_party/bloaty/third_party/re2' simple 29-Oct-2026 08:30:25 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/bloaty/third_party/googletest'... simple 29-Oct-2026 08:30:26 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/bloaty/third_party/libFuzzer'... simple 29-Oct-2026 08:30:26 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/bloaty/third_party/re2'... simple 29-Oct-2026 08:30:27 Submodule path 'casatools/grpc-source/third_party/bloaty/third_party/googletest': checked out 'a2b8a8e07628e5fd60644b6dd99c1b5e7d7f1f47' simple 29-Oct-2026 08:30:27 Submodule path 'casatools/grpc-source/third_party/bloaty/third_party/libFuzzer': checked out '1b543d6e5073b56be214394890c9193979a3d7e1' simple 29-Oct-2026 08:30:27 Submodule path 'casatools/grpc-source/third_party/bloaty/third_party/re2': checked out 'c964d9b07816f9b52ca692e23b8b3dba33beec54' simple 29-Oct-2026 08:30:27 Submodule path 'casatools/grpc-source/third_party/boringssl': checked out 'be2ee342d3781ddb954f91f8a7e660c6f59e87e5' simple 29-Oct-2026 08:30:27 Submodule path 'casatools/grpc-source/third_party/boringssl-with-bazel': checked out '886e7d75368e3f4fab3f4d0d3584e4abfc557755' simple 29-Oct-2026 08:30:28 Submodule path 'casatools/grpc-source/third_party/cares/cares': checked out '3be1924221e1326df520f8498d704a5c4c8d0cce' simple 29-Oct-2026 08:30:28 Submodule path 'casatools/grpc-source/third_party/gflags': checked out '30dbc81fb5ffdc98ea9b14b1918bfe4e8779b26e' simple 29-Oct-2026 08:30:28 Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'casatools/grpc-source/third_party/gflags/doc' simple 29-Oct-2026 08:30:28 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/gflags/doc'... simple 29-Oct-2026 08:30:28 Submodule path 'casatools/grpc-source/third_party/gflags/doc': checked out '971dd2a4fadac9cdab174c523c22df79efd63aa5' simple 29-Oct-2026 08:30:28 Submodule path 'casatools/grpc-source/third_party/googletest': checked out 'ec44c6c1675c25b9827aacd08c02433cccde7780' simple 29-Oct-2026 08:30:29 Submodule path 'casatools/grpc-source/third_party/protobuf': checked out '2761122b810fe8861004ae785cc3ab39f384d342' simple 29-Oct-2026 08:30:29 Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'casatools/grpc-source/third_party/protobuf/third_party/benchmark' simple 29-Oct-2026 08:30:29 Cloning into '/export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312/casatools/grpc-source/third_party/protobuf/third_party/benchmark'... simple 29-Oct-2026 08:30:29 Submodule path 'casatools/grpc-source/third_party/protobuf/third_party/benchmark': checked out '360e66c1c4777c99402cf8cd535aa510fee16573' simple 29-Oct-2026 08:30:29 Submodule path 'casatools/grpc-source/third_party/zlib': checked out 'cacf7f1d4e3d44d871b605da3b647f07d718623f' simple 29-Oct-2026 08:30:29 Updated source code to revision: 4a3321b72f1600f874dc362479609743a47ce11c simple 29-Oct-2026 08:30:29 Finished task 'Source Code Checkout' with result: Success simple 29-Oct-2026 08:30:29 Running pre-build action: Build Log Labeller Pre Build Action simple 29-Oct-2026 08:30:29 Running pre-build action: VCS Version Collector simple 29-Oct-2026 08:30:29 Build CASASPECS - Master Test GPU 3.12 - Test Casalith Many Linux 2.28 Py3.12 #191 (CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191) started building on agent 'cvpost135.cv.nrao.edu' (Remote agent on host cvpost135.cv.nrao.edu) command 29-Oct-2026 08:30:30 Substituting variable: ${bamboo.planRepository.branchName} with master simple 29-Oct-2026 08:30:30 Starting task 'Check if this is a 6.4.1 ticket' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script' command 29-Oct-2026 08:30:30 Beginning to execute external process for build 'CASASPECS - Master Test GPU 3.12 - Test Casalith Many Linux 2.28 Py3.12 #191 (CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191)'\n ... running command line: \n/export/cvpost135-nvme/casa/bamboohome/temp/CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191-ScriptBuildTask-3095786320675377668.sh\n ... in: /export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312\n error 29-Oct-2026 08:30:30 % Total % Received % Xferd Average Speed Time Time Time Current error 29-Oct-2026 08:30:30 Dload Upload Total Spent Left Speed error 29-Oct-2026 08:30:30 error 29-Oct-2026 08:30:30 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 error 29-Oct-2026 08:30:30 100 6002k 100 6002k 0 0 68.1M 0 --:--:-- --:--:-- --:--:-- 68.1M error 29-Oct-2026 08:30:30 [947138] Failed to execute script 'atlutil' due to unhandled exception! error 29-Oct-2026 08:30:30 Traceback (most recent call last): error 29-Oct-2026 08:30:30 File "atlutil.py", line 200, in error 29-Oct-2026 08:30:30 File "atlutil.py", line 165, in has_fix_version error 29-Oct-2026 08:30:30 KeyError: 'fields' simple 29-Oct-2026 08:30:30 Finished task 'Check if this is a 6.4.1 ticket' with result: Success simple 29-Oct-2026 08:30:30 Starting task 'Inject is_641' of type 'com.atlassian.bamboo.plugins.bamboo-variable-inject-plugin:inject' simple 29-Oct-2026 08:30:30 Injected variable bamboo.inject.is_641=False in LOCAL scope simple 29-Oct-2026 08:30:30 Finished task 'Inject is_641' with result: Success simple 29-Oct-2026 08:30:30 Starting task 'Download casalith from parent build plan' of type 'com.atlassian.bamboo.plugins.bamboo-artifact-downloader-plugin:artifactdownloadertask' simple 29-Oct-2026 08:30:30 Preparing to download plan result CASASPECS-MASTERBUILDCASALITHGPU-204 artifact: Required shared artifact Http Compression On : [ManyLinux228 Python 3.12 Tar 2], patterns: [*.xz] anchored at: [source/wheels] simple 29-Oct-2026 08:30:30 Retrieving artifact ManyLinux228 Python 3.12 Tar 2 for CASASPECS-MASTERBUILDCASALITHGPU-204 using Bamboo server artifact handler simple 29-Oct-2026 08:31:30 Artifact [ManyLinux228 Python 3.12 Tar 2] downloaded successfully in 59.91 s to dockershare/ simple 29-Oct-2026 08:31:30 Finished task 'Download casalith from parent build plan' with result: Success command 29-Oct-2026 08:31:30 Substituting variable: ${bamboo.capability.hostname} with cvpost135 command 29-Oct-2026 08:31:30 Substituting variable: ${bamboo.capability.hostname} with cvpost135 command 29-Oct-2026 08:31:30 Substituting variable: ${bamboo.capability.hostname} with cvpost135 command 29-Oct-2026 08:31:30 Substituting variable: ${bamboo.build.working.directory} with /export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312 simple 29-Oct-2026 08:31:30 Starting task 'start docker with conditional arguments' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script' command 29-Oct-2026 08:31:30 Beginning to execute external process for build 'CASASPECS - Master Test GPU 3.12 - Test Casalith Many Linux 2.28 Py3.12 #191 (CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191)'\n ... running command line: \n/export/cvpost135-nvme/casa/bamboohome/temp/CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191-ScriptBuildTask-7133632504735716842.sh\n ... in: /export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312\n build 29-Oct-2026 08:31:31 Already up to date. build 29-Oct-2026 08:31:31 Already up to date. build 29-Oct-2026 08:31:31 Data update complete error 29-Oct-2026 08:31:31 docker: Error response from daemon: Conflict. The container name "/test-container" is already in use by container "bd9681443d0ed88fd50a2fd45204818ef402a657d0931fd0082d85ca57881df0". You have to remove (or rename) that container to be able to reuse that name. error 29-Oct-2026 08:31:31 See 'docker run --help'. build 29-Oct-2026 08:31:31 CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES build 29-Oct-2026 08:31:31 bd9681443d0e casa-docker.nrao.edu:5000/casa-test-rocky-8.10:4 "tail -f /dev/null" 11 hours ago Up 11 hours test-container build 29-Oct-2026 08:31:31 643cd2f42bd2 hello-world "/hello" 4 weeks ago Exited (0) 4 weeks ago pedantic_greider error 29-Oct-2026 08:31:31 /bin/bash: nvidia-smi: command not found simple 29-Oct-2026 08:31:31 Failing task since return code of [/export/cvpost135-nvme/casa/bamboohome/temp/CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191-ScriptBuildTask-7133632504735716842.sh] was 127 while expected 0 simple 29-Oct-2026 08:31:31 Finished task 'start docker with conditional arguments' with result: Failed simple 29-Oct-2026 08:31:31 Starting task 'Cleanup' of type 'com.atlassian.bamboo.plugins.scripttask:task.builder.script' command 29-Oct-2026 08:31:31 Beginning to execute external process for build 'CASASPECS - Master Test GPU 3.12 - Test Casalith Many Linux 2.28 Py3.12 #191 (CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191)'\n ... running command line: \n/export/cvpost135-nvme/casa/bamboohome/temp/CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191-ScriptBuildTask-9290471514826323644.sh\n ... in: /export/cvpost135-nvme/casa/bamboohome/xml-data/build-dir/CASASPECS-MASTERTESTGPUPY312-TCM228PY312\n build 29-Oct-2026 08:31:31 Starting cleanup build 29-Oct-2026 08:31:41 test-container build 29-Oct-2026 08:31:46 test-container build 29-Oct-2026 08:31:46 Cleanup complete simple 29-Oct-2026 08:31:46 Finished task 'Cleanup' with result: Success simple 29-Oct-2026 08:31:46 Running post build plugin 'Docker Container Cleanup' simple 29-Oct-2026 08:31:46 Running post build plugin 'NCover Results Collector' simple 29-Oct-2026 08:31:46 Running post build plugin 'Build Results Label Collector' simple 29-Oct-2026 08:31:46 Running post build plugin 'Clover Results Collector' simple 29-Oct-2026 08:31:46 Running post build plugin 'npm Cache Cleanup' simple 29-Oct-2026 08:31:46 Running post build plugin 'Artifact Copier' simple 29-Oct-2026 08:31:46 Finalising the build... simple 29-Oct-2026 08:31:46 Stopping timer. simple 29-Oct-2026 08:31:46 Build CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191 completed. simple 29-Oct-2026 04:31:46 Running on server: post build plugin 'Build Hanging Detection Configuration' simple 29-Oct-2026 04:31:46 Running on server: post build plugin 'NCover Results Collector' simple 29-Oct-2026 04:31:46 Running on server: post build plugin 'Build Labeller' simple 29-Oct-2026 04:31:46 Running on server: post build plugin 'Clover Delta Calculator' simple 29-Oct-2026 04:31:46 Running on server: post build plugin 'Maven Dependencies Postprocessor' simple 29-Oct-2026 04:31:46 All post build plugins have finished simple 29-Oct-2026 04:31:46 Generating build results summary... simple 29-Oct-2026 04:31:46 Saving build results to disk... simple 29-Oct-2026 04:31:46 Store variable context... simple 29-Oct-2026 04:31:46 Finished building CASASPECS-MASTERTESTGPUPY312-TCM228PY312-191.