Build #3

Plan branch:

Build: #3 failed Changes by Rui Xue

Build result summary

Details

Completed
Queue duration
< 1 second
Duration
1 second
Labels
None
Agent
casaci-4.cv.nrao.edu test agent4
Revision
b035ba6bc554bc352a36d2fa7c564fed72fb3716
No failed test found. A possible compilation error occurred.

Responsible

  • Rui Xue Rui Xue Automatically assigned

Code commits

Author Commit Message Commit date
Rui Xue Rui Xue b035ba6bc554bc352a36d2fa7c564fed72fb3716 PIPE-3073: demo_prefect_tier0futures: update config and robustness fixes
- Update dataset paths to 2016.1.00053.S on NAASC lustre and introduce
  store_dir variable so ppr_file, raw_dir, and work_dir share a common
  base prefix
- Add prefect_api_url config variable; set PREFECT_API_URL before pipeline
  imports so flow runs are visible in the running Prefect server instead
  of going to the ephemeral in-process API
- Fix rawdata symlink handling: always recreate the symlink (unlink if
  it exists); if rawdata is a real directory, rename it with a timestamp
  backup before symlinking
- Override SIGINT handler after imports to call os._exit(130), bypassing
  the dask_jobqueue SIGINT→sys.exit→atexit→cluster.close() deadlock that
  caused Ctrl+C to hang

pipeline/config.yaml:
- Increase SLURM job memory from 10gb to 20gb

pipeline/infrastructure/daskhelpers.py:
- Raise default local worker cap from 4 to 6

Jira issues

IssueDescriptionStatus
Unknown Issue TypePIPE-3073Could not obtain issue details from Jira

Error summary for Pipeline PR Test 6.7.4

The job generated some errors, drill down into the full build log for more details.

Failed to prepare the build 'PIPESPECS - Pipeline Pull Request Test - PIPE-3073-prefect-workflow-task-adapter-and-tier0future-backend-improvement - Pipeline PR Test 6.7.4 #3 (PIPESPECS-PPRT559-PPRT674-3)'