Integration test uc-dpps-cp-110_cat_b fails
Summary
[Errno 20] Not a directory: '/tmp/fzsnirwz/testarea' is encountered during the grib files merge
Steps to reproduce
reproducible in autotests
What is the expected correct behavior?
Relevant logs and/or screenshots
[32;1m$ cwltool $WORKFLOW.cwl $WORKFLOW.cfg[0;m
[1;30mINFO[0m /root/micromamba/envs/cta-dev/bin/cwltool 3.1.20230624081518
[1;30mINFO[0m Resolved 'uc-dpps-cp-110_cat_b.cwl' to 'file:///builds/cta-computing/dpps/calibrationpipeline/calibpipe/calibpipe/tests/workflows/atmosphere/uc-dpps-cp-110_cat_b.cwl'
[1;30mINFO[0m [job uc-dpps-cp-110_cat_b.cwl] /tmp/fzsnirwz$ select_ref_model_full \
--das \
GDAS \
--date \
'06-07-2023 02:00:00' \
--date_format \
'%d-%m-%Y %H:%M:%S' \
--degrees_below_horizon \
18 \
--grib_download_path \
/tmp/fzsnirwz/testarea \
--site \
north \
--request_conf \
/tmp/ypwqn76e/stg649e63fc-f9a4-487a-ba02-c1c08a9a3b3e/control_gdas.json \
--waiting_time \
7200 > /tmp/fzsnirwz/output.txt
2023-07-06 15:03:26,125 [1;31mERROR[0m [calibpipe.SelectMDP_full_catB] (tool.run): Caught unexpected exception: [Errno 20] Not a directory: '/tmp/fzsnirwz/testarea'
Traceback (most recent call last):
File "/root/micromamba/envs/cta-dev/lib/python3.9/site-packages/ctapipe/core/tool.py", line 426, in run
self.start()
File "/root/micromamba/envs/cta-dev/lib/python3.9/site-packages/calibpipe/tools/selection_reference_model_cat_b.py", line 45, in start
self.comp.merge_files()
File "/root/micromamba/envs/cta-dev/lib/python3.9/site-packages/calibpipe/atmosphere/molecular_atmosphere_calibrator.py", line 309, in merge_files
for tfile in os.listdir(self.grib_download_path):
NotADirectoryError: [Errno 20] Not a directory: '/tmp/fzsnirwz/testarea'
[1;30mINFO[0m [job uc-dpps-cp-110_cat_b.cwl] Max memory used: 108MiB
[1;30mWARNING[0m [33m[job uc-dpps-cp-110_cat_b.cwl] exited with status: 1[0m
[1;30mWARNING[0m [33m[job uc-dpps-cp-110_cat_b.cwl] completed permanentFail[0m
{
"testout": {
"location": "file:///builds/cta-computing/dpps/calibrationpipeline/calibpipe/calibpipe/tests/workflows/atmosphere/output.txt",
"basename": "output.txt",
"class": "File",
"checksum": "sha1$b20d2dcb4f56977b52bc68e633eeee53e88cf8cb",
"size": 40,
"path": "/builds/cta-computing/dpps/calibrationpipeline/calibpipe/calibpipe/tests/workflows/atmosphere/output.txt"
}
}[1;30mWARNING[0m [33mFinal process status is permanentFail[0m
section_end:1688655806:step_script
[0Ksection_start:1688655806:cleanup_file_variables
[0K[0K[36;1mCleaning up project directory and file based variables[0;m[0;m
section_end:1688655807:cleanup_file_variables
[0K[31;1mERROR: Job failed: command terminated with exit code 1
Environment
- Version used:
- Operation System:
Edited by Mykhailo.Dalchenko