Improve CI pipeline

LHCb way: https://gitlab.cern.ch/lhcb-dirac/LHCbDIRAC/-/blob/master/.gitlab-ci.yml#L304-324

• TODO:

  • deploy CTADIRAC on CVMFS:
    • need gsissh command (available via dirac client)
    • test access from majestix
    • how to use CTADIRAC version deployed on CVMFS using dirac-admin-update...
    • Can we deploy a pypi CTADIRAC pkg on Harbor and use it to update the instance?
    • Update the pilot software version as well
  • add systems tests in the test report
  • use the WMS kind deployment to run some preliminary tests: https://gitlab.cta-observatory.org/cta-computing/dpps/workload/wms/-/blob/main/Makefile?ref_type=heads
  • use the harbor proxy_cache for the Docker images, ex: image: harbor.cta-observatory.org/proxy_cache/python:3.12

• !246 (merged)

  • use the dpps-aiv-toolkit in the ci (waiting for cta-computing/dpps/aiv/dpps-aiv-toolkit!21 (merged))
  • fill the traceability matrix with UCs and Reqs

• !228 (merged)

  • Run pre-commit, on commited files only at first, since old ones do not respect pep syntax
  • Generate test report: https://gitlab.cta-observatory.org/cta-computing/dpps/workload/notes/test-report/-/issues/4

• !231 (merged)

  • Store Docker images Harbor