Skip to content

Db setup and management

Vadym Voitsekhovskyi requested to merge db-setup-and-management into main

Description

Its preliminary results:

  • DB Schema was slightly changed, new version on the figure below
  • Tasks from the related Issue #148 (closed) were done
  • New test added to check the functionality of db_loader tool

But during this refactoring were raised a few new questions that should be addressed:

  • Make available automatic processing of all data tables (optical_throughput and all from atmosphere) and attach appropriate metadata in helper methods from TableHandler class
  • Fix the tests from calibpipe/src/test/unittests/database/test_metadata.py to count on new DB schema and all data tables, not only atmospheric
  • Add possibility to fill the DB with some dummy data in the new CalibPipeDatabaseCreation tool
  • Add ContextMetadata and FixityMetadata tables

Commits

  • New config structure uploaded

  • Tool for creation calibpipe DB

  • DB creation methods moved to the proper class

  • New foreign keys

  • Make DB tables names all in low register as mmetadata table names

  • Unified container naming and foreign key fields

Related Issue

Close #148 (closed)

New DB Schema

CalibPipeDBSchema_v3

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.
Edited by Vadym Voitsekhovskyi

Merge request reports