Tags

## v0.2.3 Release Notes

### Enhancements

- **Layer Calculations Plot**:
  - Fixed a bug where channels were not displayed on the plot due to a misplaced `continue` statement in the cloud detection logic.
  - **Ground Layer**:
    - Only the line from the first window where a molecular profile is found is shown in solid, while the rest of the windows are displayed in light gray.
  - **Cloud Layer**:
    - For clouds, the last window with a molecular profile (before the cloud) is plotted in a thick, dark purple line, with the corresponding c0 sum for the window.
    - The first window with a molecular profile (after the cloud) is also plotted in the same thick, dark purple line, with the corresponding c0 sum.
    - Each cloud is plotted in a different color, with both lines of the same cloud having the same color.

- **Chi2 Plot**:
  - Ground layer is now plotted in a dark color.
  - Molecular profile is plotted in a finer, less dark red.
  - Clouds are plotted in dark red if the chi2 value exceeds the threshold.
  - **TODO**: Junge layer chi2 plot still pending.

- **Alpha Plot**:
  - Alpha is now plotted in orange.
  - c0_period is plotted on the x-axis.
  - A warning is added when `trans_ground_layer > 1.04`.
  - **TODO**: Pending decision on whether to plot by segments or reset to zero when needed.

- **Transmission Display**:
  - Transmission values are now shown for both the ground layer and the cloud layer.

### Bug Fixes

- **LICEL Reader**:
  - Fixed issues with BRL files containing erroneous coordinates.
  - Updated tests to reflect changes in the LICEL reader, specifically with the new `lidar_location` parameter in the database.

## v0.2.2 Release Notes

### Enhancements

- **Layer Calculations for Variable Binwidth**: The layer calculations algorithm now supports variable binwidths, allowing greater flexibility and precision in data analysis.

### Improvements

- **Button for Reloading Raw Data**: A new button has been added to reload raw data directly, streamlining data management and updates without needing to restart the application.

- **Markus File Debugging**: Addressed various issues related to Markus files and other similar data processing errors, ensuring more stable and accurate performance.

### Bug Fixes

- **Interface Bugs Resolved**: Multiple interface-related bugs have been identified and corrected to improve user experience and overall interface stability.

- **Block Algorithm Selection During Execution**: The interface now blocks users from selecting a new algorithm while another is in execution, preventing potential conflicts.

- **Reset Default Execution on New Data Selection**: When new data is selected, the execution defaults are now properly reset, ensuring a fresh start for analysis.

- **Next Step Failure After Automate Execution**: Resolved the issue where the "Next Step" button would fail to function after an automated execution was performed.

# v0.2.1 - Release Notes

**Release Date:** September 20, 2024

The v0.2.1 release is a follow-up to v0.2.0, focusing primarily on the implementation of dynamic rebinning, error calculation improvements, and additional dashboard enhancements. This release also fixes bugs and refines various configurations to improve the system’s flexibility and performance.

## 1. Dynamic Rebinning and Error Calculations
   - A key feature introduced in v0.2.1 is **dynamic rebinning**, which allows data to be restructured in real-time. This is particularly important for adjusting data granularity based on specific needs.
   - Error calculations for the different layers (ground, cloud, and Junge layers) have been refined. Collaboration with external teams, particularly **Markus**, has helped in achieving more accurate and reliable error estimations.

## 2. LayerCalculations Expansion
   - The algorithms implemented for **ground**, **cloud**, and **Junge layers** in v0.2.0 have been expanded upon, with enhanced performance and optimizations for specific LIDAR instruments.
   - These improvements ensure that the elastic channels process the data more effectively, especially when dealing with **MAGIC**, **MRL**, and **BRL** instruments.

## 3. Support for Multiple LIDAR Data
   - Compatibility has been improved for different LIDARs. Both **MAGIC 2022** and **MRL 2023** data formats are now fully supported, making it easier to handle diverse datasets and streamline data processing.
   - The system now integrates more smoothly with varied observation campaigns, ensuring that the configurations for each LIDAR device work seamlessly across datasets.

## 4. Configuration and Deployment Improvements
   - New **configuration files** have been added and updated to support a wider array of use cases. Each configuration file is tailored to specific needs, ensuring smoother operation across different environments.
   - Deployment configurations were updated to improve CI/CD processes, optimizing system startup times and reducing deployment issues related to network conflicts and pipeline failures.

## 5. Additional Bug Fixes and Interface Enhancements
   - Various bug fixes across the system, including better handling of MAGIC 2022 data.
   - The **dashboard** continues to see improvements, with a cleaner layout and the addition of recent RCS and MDP plot displays. The fixes also include minor adjustments to UI behavior for improved user experience.

# v0.2.0 - Release Notes

**Release Date:** September 15, 2024

The v0.2.0 release introduces significant advancements in the CaWeCS project, focusing on data processing capabilities, new views for historical analysis and comparisons, and enhanced user interface features. Below is a breakdown of the key improvements and new functionalities in this release.

## 1. Implementation of Layers Calculations for Elastic Channels
   - The core algorithms for **ground layer**, **cloud layer**, and **Junge layer** calculations using elastic channels have been fully implemented.
   - These algorithms mark a major step forward in the system's ability to analyze atmospheric data effectively. Elastic channels provide the base for detecting these key layers, which are essential for various analysis processes.
   - **Raman** and **NR (non-elastic)** channels, which are important for future extensions, are not yet implemented in this version but are planned for future updates.

## 2. Historical Data View
   - A dedicated view has been added to display the historical data stored in the system, enabling users to access the complete range of past results.
   - This feature is not limited to processed results but includes **MDP (Molecular Data Profile)** and **RCS (Raw Data)** files, offering a comprehensive look at both analyzed and raw data for deeper insights into the system's historical performance.
   - Users can navigate through different time periods, compare data consistency, and evaluate how conditions evolve over time, offering a powerful tool for long-term studies.

## 3. Data Comparison View
   - A new **Comparison View** has been introduced to facilitate direct comparisons between datasets from different time periods.
   - Built on the same data framework as the Historical View, this tool allows users to visually and quantitatively compare two or more sets of data, helping identify trends, patterns, and anomalies across different timeframes.
   - The Comparison View utilizes data stored in the internal database, ensuring consistent and quick access to both current and archived data.

## 4. MDP Retriever: Molecular Profile Integration
   - This version includes the **MDP Retriever**, an innovative feature that allows users to pull molecular profiles (MDP) directly from the RSA database by selecting a geographic location and date.
   - The retrieved molecular profile is saved into the system’s database for future use in analysis or display, providing a seamless way to incorporate real-world atmospheric data into the system.
   - Once saved, these MDPs are integrated with both the **Historical** and **Comparison** views, allowing users to visualize how molecular profiles evolve alongside RCS and other data.

## 5. Dashboard Enhancements
   - The **Dashboard** has been revamped to provide a cleaner, more efficient user interface. Key new features include:
     - **Real-time plots** for the latest RCS and MDP data, giving users an immediate snapshot of recent measurements and profiles.
     - A fix for a long-standing issue where log files would overflow outside their designated area, improving the clarity of system diagnostics.
     - **Night Mode** functionality, allowing users to switch to a darker theme for enhanced readability in low-light environments. This mode switches the interface's white background tones to dark, ensuring a more comfortable user experience during night operations or in observatories.

## 6. Rebinning Method and Configurations
   - A dynamic **rebinning method** has been introduced to allow more flexible data analysis, enabling recalculation of data points over different time intervals. This feature is particularly useful for focusing on specific periods with varying resolutions, depending on the level of detail required.
   - Configuration files have been updated to adapt to different LIDAR instruments (including **MAGIC**, **MRL**, and **BRL**), ensuring compatibility across different setups and observation periods.

## 7. Bug Fixes and Performance Enhancements
   - Several bugs related to the system’s file management and visualization have been fixed, improving stability and user experience.
   - The data handling process has been optimized, allowing for smoother transitions between different datasets and ensuring quicker access to results.
   - Backend improvements, including the refinement of **NGINX containers** and deployment configurations, have enhanced the system's reliability, particularly during continuous integration (CI) operations.

Release v0.1.0

The scope of the LPP Subsystem encompasses a comprehensive set of features and functionalities, strategically designed to meet the project's objectives. 

This includes, but is not limited to:

1. LICEL 2 FITS Converter: Development of a tool for converting LICEL 2 data to FITS format.
2. Graphical User Interface (GUI): Implementation of a user-friendly interface with a finalized design using frontend technologies.
3. LPP Analysis: Integration of LICEL Reader for FITS format  and various algorithms for BG Subtraction, Time Shift, Gluing, and RCS.
4. MDPs Integration: Development of a downloader component and a profile simple plot feature.
5. Logging and Configuration:
- Implementation of a comprehensive logging system with database entries and log file generation.
- Configuration options through YAML files, including auto-update capabilities and GUI configurability.
6. Testing:
- Execution of thorough CI tests covering GUI, HTTP interactions, database connections, and specific functionalities.
- Manual testing on diverse datasets for BG, TimeShift, Gluing, and RCS.