graph TD A[Data Sources] --> B[R Processing Layer] B --> C[dbt Transformation] C --> D[SQL Server] D --> E[Reporting Layer] style A fill:#f9f,stroke:#333 style E fill:#bbf,stroke:#333
System Architecture and Implementation
Component Integration 🏗️
System Overview
Workflow Orchestration with R 🔄
R Processing Components
Component | Purpose | Dependencies |
---|---|---|
Data Loader | Initial data ingestion | readxl, tidyverse |
Validator | Data validation | assertr, validate |
Transformer | Data transformation | dplyr, tidyr |
Logger | Process logging | logger, futile.logger |
Database Schema Design 💾
Logical Data Model 📊
erDiagram VESSELS ||--o{ TRIPS : makes TRIPS ||--o{ CATCH_DATA : contains CATCH_DATA }|--|| SPECIES : references