Please enable JavaScript.
Coggle requires JavaScript to display documents.
Pacific Eagle - Coggle Diagram
Pacific Eagle
Current architecture
Reporting
Tableau
30 Reports - pre canned reports
Database
??
dataflow
Driven by Vendor
2013 onwards - 1TB
Daily file < 1 GB
Architecture
Extract Data from data source
Load raw data into Source Image Layer
Transform & Store in foundation layer
Use Case Layer
Refresh Tableau Models
AWS Components
Glue - ingest data & Orchestration
EMR
Guzzle
Create the data pipelines
SQL
aggregation
Join
dimensional model
Create Recon Jobs
Agg data - Counts & sum (of few important metrics)
Target
Storage - S3
Redshift
Advantage
Structured data analysis
Unstructured
Business
FSI - SME
asset management
Requirements
Daily reporting to management
Extract data and transfer to DWH