Please enable JavaScript.
Coggle requires JavaScript to display documents.
Data Engineering - Coggle Diagram
Data Engineering
Data Processing
Batch
Lambda
Stream
Kafka
PubSub
Kappa
Medallion
Ingestion | Integration
ETL
ELT
Zero ETL
CDC
Systems
OLAP
Dimensional Data Models
Kimball
Facts
Dimensions
Star - Snowflake
Hub & Spoke Hybrid
Data Vault | Hub & Spoke
SCD
Distributed
Partioning
Replication
Leader Based
Multi Leader
Leader Less
OLTP
Relational Data Models
Normalization
1,,2,3 NF
Transactions
ACID
Consistency
Non Relational Model
Document
Key- Value
One Big Table
Storage Patterns
Enterprise Data Warehouse
BigQuery, Redshift, Azure Synapse, HIVE
Data Lakes
GCS, S3, Azure Storage, HDFS
Data Lakehouse
Storage
Apache Iceberg | Apcache HUDI | Delta Lake
Metadata
Catalogs
Data Governance
Data Catalog
Data Contracts