Please enable JavaScript.
Coggle requires JavaScript to display documents.
Data Engineering - Coggle Diagram
Data Engineering
Data Sources + Ingestion
APIs
Webhooks
Change Data Capture
Database Connections (ODBC/JDBC)
Streaming vs Batch
SFTP/SCP
Push vs Pull
Overarching Ideas/Undercurrents
DataOps
Architecture
Data Management
Orchestration
Security/Privacy
Storage
Data Warehouse + Data Marts
Data Lake
NoSQL Databases
Data Lakehouse
SQL Databases
Lifecycle
Service/Delivery
Transformation
Storage
Data Sources/Source Systems
Transformations
Cleaning Data
Datatypes
Combining Data (merge, join)
Business Rules/Logic
Serving/Delivering Data
Self Service (Data Mesh, etc.)
Reverse ETL
Machine Learning
Analytics
Coding
Python
Shell
SQL
Java/Scala