Please enable JavaScript.
Coggle requires JavaScript to display documents.
Data Engineering - Coggle Diagram
Data Engineering
Data Sources + Ingestion
Webscraping
Webhooks
APIs
Database Connections (JDBC/ODBC)
Streaming vs Batch
Change Data Capture Data
Push vs Pull
SFTP + SCP
Overarching Ideas/Undercurrents
DataOps
Architecture
Data Management
Orchestration
Security/Privacy
Storage
Data Warehouse + Data Marts
Data Lake
NoSQL Databases
Data Lakehouse
SQL Database
Transformations
Cleaning Data
Datatypes
Combining Data (merge, join)
Business Rules/Logic
Lifecycle
Storage
Transformation
Data Sources/Source Systems
Service/Delivery
Serving/Delivering Data
Reverse ETL
Self Service (Data Mesh, etc.)
Machine Learning
Analytics
Coding
Python
Shell
SQL