Please enable JavaScript.
Coggle requires JavaScript to display documents.
Data Engineering - Coggle Diagram
Data Engineering
Key Concepts
Primary Key
Deletion Flag
Partition Strategy
year
month
source_name
day
source_type
Incremental load
Data Lineage
Data Versioning
Historical Tables
Delta Tables
Raw Tables
Hash Content
Important Resources
Data Eng Roadmap
Data Eng Wiki
Airflow Tips and tricks
Athena Tips and Tricks
Data Eng Guideline
RFC 22
RFC 74
Data Lake Zones
Raw
Trusted
Refined
Validated
Base Projects
Airflow
Airflow Setup
Private Data Ingestion
Tools
Azure
Azure Kubernets Service(AKS)
AWS
Athena
Amazon S3
Amazon Kinesis(Firehose)
Other Tools
Python
Docker/Kubernets
Fish Functions
Astronomer
Metabase
PopSQL
Data Lake Modelling Structure
Product Model
Opinion Model
Auxiliary model(reg)