Please enable JavaScript.
Coggle requires JavaScript to display documents.
Azure POC - Coggle Diagram
Azure POC
1. Data Transformation (ETL)
Dataflow
Synapse Spark Pool
Databricks
Storage (ADLS)
Framework for Data Ingestion using Pipelines
3. Process Automation
ADF Pipelines
Databricks Workflow
Talend Orchestration using Pipelines (ADF)
2. Performance
Loading Perfromance
Parallel Execution by countries
Query Performance
Concurrent Query
0.Pre-requisites
Dataset Creation
small (< 10 GB)
Medium (100 GB - 1 TB)
Large (1 TB - 10 TB)
Environment
SC Ventures
SCBDEV
4. Cloud - On Premise Hybrid