Please enable JavaScript.
Coggle requires JavaScript to display documents.
Pipeline Performance - Coggle Diagram
Pipeline Performance
Query Performance
Limited in indexing source DB's
Distribution Pipeline queries pulling from source could be slow. Low priority though.
Materialized Views are likely slow
Probability that MV's are running when there are no changes at source
ADF Configuration
Distribution Pipeline
Transfers take hours - should be minutes
Investigate queries
Investigate Parallel execution of triggers
DW Pipeline
UPSERT queries are sloooooooow
Asynchronous Pipeline Execution
DP Transfers are all synchronous. Could be made Asynchronous
Synapse Configuration
Workload Assignments poorly managed
Resources can be utilized \ assigned unequally
Synapse Available Resources
Potential cost savings, but no performance enhancements
Chaining pipelines together
No need for this feature
Notification
Automatic retries
Materialize some tables prior to Async Exec