Please enable JavaScript.
Coggle requires JavaScript to display documents.
data_enginer_cli - Coggle Diagram
data_enginer_cli
services
scheduler
code pipeline line window
pipelines
datacontract catalog
data quality checks
commands
run processing on dev
deployment to cloud
init repo
run tests
deployment
databricks
ecs/fargate
emr
glue
custom libraries
spark sodacl for testing
data abstraction layer
datacontract
docker
airflow
spark aws
delta
iceberg
glue client
airflow
scheduler
webui
scenarios
TODO
initialize stack
s3 bucket for data contracts
ecs clusters
roles
data engineer
data scientist
groups
reader
ETL job role
bucket for artifacts
GitHub custom runner
cognito integration
locking dependencies / cover envs
data contract auto deployment from bucket using pulumi deployment
versioning / autoupdate