Please enable JavaScript.
Coggle requires JavaScript to display documents.
ML Model GH REPO, test project This is a test project that is doing…
create_model.py
This script will create the Model's binary file and save it on vertex AI. It will update the model if it's exist already using a utils function model_exists
:recycle:
-
test project This is a test project that is doing manually and in local what the pipeline runner does on the cloud
-
DBT ML OPS
This will Create the tables that are required for generating data to be used by the model
Example : Wad_features, loan_balances
Artifact registry dummy_loan
TBC this is probably where GA will save the docker images running the dbt
Airflow Dag
This is an airflow Dag that will execute dbt and run a batch prediction
BQ tables
This is where the dbt models execution will land
-
-
Vertex AI Scheduler
Alternative to the runner, Built in vertex ai scheduler for running pipeline but we won't be using this as it's not flexible enough for our needs