Please enable JavaScript.
Coggle requires JavaScript to display documents.
GCP (Storage solutions (BigQuery (Hive) (Enterprise Data Warehouse (EDW)…
GCP
Storage solutions
Persistent disk
Block storage
Kubernetes (Containers)
Compute Engines
Snapshots
VM
Online scale up
64TB
Cloud Storage
Blob storage
Store/Stream Multimedia
Videos
Images/pictures
Unstructured data
Blobs
Objects
Archive/Backup/DR
Can't Query
Multi regiona
Regional
Nearline
once a month
Coldline
once a year
Bigtable (HBase)
NoSQL Wide Column
low latency
Finance
Time series
high throughput
IoT
Only append (No update)
Support 1000s of Columns
Best for >1TB
Sparsely populated table
Semi Structured
Structured
Single-keyed
Cloud Datastore
NoSQL document (MongoDB)
Structured / Semi structured
Hierarchical
User profiles
prod catalogs
Game stats
Hash - Key - Value
Multi-Key
Support ACID
SQL Like
Sharding (Chunk out)
Coud SQL
MySQL / Postgre
Structured / Relational
OLTP up to GBs
Support field updates
Cloud Spanner
Critical relational database with high transactions
Standard SQL
Benefits of NoSQL databases
Unlike cloudSQL supports large datasets
BigQuery (Hive)
Enterprise Data Warehouse (EDW)
Standard SQL
UDF with JS
OLAP up to PBs
BigData
Support field updates
Support stream inserts (costly)
Query is costly (storing is not)
Google Drive
StackDriver
Debugging
Error reporting
Monitoring
Alerting
Tracing
Logging
Compute Engine (VM)
Regions
Zone 1
Zone 2
Zone 3
Snapshots
At given time!
Admin Images
Preemtible instances
TensorFlow (NN)
Light weight
Python API talks to C++
Written in C++
Best for Deep Learning NN
Datalab (Jupyter)
SQL
Python
Javascript
DataStudio (Tableau)
Visualization Dashboard
Dynamic
Cloud Dataflow (Apache Beam/Nifi/Storm)
Streaming + Batch processing
Data cleanup
Transform
Cloud Pub/Sub (Kafka)
Real time messaging
Decouple Sender & Reciever
Cloud DataProc (HDFS)