Please enable JavaScript.

Coggle requires JavaScript to display documents.

CDL-Data - Coggle Diagram

- - - - highly organized - Customer data
    - - qualitative - docs, audio /video files - BLOB format(Bin large obj)
      - Thru APIs unstructured data can be converted to structured data
- - - - 2 Priorities: Data Integrity (Transactional Integrity) and Scale
      - Cloud SQL - Relational DB, provides scalability, security,durability,availability. automatically scales realtime
      - Cloud Spanner - Global scale. Data automatically copied in all locations
      - Transactional data
    - - Assembles data from multiple sources, including databases Enables rapid analysis of large and multidimensional datasets . Allows businesses to consolidate data that is structured and semi-structured. Connector tools are used to transform unstructured data into semi-structured data
      - BigQuery is a fully-managed data warehouse with downtime free upgrades and maintenance and seamless scaling. to analyze petabytes of data using incredibly fast speeds and zero operational overhead
      - BigQuery is serverless. compute power are automatically provisioned as run your queries.
      - Pub/Sub: service for real-time ingestion of data, and Dataflow: service for large scale processing of data. They work together to bring unstructured data into the Cloud and transform it into semi-structured data. This transformed data can then be sent directly from Dataflow to BigQuery,
    - - Data is encrypted automatically. Supports both Global and Region storage
      - 2 Classes. Nearline - 30 days. Coldline - 90 days Archive - 1 year
      - It stores raw-data - structured, semi-structured, and unstructured data. Also to store historic data