Please enable JavaScript.

Coggle requires JavaScript to display documents.

GCP_DATA_BQ, Data_lifecycle, Dataproc - Coggle Diagram

- - - - there are a set of limits for streaming, duplicates(100 mb) without duplicates (1Gb)
      - Stream ID - provide option to avoid duplicates
  - - - partition table to multiply segments
        
        improve perf
        
        optimize costs
        
        inherit schema
        
        we can expire partition
        
        date related and Integer are OK for partition
        
        need to avoid creating small partitions
      - clustering - group related data together
        
        goal - collocate data and avoid bigger scan