Please enable JavaScript.

Coggle requires JavaScript to display documents.

Data Lake, Warehouse, Mart - Coggle Diagram

- - - - structure, semi-, no- <> structure
    - - pre-define <> non define
    - - from raw -> transformed <> processed
    - - easy, low cost <> difficult, expensive
    - - ML, real-time analytics <> reporting, BI
  - - - many source, many format
    - - data quanlity & availability
    - - the speed data is generated
  - - - enforcing policies
        
        security
        
        access control
      - tracking data lineage
      - maitaining data quanlity
      - data auditing
      - metadata management
      - data cataloging
- - - - maintains a staging area inside the data warehouse itself
      - data gets extracted from source systems
        -> directly loaded into the data warehouse,
        -> before any transformation occurs.
    - - Step 1: Extract data from source -> store at the staging layer or staging database stores
      - Step 3: then moved data to data warehouse database
      - Step 2: transform data -> storing in an operational data store (ODS) database
  - - - External data
      - internal data
      - Operational system data
      - Flat file
    - - Metadata
      - raw table
      - Summary data
- - - - hold a small subset of data, so users can quickly retrieve the data they need with less work
  - - - dependent on DBW
    - - Not rely on DBW
    - - combine data from
        
        DBW
        
        other operational soures