Please enable JavaScript.

Coggle requires JavaScript to display documents.

Sqoop 2 (has 2 things (connector (Implements a pluggable API (P - Partiton…

- - - - represent via config
        
        Link config
        
        to connect to data source
        
        like
        
        jdbc
        
        driver
        
        username
        
        password
        
        connection string
        
        kafka
        
        zookeper host
        
        broker hosts
        
        Job config
        
        to read write data from data source
        
        like
        
        jdbc
        
        table
        
        sql
        
        partition column
        
        kafka
        
        topic
        
        schema
    - - P - Partiton API for parallelism
      - E - Extract API for egress data
      - L - Load API to ingest
  - - - Creating job
        
        Create LINKs
        
        Populate From and To link from configs
        
        probably 2 types
        
        FROM LINK
        
        TO LINK
        
        Create Job associating FROM LINK to TO LINK
      - Job submission
      - Job Exection