Please enable JavaScript.

Coggle requires JavaScript to display documents.

eBay SFTP service (BeanStalk (process checkpoints (sftp_tracking_delta…

- - - - exactly 1 job in Reserved, Only 1 worker could be able to process the checkpoint jobs at the same time.
  - - - delay 60s
- - - - job_body
        
        sftp_username
        
        filename
        
        total
        
        payload
        
        user_id
        
        tracking_number
        
        should start with "EBA"
        
        should start with "TBA" and length = 15
        
        user_provided_carrier_name
        
        source_country_code
        
        destination_country_code
        
        destination_zip
        
        tracking_upload_date
        
        if CSV has tracking_upload_date, use it
        
        if not use the CSV file name
    - - list SFTP /home/upload
      - match file name
    - - if 1.2.2 has wrong file name, generate *.bad file, and store it to S3 for backup
      - get summary file
      - if no summary file, release beanstalk job 60s delay
      - if summary file found, process the first one
      - validate trackings using the summary file
      - generate *.ok file
      - move processed file to /home/archive
      - release beanstalk
  - - - mapping field
        
        slug
        
        4px china => 4px
        
        abx express => abxexpress-my
        
        au post => austrilia-post
        
        australia post => australia-post
        
        correos => correosexpress,spain-correos-es,correos-de-costa-rica,correos-de-mexico,correos-chile
        
        courier mapping: https://github.com/AfterShip/worker.utility/blob/master/enum/implementation/courier_mapping.js
        
        chronoexpres => chronopost-france,chronopost-portugal
        
        if not mapped slug, auto-detect this courier with required_fields and tracking_number
        
        if auto detect error, the status field in csv file for eBay should be ERROR.
  - - - reserve the lock
        
        sample payload
        
        batch_number
        
        file_datename
        
        next_process_time
      - reserve jobs from sftp_tracking_delta_global_q(n)
        
        wait for 5s
        
        all data should less than 9.5MB
    - - csv filename (EBAYTRK1.0(batch_number)AFTERSHIP(file_datetime).csv)
        
        batch_number
        
        00000 - 99999
        
        file_datetime
        
        Get the current worker’s processing minute (16, 31, 46, 01)
        
        Minus the minute value by 1
        
        Format the output in YYYYMMDD_HHmmss
      - download-sftp.aftership.com
        
        upload to /home/download_buffer
        
        when the job is done, move to /home/download
    - - all job's done(time of reserving doesn't exceed 5s, data size doesn't exceed 9.5MB)
        
        batch_number: 0
        
        file_datetime: null
        
        next_process_time: null
      - job left
        
        batch_number: batch_number + 1
        
        file_datetime: #unchanged
        
        next_process_timet: #unchanged
- - - - to read
    - - to write
  - - - to write
    - - for eBay to read
- - - - UserProvidedCarrierName(eBay's Courier name)
      - SourceCountryCode(ISO3)
      - DestinationContryCode(ISO3)
      - DestinationZip
      - TrackingUploadDate(YYYYMMDD)
      - TrackingNumber
  - - - TotalTrackingNumber
- - - - https://github.com/AfterShip/worker.crawler/blob/master/lib/crawler/tracking_processor.js#L1166
    - - payload
        
        user_id
        
        slug
        
        tracking_id
        
        delta
        
        CSV_string