White To Kraft ETL

Valid CSV file with valid supcs uploaded to S3 bucket

Run the W2K ETL

Verify the W2K products on white_to_kraft_products table on product DB

Add few more products / Remove some products from the CSV file and re-upload it to the S3 bucket

Run the W2K ETL

Verify that the relevant changes are appeared in white_to_kraft_products on product DB

Add few more products/ remove some products from the white_to_kraft_products table on product DB

Re - run W2K ETL with original CSV file which does not reflect the changes that were made in the product DB

Verify that the changes made on product DB are no longer there on white_to_kraft_products table on product DB

Negative scenarios

File Access Error Scenarios

Uploading the file to an incorrect S3 bucket

Uploading a file with an invalid file format (Incorrect header row)

Uploading file with incorrect column order

Unable to open the csv file

Uploading a file with incorrect number of columns (less or more than expected)

Database Errors

Data Validation Errors

Connection Errors

Data truncating errors

Data Inserting Errors

When there are empty rows in CSV file

When there are supcs with invalid format

3001 error code should return

3002 error code should return

1002 error code should return

1001 - File Not Found error code should return

1003 error code should return

1005 error code should return

1004 error code should return

2003 error code should return

2001 error code shoul return

2002 error code should return