Please enable JavaScript.
Coggle requires JavaScript to display documents.
DWH Production Cluster work - Coggle Diagram
DWH Production Cluster work
Renaming the DWH clusters
Old Prod
UAT
Prod
Testing UAT cluster
Current status
Nifi Running
Pipleline working as old Prod
Queries going to RedShift
Get UAT back to latest version to what we want to release
Revert activities we did on 31/08
Done
Rest of the testing activities
phases
Data and Data source validation
if not UAT then we can continue working on Prod
Otherwise ??
Application testing
Through Reports
Errors we came across
Access issues?
Non access related issues
Need to validate this with Ehsan as these could be still access issues
UAT or Not?
Boundary testing
Query Engine
RedShift
Data flow is working
Whether data is correct need to be validated
Site Gaming data?
Pipeline validation
Based on findings from above branch
To be continued
07/09/2020
Troubleshooting
Query Engine Authentication issue
Done
Connecting new Nifi and Production connectivity
Old cluster getting data from production
Change Nifi config in new Production
Get the pipeline working with above
Do a validation of data
Using the queries which have been used in production
Production move
Linking Report service ( site data) to Query Engine
Analyse whether old site data working with new Query engine
Do we have to check whether site data is changed
Report publishers will have to be changed
Analyse what has to happen
Code changes required
Infrastructure changes need to be identified
Anything need to happen related to EKS version upgrade?
Reduction of Redshift 02 nodes already catered
Additional Activities
Refresh UAT data ?
Last time we have done it may be 2 month back
Other issues
CG Year was not appearing
Might be an intermittent issue
Something might be blowing up Redshift table
Re starting Query engine might resolve this
Did not resolve the issue
1st Position is going for Gold which is pushing the UAT solution to Production
Questions
Was the queries working during
UAT time in Dec-Feb
Releases UAT
We need to change the publisher to only include CG reports as it has more reports such as AML, Breaches, etc
Documentation and KT related activities
How to support
Future??
Do we really need RedShift
Can we use Prosgress
Maintenance
Planning for upgrades, patches
Ehsan's prev experience could be tapped in to