GoldenDataset Refactoring
Helper Functions
IO
Docker
environment file
verification functions
network removal
network availability
running container status
free container name
verification functions
Zipping folders
file availability
status if artifact is cached
data artifact preparation
delete files or folders in cache
Pseudo Code
1) Configuration file loading
2) Environment variable checking
4) Variable definitions
ADAS 247 variables
Gitlab Credentials
Azure Credentials
5) Remote artifact verification
6) Docker state preparations
7) Artifact preparation
8) MongoDB startup
9) Local Nexus startup
10) Verify local Nexus instance
3) Verify static log compatibility with ADAS with given configuration
11) Run ADAS 247 resimulation
12) Algo Stream isolation
13) KPI computation
Gitlab
File retrieval from branches
Open issues
KPI
Gitlab Branch code dedublication
Error / Exception Handling
Logging
config file management
KPI algorithm / library
additional golden dataset fields
14) Cleanup
timestamp tracking
Logging
Time
Errors
Exceptions
Stack traces
Execution time of job
Job created at
Job started at
Job finished at
Log processed at
Job information
Worker information
Job Parameters
Worker monitoring
Metricbeat
Heartbeat
CI Pipeline information
Docker
manage multiple golden datasets