Please enable JavaScript.

Coggle requires JavaScript to display documents.

XR Performance Tests (Implementation (Phase 1 : Migrate Existing Tests to…

- - - - :check: Refactor perf test project to use programmatic build and deployment
        
        :check: Target FPS Settings
        
        :check: Custom scene building
        
        :check: Custom Free CPU Measurement Script
        
        :check: XR Device Types
        
        :check: Enable player builds with VR targets
      - :check: Batch execution of tests with PS script
    - - :check: Get XR Perf Results written to Perf DB
  - - - :check: Ingest data to ElasticSearch/Kibana
      - :check: Build initial data visualizations with filters
  - - - :check: Add framework support for
        
        HTC Vive
        
        Gear VR
        
        Google Cardboard
        
        Google Daydream
      - :check: Build out lab with HW & Devices to support tests
      - :check: Add support for StereoRenderPath
        
        MultiPass
        
        SinglePass
        
        Instancing
      - :check: Add support for RenderThreadingMode
        
        SingleThreaded
        
        MultiThreaded
        
        GfxJobs
      - :check: Add support for Graphics API
        
        D3D11
        
        OpenGL
        
        Vulkan
  - - - :check: Add more size variety to test scenes to accomodate more configurations/possible performance results
      - :check: Improve Oculus Rift HMD/Sensor connection reliablity via service restarts done in test framework
      - :check: Improve HTC Vive HMD/Sensor connection reliablity via process restarts done in test framework
      - :check: Migrate CI system to Jenkins for more flow control of test execution
  - - - :check: Redesign baselining algorithm.
        
        Perf DB schema
        
        test framework
        
        results publishing service
        
        expansion of baseline configuration inputs
      - :check: Add ability to reset baseline if necessary
  - - - :pencil2:: New NDA platform
      - :pencil2:: New tests/scenes to collect
        
        App Startup Time
        
        Camera.Render Time
        
        Render.Mesh time
        
        FPS
      - :pencil2: Collect perf metrics on xr-enabled AND non-xr-enabled configurations for easier comparison and RCA
  - - - :pencil2: Standup Katana/Bokken agent with first XR device
- - - - :pencil2: Trigger PASS/FAIL against baseline and threshold
      - :pencil2: Baseline against non-XR enabled platform
    - - :pencil2: Standalone
        
        :check: HTC Vive
        
        :check: Oculus Rift
        
        :check: Oculus
        
        :check: OpenVR
        
        ⚪ Windows MR
        
        ⚪ Microsoft Hololens
      - :pencil2: Mobile
        
        :check: Google Cardboard
        
        :check: Google Daydream
        
        :pencil2: Mayo
        
        :check: Gear VR
        
        ⚪ AR Kit
        
        ⚪ AR Core
        
        :check: iOS
    - - :check: Free CPU Overhead Time
      - :check: GPU Time
      - :check: Total Allocated Memory Size
      - :check: App Startup Time
      - :check: Camera.Render CPU Time
      - :check: Render.Mesh CPU Time
      - :check: Frames Per Second (FPS)
  - - - :check: Pivot on StereoRenderPath
      - :check: Pivot on Graphics API
      - :check: Pivot on RenderThreadingMode
      - :check: Pivot on Platform
      - :check: Pivot on XR Device Type
      - :check: Pivot on XR SDK
      - :check: Pivot on changeset