Please enable JavaScript.

Coggle requires JavaScript to display documents.

A/B testing (Used to: (Test addition of new services, Test ranking…

- - - - Clicks?
      - CTR?
      - Click through probability
      - Estimating repeating experiment
      - Which distribution?
        
        Binomial
        
        2 types of ouctomes
        
        Independant events
        
        Identical distribution
      - Calculating the confidence interval
- - - - Are the populations the same
      - Is the distribution the same
  - - - Helping students get jobs
      - Financial sustainability
    - - Expand and refine
      - Each stage is a metric
        
        Number
        
        Rate or probabilities
    - - Exclude Difficult Metrics
      - Factor External Data
        
        Surveys
        
        Academic Research
      - Internal Data
        
        Retrospective analyses
        
        Run experiments
      - Additional Data
        
        User Experience Research (UER)
        
        Good for brainstorming
        
        Can use special equipment
        
        Want to validate results
        
        Focus Groups
        
        Get feedback on hypotheticals
        
        Run risk of group think
        
        Surveys
        
        Useful for gathering bulk data
- - - - Stable, unchanging
      - Personally identifiable
    - - Changes when you switch browser
      - Users can clear cookies
    - - No consistent experience
      - Use only for non-user-visible changes
    - - only available for mobile
      - tied to specific device
      - unchangable
      - personally identifiable
    - - changes when location changes
- - - - Do participants understand what data is being collected about them?
      - What harm would befall them should that data be made public?
      - Would they expect that data to be considered private and confidential?