Please enable JavaScript.

Coggle requires JavaScript to display documents.

Deep neural networks (types of ML (transfer learning, continual learning,…

- - - - curriculum learning (Bengio, ICML2009)
      - self-paced learning (Kumar, NIPS2010)
      - self-paced curriculum learning (Jiang, AAAI2015)
      - automated curriculum learning (Graves, ICML2017)
      - spaced repetition (Amiri, EMNLP 2017)
      - teacher-student curriculum learning (Matiisen, 2017)
- - - - standard/random training
      - curriculum learning (Bengio, 2009)
      - spaced repetition (Amiri, 2017)
    - - standard/random training
        
        regularization methods
        
        rehearsal methods
        
        recency-based rehearsal (Ratcliff, 1990)
        
        sweep rehearsal (Robin, 1995)
        
        pseudo-rehearsal (Robin, 1995)
    - - standard/random training
      - curriculum learning
- - - - types of cost functions
        
        quadratic cost fn (mean squared error)
        
        cross-entropy cost fn (used w sigmoid)
        
        log likelihood cost fn (used w softmax)
        
        hinge loss (used w SVM)
    - - L1 regularization
      - L2 regularization
      - dropout