Please enable JavaScript.

Coggle requires JavaScript to display documents.

Neural Networks for NLP, CMU CS 11-747, Fall 2017 (CMU Neural Nets for NLP…

- - - - Efficiency Slides
    - - Efficiency Code Examples
    - - Efficiency Lecture Video
    - - Reference: Importance Sampling (Bengio and Senécal, 2003)
      - Reference: Noise Contrastive Estimation (Mnih and Teh, 2012)
      - Highly Recommended Reading: Notes on Noise Contrastive Estimation and Negative Sampling (Dyer 2014)
      - Reference: Negative Sampling (Goldberg and Levy, 2014)
      - Reference: Mini-batching Sampling-based Softmax Approximations (Zoph et al., 2015)
      - Reference: Class-based Softmax (Goodman 2001)
      - Reference: Hierarchical Softmax (Morin and Bengio 2005)
      - Reference: Error Correcting Codes (Dietterich and Bakiri 1995)
      - Reference: Binary Code Prediction for Language (Oda et al. 2017)
    - - Describing a word by the company that it keeps
      - Skip-grams and CBOW
      - Counting and predicting
      - Evaluating/Visualizing Word Vectors
      - Advanced Methods for Word Vectors
  - - - Describing a word by the company that it keeps
      - Skip-grams and CBOW
      - Evaluating/Visualizing Word Vectors
      - Counting and predicting
      - Advanced Methods for Word Vectors
    - - Word Embedding Slides
    - - Word Embedding Code Examples
    - - Word Embedding Lecture Video
    - - Reference: WordNet
      - Reference: Linguistic Regularities in Continuous Representations (Mikolov et al. 2013)
      - Required Reading (for quiz): Goldberg Book Chapters 10-11
      - Reference: t-SNE (van der Maaten and Hinton 2008)
      - Reference: Visualizing w/ PCA vs. t-SNE (Derksen 2016)
      - Reference: How to use t-SNE effectively (Wattenberg et al. 2016)
      - Reference: Evaluating Word Embeddings (Schnabel et al. 2015)
      - Reference: Morphology-based Embeddings (Luong et al. 2013)
      - Reference: Character-based Embeddings (Ling et al. 2015)
      - Reference: Subword-based Embeddings (Bojankowski et al. 2017)
      - Reference: Multi-prototype Embeddings (Reisinger and Mooney 2010)
      - Reference: Non-parametric Multi-prototype Embeddings (Neelakantan et al. 2014)
      - Reference: Cross-lingual Embeddings (Faruqui et al. 2014)
      - Reference: Retrofitting to Lexicons (Faruqui et al. 2015)
      - Reference: Sparse Word Embeddings (Murphy et al. 2012)
      - Reference: De-biasing Word Embeddings (Bolukbasi et al. 2016)