Please enable JavaScript.
Coggle requires JavaScript to display documents.
NLP - Coggle Diagram
NLP
-
Classify
Bag-of-Words (BOW model)
-
Milk is good and not expensive
Milk is expensive and not good
BOW model things both are the same information
Sequence Modeling
n-grams
-
-
Smoothing
-
-
-
Interpolation
Mix of different ngrams with lower order like 4gram, trigram & unigam
-
-
-
-
-
-
-
Sequence Tagging
POS Tagging
noun, verb, pronoun, preposition, adjective, adverb,
conjunction, article
-
-
-
-
-
-
Why Probality
Bayes rule:
\( P(A|B) = \frac{P(B|A)P(A)}{P(B)} \)
where \( P(A) \) is the prior probability of \( A \), \( P(B) \) is the prior probability of \( B \), \( P(A|B) \) is the posterior probability of \( A \) given \( B \), and \( P(B|A) \) is the likelihood of \( B \) given \( A \).
-
-
Zipf's law
Perplexity score
Perplexity score is used to determine how the model is confused with the given text. The usually score between 0 and 1. The lower the perplexity score, the better the model is.
-