Please enable JavaScript.
Coggle requires JavaScript to display documents.
Provost Ch 10 (How to work with Text (Term frequency (Analyze how…
Provost Ch 10
How to work with Text
a "document" can be any piece of text, regardless of length or structure
-
Bag of words
-
Ignore grammar, word order, sentence structure. and usually punctuation
-
Term frequency
-
normalize words
ex: iPhone, IPHONE, iphone
-
remove stop word: and, the, of ect.
Text processing
-
-
Why text is difficult
-
-
-
-
Context and punctuation is key, and is which humans can pick up on, but computers struggle
-
-