Please enable JavaScript.
Coggle requires JavaScript to display documents.
Natural Language Processing - Coggle Diagram
Natural Language Processing
Natural vs Formal Language
Formal
ex- Java
Python
C++
C#
ormal
Natural
ex-Chinses
Japanese
Sinhala
English
Language
Conversation
Two-way communication
Both sides feel understood
Communication
One-way communication.
message sent.
Natural
English
Sinhala
Japanese
ex-Chinses
Collaboration
Thinking, planing, making decisions
Co-Creation
Joint activity, making, doing
How NLP Works
Fundamental NLP Pre-processing tasks
Tokenization - Splitting text into individual tokens
Lowercasing - Converting all characters in the text to lowercase to ensure uniformity.
Removing Stop Words - Removing common words that usually don't carry significant meaning
Stemming - Reducing words to their root form by removing suffixes
Lemmatization - Reducing words to their base or dictionary form
Discourse analysis is the study of language beyond the level of individual words and sentences
Pragmatic analysis is the study of language in use, focusing on how context, speaker intentions, and social norms influence meaning in communication
Syntex Tree
depict the relationships between words and phrases within a sentence.
Syntax and Semantics in NLP
Syntax refers to the structure of sentences in a language
Semantics, on the other hand, deals with the meaning of words and sentences and how they convey information.
Lexicon
A lexicon is a collection of words and phrases (lexical items) in a language.
N-Gram Model
It predicts the next word in a sequence of words based on the probability of occurrence of N consecutive words (or tokens) in the sequence.
web Links
http://www.bbc.co.uk/programmes/p032nvf4
http://www.aisb.org.uk/media/files/LoebnerPrize2014/Rose.pdf