Please enable JavaScript.
Coggle requires JavaScript to display documents.
Natural Language Processing - Coggle Diagram
Natural Language Processing
History of NLP
1950s: Turing's test, Georgetown experiment
1960s: ELIZA program
1970s: Conceptual ontologies, chatterbots
1980s: Shift from hand-written rules to machine learning algorithms.
Natural Language Generation
NG process involves:
Discourse Planner
Surface Realizer
Lexical Selection
Techniques
in NLP
Machine learning and Al systems.
Categories:
Symbolic: Deep analysis, human verification.
Statistical: Mathematical models, large corpora
Connectionist: Inferencing from examples.
General Task in NLP
Tokenization/Semantic Segmentation
Disambiguation -
Stemming
Part of Speech (POS) tagging
Contextual Analysis
Sentiment Analysis
Challenges in NLP
Phonology, morphology, lexicon, syntax, semantics, pragmatics, discourse analysis, OCR, word and topic segmentation, and NL creation and comprehension.
Steps of Natural Language Understanding
Contextual Understanding
Coreference Resolution
Context Handling
Sentiment Analysis
Entity Extraction
Identifying Key Entities Relevant to Intent
Mapping to Database or Domain-Specific Terms
Semantic Analysis
Named Entity Recognition (NER)
Word Sense Disambiguation
Semantic Role Labeling
Intent Recognition
Detecting User Intent
Classifying the Purpose of Input
Syntactic Analysis
Part-of-Speech Tagging
Parsing (Dependency / Constituency)
Knowledge Base interaction (Optional)
Querying Structured Knowledge (e.g, SOL,Ontologies)
Retrieving Relevant Facts
Text Preprocessing
Tokenization
Normalization (lowercasing, removing punctuation)
Stop Word Removal
Output Generation
Action Execution
Response Generation (if chatbot or dialogue system)
Input Acquisition
Text Input (eg, from speech, user typing)
Speech Recognition (if voice input)
Linguistics and Language
Sounds (phonology), word formation (morphology), sentence structure (syntax), meaning (semantics), understanding (pragmatics).
Definition in NLP
Communication between human languages and computers
link between machine comprehension and human language.
makes it possible for machines to read, comprehend, and interpret text.
Language Technologies
Information Retrieval & Extraction
Sentiment & Opinion Analysis
Conversational Agents
Language Learning Tools
Machine Translation
Speech Technologies
Text Technologies
Components of NLP
Natural Language Understanding (NLU)
Mapping input sentences to useful representations.
Levels of analysis: morphological, syntactic, semantic, discourse.
Natural Language Generation (NLG)
Producing natural language outputs from internal representations.
Levels of synthesis: deep planning, syntactic generation.