NLU Notebook Examples

Checkout the following notebooks for examples on how to work with NLU.

NLU Training Examples

Binary Class Text Classification training

• 2 class Finance News sentiment classifier training
• 2 class Reddit comment sentiment classifier training
• 2 class Apple Tweets sentiment classifier training
• 2 class IMDB Movie sentiment classifier training
• 2 class twitter classifier training

Multi Class Text Classification training

• 5 class WineEnthusiast Wine review classifier training
• 3 class Amazon Phone review classifier training
• 5 class Amazon Musical Instruments review classifier training
• 5 class Tripadvisor Hotel review classifier training
• 5 class Phone review classifier training

Multi Label Text Classification training

• Train Multi Label Classifier on E2E dataset Demo
• Train Multi Label Classifier on Stack Overflow Question Tags dataset Demo

Named Entity Recognition training (NER)

• NER Training example

Part of Speech tagger training (POS)

• POS Training example

NLU Applications Examples

• Sentence Similarity with Multiple Sentence Embeddings
• 6 Wordembeddings in 1 line with T-SNE plotting

NLU Demos on Datasets

• Kaggle Twitter Airline Sentiment Analysis NLU demo
• Kaggle Twitter Airline Emotion Analysis NLU demo
• Kaggle Twitter COVID Sentiment Analysis NLU demo
• Kaggle Twitter COVID Emotion Analysis nlu demo

NLU examples grouped by component

The following are Collab examples which showcase each NLU component and some applications.

Named Entity Recognition (NER)

• NER pretrained on ONTO Notes
• NER pretrained on CONLL
• Tokenize, extract POS and NER in Chinese
• Tokenize, extract POS and NER in Korean
• Tokenize, extract POS and NER in Japanese
• Aspect based sentiment NER sentiment for restaurants

Part of speech (POS)

• POS pretrained on ANC dataset
• Tokenize, extract POS and NER in Chinese
• Tokenize, extract POS and NER in Korean
• Tokenize, extract POS and NER in Japanese

Sequence2Sequence

• Translate between 192+ languages with marian
• Try out the 18 Tasks like Summarization Question Answering and more on T5
• T5 Open and Closed Book question answering tutorial

Classifiers

• Unsupervised Keyword Extraction with YAKE
• Toxic Text Classifier
• Twitter Sentiment Classifier
• Movie Review Sentiment Classifier
• Sarcasm Classifier
• 50 Class Questions Classifier
• 300 Class Languages Classifier
• Fake News Classifier
• E2E Classifier
• Cyberbullying Classifier
• Spam Classifier
• Emotion Classifier

Word Embeddings

• BERT, ALBERT, ELMO, ELECTRA, XLNET, GLOVE at once with t-SNE plotting
• BERT Word Embeddings and t-SNE plotting
• ALBERT Word Embeddings and t-SNE plotting
• ELMO Word Embeddings and t-SNE plotting
• XLNET Word Embeddings and t-SNE plotting
• ELECTRA Word Embeddings and t-SNE plotting
• COVIDBERT Word Embeddings and t-SNE plotting
• BIOBERT Word Embeddings and t-SNE plotting
• GLOVE Word Embeddings and t-SNE plotting

Sentence Embeddings

• BERT Sentence Embeddings and t-SNE plotting
• ELECTRA Sentence Embeddings and t-SNE plotting
• USE Sentence Embeddings and t-SNE plotting

Sentence Embeddings

• BERT Sentence Embeddings and t-SNE plotting
• ELECTRA Sentence Embeddings and t-SNE plotting
• USE Sentence Embeddings and t-SNE plotting

Dependency Parsing

• Untyped Dependency Parsing
• Typed Dependency Parsing

Text Pre Processing and Cleaning

• Tokenization
• Stopwords removal
• Stemming
• Lemmatization
• Normalizing
• Spell checking
• Sentence Detecting
• Normalize documents

Chunkers

• N Gram
• Entity Chunking

Matchers

• Date Matcher