anlp21
Course materials for "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley) Syllabus: http://people.ischool.berkeley.edu/~dbamman/info256.html
| Notebook | Description |
|---|---|
| 1.words/EvaluateTokenizationForSentiment | The impact of tokenization choices on sentiment classification. |
| 1.words/ExploreTokenization | Different methods for tokenizing texts (whitespace, NLTK, spacy, regex) |
| 1.words/TokenizePrintedBooks | Design a better tokenizer for printed books |
| 1.words/Text_Complexity | Implement type-token ratio and Flesch-Kincaid Grade Level scores for text |
| 2.compare/ChiSquare, Mann-Whitney Tests | Explore two tests for finding distinctive terms |
| 2.compare/Log-odds ratio with priors | Implement the log-odds ratio with an informative (and uninformative) Dirichlet prior |
| 3.dictionaries/DictionaryTimeSeries | Plot sentiment over time using human-defined dictionaries |
| 3.dictionaries/Empath | Explore using Empath dictionaries to characterize texts |
| 4.embeddings/DistributionalSimilarity | Explore distributional hypothesis to build high-dimensional, sparse representations for words |
| 4.embeddings/WordEmbeddings | Explore word embeddings using Gensim |
| 4.embeddings/Semaxis | Implement SemAxis for scoring terms along a user-defined axis (e.g., positive-negative, concrete-abstract, hot-cold), |
| 4.embeddings/BERT | Explore the basics of token representations in BERT and use it to find token nearest neighbors |
| 4.embedings/SequenceEmbeddings | Use sequence embeddings to find TV episode summaries most similar to a short description |
| 5.eda/WordSenseClustering | Inferring distinct word senses using KMeans clustering over BERT representations |
| 5.eda/Haiku KMeans | Explore text representation in clustering by trying to group haiku and non-haiku poems into two distinct clusters |
9 Nov 17, 2022
82 Jun 28, 2022
0 Dec 11, 2022
435 Jan 04, 2023
2 Sep 20, 2022
3 Jul 28, 2021
159 Jan 06, 2023
47 Jul 26, 2022
37 Dec 06, 2022
3 May 26, 2022
101 Dec 26, 2022
322 Jan 01, 2023
5 Oct 01, 2022
9 Sep 13, 2021
1 Feb 23, 2022
3 Jul 05, 2022
21 Sep 25, 2022
220 Dec 30, 2022
1.6k Dec 29, 2022
26 Dec 14, 2022