Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
https://nlpoverview.com/#a-pos-tagging
Andor et al. (2016) showed a transition-based approach that produces competitive result with a simple feed-forward neural network.
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Code for the paper "Language Models are Unsupervised Multitask Learners"
The project huggingface/transfomer has implementation of transfomer based modles (such as GPT-2 ) .
https://openai …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
huggingface/transformers has PyTorch implementation of transfomer based models (such as BERT and DistilBERT ).
https://github.com/codertimo/BERT-pytorch
Official Implementation of BERT in TensorFlow
https://mccormickml.com/2019 …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
User-based Filtering (Memory-based Filtering)
Item-based Filtering (Content-based Filtering)
Non-negative Matrix Factorization
Neural Matrix Factorization
Variational Autoencoder
Hybrid
New methods like VAE, AE, or Deep Collaborative outperform classical methods like NMF on …
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
GELU is the best activation function currently (at least in NLP).
,
where \(\Phi(x)\) is the cumulative distribution function of the standard normal distribution.