Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

VisualVM is a great tool for performance profiling of JVM applications.

1. The application must be LONG RUNNING in order for VirtualVM to profile it.

IntelliJ IDEA

VisualVM Launcher

VirtualVM Executable

/usr …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Code for the paper "Language Models are Unsupervised Multitask Learners"

The project huggingface/transfomer has implementation of transfomer based modles (such as GPT-2 ) .

Fine Tune the GPT-2 Model

References

https://openai …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Implementations

huggingface/transformers has PyTorch implementation of transfomer based models (such as BERT and DistilBERT ).

https://github.com/codertimo/BERT-pytorch

Official Implementation of BERT in TensorFlow

Tutorials

https://mccormickml.com/2019 …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Installation

Ubuntu

apt-get install krb5-user

CentOS

yum install -y ntp yum install krb5-workstation krb5-libs krb5-auth-dialog

Issues

kinit: Permission denied while initializing Kerberos 5 library

It is likely due to the fact …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

General Tips

1. By default, internet access from a Kaggle notebook/kernel is turned off. You have to manually turn it on from the right-side panel in order to visit access internet …

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

1. The default user is the root user, so you can install software as needed.

2. Google Colab notebook does not support terminal but it can be hacked to run JupyterLab.

3. You can …