Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Microsoft Learning to Rank Datasets - MSLR-WEB10K - MSLR-WEB30K
Tips on PyTorch
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Docker Images for PyTorch
- pytorch/pytorch:latest (official PyTorch image)
- dclong/jupyterhub-pytorch
PyTorch Tutorials
https://pytorch.org/tutorials/beginner/pytorch_with_examples.html
Initialize Weights and Biases
In general …
My List of Python Modules
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Data Science
-
pandas: data frame.
-
scipy: scientific computing.
-
numpy: multi-dimensional arrays, fundation of pandas and deep learning packages.
-
re: regular expression
File System
-
shutil: copy, move …
Python Modules for Date and Time
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
datetime
dateutil
Useful extensions to the standard Python datetime features
dateparser
python parser for human readable dates
arrow
Better dates & times for Python.
monthdelta
Serialization and Caching in Python
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
functools.lru_cache
https://docs.python.org/3/library/functools.html#functools.lru_cache
cachetools
https://cachetools.readthedocs.io/en/latest/ https://github.com/tkem/cachetools
diskcache sounds like a good options!!!
DiskCache …
Spark Issue: _Pickle.Picklingerror: Args[0] from __Newobj__ Args Has the Wrong Class
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Please refer to Spark Issue: Task Not Serializable for a similar serialization issue in Spark/Scala.
Symptom
Cause
For example, if you have the following import
from nltk.corpus import stopwords …