Ben Chuanlong Du's Blog

It is never too late to learn.

China Transportation

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. 能乘坐火车就尽量乘坐火车, 公路客运相比缺点实在是太多了.

中国铁路客 …

Use LightGBM With Spark

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

https://github.com/Azure/mmlspark/blob/master/docs/lightgbm.md

MMLSpark seems to be the best option to use train models using LightGBM on a Spark cluster. Note that MMLSpark requires …

The Python Quit Unexpectedly Error

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

If you are using Homebrew, you can reinstall a corrupted Python environment like this:

brew uninstall --ignore-dependencies --force python python@2 unset PYTHONPATH brew install python python@2 I had another …

Gradient Clipping in PyTorch

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

optimizer.zero_grad()        
output = model(data)
loss = F.nll_loss(output, target)
loss.backward()
torch.nn.utils.clip_grad_norm_(model.parameters(), args.clip)
optimizer.step()
  1. Use torch.nn.utils.clips_grad_norm_ (which is in-place) instead …