Ben Chuanlong Du's Blog

It is never too late to learn.

Spark Issue: Unable to Find Encoder Type

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Issue Unable to find encoder for type stored in a Dataset

Solution …

Proxychains-Ng Issues on Mac

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

ProxyChains-ng does not work on macOS due to System Integration Protection (SIP). There are basically 3 ways to fix/avoid it.

  1. The issue only happens if you execute a system binary …

Common Errors Encountered in Scala and Solutions

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

  1. Java Version Issue

    Unsupported major minor version

    https://stackoverflow.com/questions/22489398/unsupported-major-minor-version-52-0

java.lang.NoSuchMethodError: scala.Product.\(init\)

Fixing the Scala error: java.lang.NoSuchMethodError: scala.Product.\(init\)

It probably …

Issues in pip and Solutions

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

The issue is due to to pyopenssl using old dependencies. It can be fixed by removing the Python package cryptography package and then upgrading …

Fix Package Installation Issue in Linux

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Error message: The package hl1440lpr needs to be reinstalled, but I can't find an archive for it.

Steps to fix the issue:

Start with

sudo dpkg --remove --force-all hl1440lpr

If that …

Zeppelin Issues and Solutions

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Error/Issue 1

java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask