The best logging package for Python!
Note that the default logging level is
DEBUGin loguru and it is not allowed to change the logging level of an created logger object in loguru. You can refer to changing-the-level-of-an-existing-handler and Change level of default handler on ways to changing logging level in loguru.- Remove the default logger (with logging level equals DEBUG) and add a new one with the desired logging level.
Logging in PySpark
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
-
Excessive logging is better than no logging! This is generally true in distributed big data applications.
-
Use
loguruif it is available. If you have to use theloggingmodule, be …