Tips on Delta Lake
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Delta Table
convert to delta [db_name.]table_name [partitioned by ...] [vacuum [retain number hours]]
vaccum
describe history db_name.table_name
can select from historical snapshot can also rollback to a historical snapshot rollback …
Understand Memory Usage in PyTorch
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Data Engineering Tools
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
https://github.com/linkedin/datahub
https://engineering.linkedin.com/blog/2019/data-hub DataHub: A generalized metadata search & discovery tool
Study Notes on Knowledge Graph
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
RDF: Resource Description Framework OWL: Web Ontology Language
Products
neo4j
RDFox
Unique features of RDFox include the very powerful rule language (roughly …
Pretrained Deep Learning Models
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!