Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Microsoft Learning to Rank Datasets - MSLR-WEB10K - MSLR-WEB30K
Data for NLP Research
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
The Multi-Genre NLI Corpus (MultiNLI)
General Language Understanding Evaluation (GLUE)
The Stanford Question Answering Dataset
SWAG (Situations With Adversarial Generations)
Reading Comprehension Dataset (RACE)
Heuristic Analysis for NLI Systems Data set …
Data for Testing
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
DataTable Generator
Faker
Faker is a Python package that generates fake data for you.
hypothesis
Hypothesis is a powerful, flexible, and easy to use library for property-based testing.
SQL Data Generator …
Use pyarrow to Share Data in Memory in Python
References¶
https://github.com/apache/arrow
https://stackoverflow.com/questions/54582073/sharing-objects-across-workers-using-pyarrow
https://github.com/pytorch/pytorch/issues/13039
https://issues.apache.org/jira/browse/ARROW-5130
https://uwekorn.com/2019/09/15/how-we-build-apache-arrows-manylinux-wheels.html