Reduce Memory Needed to Train Deep Learning Models May 03, 2020 checkmate¶checkmate breaks the GPU memory wall by enabling researchers to train large state-of-the-art models that do not fit in GPU memory. Checkmate applies optimal tensor rematerialization (as detailed in the paper) to trade off space and time.