Ben Chuanlong Du's Blog

It is never too late to learn.

Delete a Layer in a Pretrained Model in PyTorch

It is common to customize a pretrained model by delete the output layer or replace it to the output layer that suits your use case. There are several ways to achieve this in PyTorch.

Replace the Fully Connected Layer with an Identity Layer

  1. Define an identity layer.

  2. Replace the fully connected layer with an Identity Layer (using ResNet18 as an example).