Semi-supervised Pre-training

Pre-training methods are aimed to guide the parameters of a network towards interesting regions in model space using unlabeled data, before fine-tuning the parameters with the labeled data

References

Jashish Shrestha. (n.d.). Beginner's Guide to Semi-Supervised Learning. Link