On Pre-Training for Visuo-Motor Control: Revisiting a Learning-from-Scratch Baseline

We revisit a simple Learning-from-Scratch baseline for visuo-motor control that uses data augmentation and a shallow ConvNet. We find that this baseline has competitive performance with recent methods that leverage frozen visual representations trained on large-scale vision datasets.