Robust Self-Supervised Extrinsic Self-Calibration