Rotation Prediction: A Self-Supervised Pretext Task
Watch an embedding space self-organize as a rotation-prediction pretext task trains: unlabelled points move under real softmax cross-entropy gradients toward one of four rotation-class centroids, with live loss and accuracy readouts.
Self-supervised learning trains an encoder without any human labels by inventing a pretext task the data can label itself — here, predicting which of four rotations (0°/90°/180°/270°) was applied to an image. This simulator renders every embedded sample as a point in a live 3D feature space and runs a real softmax-cross-entropy gradient descent against four rotation-class prototypes: the true-class term pulls each point home while the wrong-class terms push it away in proportion to how confidently the classifier currently mispredicts it. A temperature slider controls how hard the pretext task is, a learning-rate slider controls the optimizer step size, and live readouts track training step, accuracy, cross-entropy loss and cluster separation as the four rotation clusters emerge from an initially scrambled cloud.
Watch an embedding space self-organize as a rotation-prediction pretext task trains: unlabelled points move under real softmax cross-entropy gradients toward one of four rotation-class centroids, with live loss and accuracy readouts.
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install