HomeAI & Machine LearningRotation Prediction: A Self-Supervised Pretext Task

Rotation Prediction: A Self-Supervised Pretext Task

Watch an embedding space self-organize as a rotation-prediction pretext task trains: unlabelled points move under real softmax cross-entropy gradients toward one of four rotation-class centroids, with live loss and accuracy readouts.

AI & Machine Learning3DModerate60 FPS📱 Mobile-adapted
ds-topic-54 ↗ Open standalone

Self-supervised learning trains an encoder without any human labels by inventing a pretext task the data can label itself — here, predicting which of four rotations (0°/90°/180°/270°) was applied to an image. This simulator renders every embedded sample as a point in a live 3D feature space and runs a real softmax-cross-entropy gradient descent against four rotation-class prototypes: the true-class term pulls each point home while the wrong-class terms push it away in proportion to how confidently the classifier currently mispredicts it. A temperature slider controls how hard the pretext task is, a learning-rate slider controls the optimizer step size, and live readouts track training step, accuracy, cross-entropy loss and cluster separation as the four rotation clusters emerge from an initially scrambled cloud.

⚙ Under the hood

Watch an embedding space self-organize as a rotation-prediction pretext task trains: unlabelled points move under real softmax cross-entropy gradients toward one of four rotation-class centroids, with live loss and accuracy readouts.

self-supervised-learningpretext-taskrotation-predictioncross-entropyembeddingsmachine-learning

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)