Neural Backdoor Detection: Activation Clustering Defense
Interactive 3D visualizer: a hidden trigger poisons part of a training class, forming a separable cluster in the network's activation space — run k-means-based Activation Clustering to detect and flag the poisoned samples.
This simulator renders every sample a poisoned classifier assigns to one output class as a point in a real 3D projection of the network's last hidden-layer activation space. A hidden trigger pushes a poisoned minority of that class into a tight, separated cluster, exactly as it does in a real backdoored network. Adjust the poison rate, trigger separation and clean-activation spread, then run the real k-means Activation Clustering defense (Chen et al., 2018) to flag the suspected cluster, or reveal the planted ground truth to check how the defense performed — with live precision, recall and a silhouette-style separation score.
Visualize how a hidden backdoor trigger creates a separable cluster in a neural network's activation space, then run the real k-means-based Activation Clustering defense to detect and flag the poisoned samples.
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install