HomeCybersecurityNeural Backdoor Detection: Activation Clustering Defense

Neural Backdoor Detection: Activation Clustering Defense

Interactive 3D visualizer: a hidden trigger poisons part of a training class, forming a separable cluster in the network's activation space — run k-means-based Activation Clustering to detect and flag the poisoned samples.

Cybersecurity3DAdvanced60 FPS
exp-ai-security ↗ Open standalone

This simulator renders every sample a poisoned classifier assigns to one output class as a point in a real 3D projection of the network's last hidden-layer activation space. A hidden trigger pushes a poisoned minority of that class into a tight, separated cluster, exactly as it does in a real backdoored network. Adjust the poison rate, trigger separation and clean-activation spread, then run the real k-means Activation Clustering defense (Chen et al., 2018) to flag the suspected cluster, or reveal the planted ground truth to check how the defense performed — with live precision, recall and a silhouette-style separation score.

⚙ Under the hood

Visualize how a hidden backdoor trigger creates a separable cluster in a neural network's activation space, then run the real k-means-based Activation Clustering defense to detect and flag the poisoned samples.

cybersecurityAI securitybackdoor attackactivation clusteringk-meansneural network

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)