HomeAI & Machine LearningEmergent Communication — Policy Graph (2D)

Emergent Communication — Policy Graph (2D)

Watch a sender and receiver agent invent their own symbolic language from scratch through a Lewis signaling game, rendered as a live 2D policy graph and entropy/success strip chart — REINFORCE policy updates in a genuinely 2D representation.

AI & Machine Learning2DAdvanced60 FPS📱 Mobile-adapted⇄ 3D version
2d-ai-topic-54 ↗ Open standalone

Two independent agents — a Sender that sees a target object and a Receiver that only hears a symbol — are trained end-to-end with nothing but a shared reward for guessing correctly. This 2D counterpart renders the resulting Lewis signaling game as a live bipartite policy graph: five concept icons on the left, the current vocabulary of symbol nodes in the middle, and the same five concepts mirrored on the right as the receiver's possible guesses. Every edge's thickness and opacity is drawn directly from the agents' softmax probability tables, so the entire learned language is visible at once, and a traveling token replays a sampled round across it. Rolling strip charts beneath the graph track success rate and protocol entropy across training — a distinct, graph-and-timeseries representation of the exact same REINFORCE mechanics used by the 3D version, not a flattened camera view of it.

⚙ Under the hood

Train a sender and receiver agent from scratch in a Lewis signaling game, but watch it as a live 2D policy graph: concept-to-symbol and symbol-to-concept edges drawn straight from the agents' softmax tables, plus rolling success-rate and entropy strip charts.

multi-agentreinforcement-learningemergent-communicationMARLsignaling-gameREINFORCEpolicy-graph2D

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)