🧬 2D Differentiable Architecture Search: Bilevel Alpha Gradient, Mixed Edges and the Discretisation Gap
Cell diagram of a tiny DARTS supernet: softmax weights of zero, skip, average and convolution operations on six edges, first versus second-order alpha gradients, the derived discrete cell and the discretisation gap, with five independent numerical checks.
⚙ Under the hood
Cell diagram of a tiny DARTS supernet: softmax weights of zero, skip, average and convolution operations on six edges, first versus second-order alpha gradients, the derived discrete cell and the discretisation gap, with five independent numerical checks.
Differentiable Architecture SearchDARTSNeural Architecture SearchBilevel OptimisationSoftmax RelaxationSecond-Order GradientDiscretisation GapAutoML
2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install