Paths in parameter space: blue = plain sum, orange = PCGrad; green = task optima
Total loss against step

Gradient Surgery: Projecting Away Conflicting Task Gradients (2D)

Two tasks pull one shared parameter vector in opposite directions. Project each gradient onto the normal plane of the other whenever they conflict, and compare the path with plain gradient summing. Change the curvature mismatch, the distance between the task optima and the step size, then read the conflict fraction, both losses and the Pareto stationarity gap. A Blender-built plotting easel with exact orthogonality, descent and finite-difference checks built in.

Made with 🟠 Blender