Improved Elastic Weight Consolidation

Improved Elastic Weight Consolidation derives EWC from an explicit old-task solution-preservation constraint. Preserving scalar loss recovers empirical-Fisher EWC; preserving outputs up to motion along the old-task loss level set produces IEWC and removes unintended gradient-scale weighting.