pptrain
A PyTorch-native library for pre-pretraining language models on synthetic tasks
Work
Closed-Form Initialization
An analytical approach to neural network initialization using covariance and eigendecomposition
Gradient Routing for Continual Learning
Evaluating sparsity and gradient-reweighted updates as a mechanism for continual learning
Temporal Regularized Learning
A highly local, self-supervised learning procedure that optimizes each neuron individually
Clac
A series of programming language projects exploring pattern matching, macro expansion, and interpreter design
PV Growth Forecasting
Multivariate time series forecasting of photovoltaic electricity production in Germany