dead features at high SAE width caught me completely off guard

trained a wide autoencoder and a huge chunk of features basically never fire. activation frequency histograms became my best friend overnight.