Llm

Multiple figures exploring patterns within the feed forward network weight matrices.

Multiple figures exploring how the model's prediction of the next token evolves through the layers of the model.

Interesting plots examining properties of the model parameters in the attention block.

Interesting plots showing how the transformer attention mechanism behaves.

An overview of the setup I use for the research. Which model, dataset, ect...