Partiful logo

Performing Per-Neuron Analysis on an LLM

Hosted by
•‿•
Sign in to see location
Ever wonder how transformers actually do some of their computation? Wanted to know more about what this “mechanistic interpretability” thing is and how it relates to AI safety? This is the workshop for you! We’ll be analyzing how transformers perform induction (in particular in the vein of mechanistic interpretability as first kicked off by Anthropic’s 2021 transformer circuits paper). This workshop is meant for people who have previously built and trained their own transformers previously. We will assume that people are already very familiar with a standard decoder-only GPT-2-style transformer. This workshop will consist of an introduction talk into mechanistic interpretability of LLMs, some guiding principles, and then a hands-on exercise where we actually do some interpretability exercises. You will need to bring a computer to participate!
4 on the list
KM
EH
SJ
LB
SM
MT
MF
MW
M
SR
SV

Restricted Access

Verify your phone number to view event details and activity
Sign in

Photo Album

Activity

XX
Xxxx Xxxxxx got added to The List 🤘
about 1 month ago
XX
Xxxx Xxxxxxx got added to The List 🤘
about 2 months ago
XX
Xxxxx Xxxxxxx got added to The List 🤘
about 2 months ago
Excited Schitts Creek GIF by CBC
XX
Xxxxxx Xxxxxxxxx got added to The List 🤘
about 2 months ago
XX
Xxxxxxx Xxxxxxx got added to The List 🤘
2 months ago
XX
Xxxxx Xxxxx got added to The List 🤘
2 months ago
XX
Xxxxxxxx Xxxxxxxx got added to The List 🤘
3 months ago
XX
Xxx Xxxxxx got added to The List 🤘
3 months ago
X
Xxxxx got added to The List 🤘
3 months ago
XX
Xxxxxxxxx Xxxxxx got added to The List 🤘
3 months ago
Artificial Intelligence Design GIF by xponentialdesign