Badges are our best guess from the listing, but may contain errors.
Can we decompile a transformer to find out how it works? Join us to discuss Discovering Interpretable Algorithms by Decompiling Transformers to RASP: In this paper, we present a general method to extract such programs from trained Transformers. The idea is to faithfully...