How To Transform A Transformer