Transformer Testing Knowledge