Language Model
BERT is a bidirectional Transformer encoder. It is also a Language Model that has been studied and used widely after the paper was published.