A Lite Bert
Year: 2,020
Journal: International Conference on Learning Representations
Languages: Chinese, English
Programming languages: Python
Input data:
sentences
Project website: https://github.com/google-research/ALBERT
ALBERT is “A Lite” version of BERT, a popular unsupervised language representation learning algorithm. ALBERT uses parameter-reduction techniques that allow for large-scale configurations, overcome previous memory limitations, and achieve better behavior with respect to model degradation.