ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning

Keyphrases

• Language Model 100%
• Protein Sequence 100%
• Self-supervised Learning 100%
• Token 50%
• Autoencoder 50%
• Dimensionality Reduction 50%
• Amino Acids 50%
• Unlabeled Data 50%
• Autoregressive Model 50%
• Three-state 50%
• Grammar 50%
• Natural Language Processing 50%
• Water-soluble 50%
• Secondary Structure 50%
• Computational Biology 50%
• Database Search 50%
• Multiple Sequence Alignment 50%
• Biophysical Characteristics 50%
• Protein Subcellular Localization 50%
• Protein Secondary Structure Prediction 50%
• Evolutionary Information 50%
• Computational Bioinformatics 50%
• ELECTRA 50%
• Transformer-XL 50%
• XLNet 50%
• Sequence Ideal 50%
• Protein Language Model 50%

Biochemistry, Genetics and Molecular Biology

• Peptide Sequence 100%
• Protein Secondary Structure 100%
• Amino Acids 50%
• Dimensionality Reduction 50%
• Evolution 50%
• Sequence Alignment 50%
• Natural Language Processing 50%