Lightweight transformers for clinical natural language processing

Keyphrases

• Clinical Natural Language Processing 100%
• Lightweight Transformer 100%
• Transformer 50%
• Processing Task 50%
• ArXiv 50%
• BioBERT 50%
• Knowledge Distillation 50%
• Sequence Classification 25%
• Publicly Available 25%
• Using Knowledge 25%
• Distillation Learning 25%
• Biomedical Text Mining 25%
• Named Entity Recognition 25%
• DistilBERT 25%
• BERT Embeddings 25%
• Natural Language Inference 25%
• Clinical Text 25%
• Progress Notes 25%
• Language Model 25%
• Compact Model 25%
• Number of Parameters 25%
• Relation Extraction 25%
• Large Animal Model 25%
• Continual Learning 25%
• Inference Relations 25%
• Natural Language Processing 25%
• Discharge Summary 25%
• Preprints 25%
• Recognition Classification 25%
• Biomedical Data 25%
• Pre-trained Language Model 25%
• GitHub 25%

Computer Science

• Processing Task 40%
• Knowledge Distillation 40%
• Continual Learning 20%
• Biomedical Data 20%
• Language Modeling 20%
• Text Mining 20%
• Sequence Classification 20%
• DistilBERT 20%
• Reproducibility 20%
• Named Entity Recognition 20%
• Pre-Trained Language Models 20%