공부할 논문 리스트

논문

아키텍쳐

• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
• SimCSE: Simple Contrastive Learning of Sentence Embeddings

임베딩

• RoFormer: Enhanced Transformer with Rotary Position Embedding

• SimCSE: Simple Contrastive Learning of Sentence Embeddings

• Dense Passage Retrieval for Open-Domain Question Answering

• Unsupervised Dense Information Retrieval with Contrastive Learning

• ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

• BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation

경량화

• Distilling the Knowledge in a Neural Network