읽은 리뷰

논문 리뷰 읽은 것 정리용

• [논문 리뷰] Finetuned Language Models Are Zero-Shot Learners (인용 3326)
• [논문 리뷰] InstructGPT: Training language models to follow instructions with human feedback (인용 11000)
• [논문 리뷰] COT: Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (10000)
• [논문 리뷰] LoRA: Low-Rank Adaptaion of Large Language Models (9700)
• [논문 리뷰] CLIP: Learning Transferable Visual Models From Natural Lanugage Supervision (27600)
• Let's Verify Step by Step (437)
• [PMLR 2020] A Simple Framework for Contrastive Learning of Visual Representations (SimCLR) 핵심 리뷰 (21300)
• [논문 리뷰] NeRF 간단 설명 & 원리 이해하기 | 새로운 방향에서 바라본 view를 생성하는 기술 (10400)
• [논문리뷰] Self-Consistency Improves Chain of Thought Reasoning in Language Models (1300)
• [LLM] Graph of Thoughts: Solving elaborate problems with large language models (AAAI 2024) (700)
• [논문리뷰]GraphSage : Inductive Representation Learning on Large Graphs(2017) (18500)
• [논문리뷰] Training Large Language Models to Reason in a Continuous Latent Space
• [논문리뷰] Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach

Survey 논문

• A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

개념 정리

• Rotary Position Embedding (RoPE)
• KV cache
• MHA vs MQA vs GQA vs MLA
• [Deep Research] 강화학습의 개념과 주요 기법 분석, LLM에서의 활용 및 발전 방향에 대한 보고서
• Tree of Thoughts
• "좋아요", "싫어요"로 언어모델을 개선해 보자. (KTO)