본문 바로가기

Papers/ML

(3)
[논문 리뷰] Protein Design with Guided Discrete Diffusion (NIPS 2023) 이 글에서 다루는 논문: Protein Design with Guided Discrete Diffusion (2023.05, N Fray et al.) https://arxiv.org/abs/2305.20009 비슷한 시기에 나온 유사한 논문: Protein Discovery with Discrete Walk-Jump Sampling (2023.06, N Gruver et al.) https://arxiv.org/abs/2306.12360 참고하면 좋을 논문: Plug-and-Play Language Models (PPLM) https://arxiv.org/abs/1912.02164 Code: https://github.com/ngruver/NOS Introduction Protein sequence d..
[리뷰] Interpreting Graph Neural Networks for NLP With Differentiable Edge Masking (ICLR 2021) by Schlichtkrull et al. Paper Link : https://openreview.net/pdf?id=WznmQa42ZAx Contents 1. Introduction 2. Related Works 3. Methods 4. Synthetic Experiment 5. Question Answering 6. Semantic Role Labeling 7. Summary & Conclusion Abstract GNNs are famous apporach for integrating structural inductive biases into NLP models There is little work on interpreting for understanding which parts of the gr..
[리뷰] Distilling the Knowledge in a Neural Network (NIPS Workshop 2014) by Hinton et al. Paper Link : https://arxiv.org/pdf/1503.02531.pdf Contents 1. Introduction 2. Distillation 3. Experiments (MNIST, Speech Recognition) 4. Training Ensembles on Very Big Datasets (JFT) 5. Soft Targets as Regularizers 6. Summary Introduction 다수의 사용자가 사용하는 서비스를 배포하고자 할 때, latency와 computational resources는 중요한 문제입니다. 예를 들어, ensemble 모델은 모바일 프로그램으로 배포하기에 부적합할 수 있습니다. 이러한 경우 도입해볼 수 있는 ..

반응형