TRL2024/3/10 4:47:00 https://huggingface.co/docs/trl/index Transformer Reinforcement Learning DPOを行うためのライブラリ。
『Direct Preference Optimization: Your Language Model is Secretly a Reward Model』2024/3/10 4:46:00 https://arxiv.org/abs/2305.18290