The kyungeun/gemma-2-9b-it-mathinstruct-dpo was trained using UltraFeedback dataset on kyungeun/gemma-2-9b-it-mathinstruct which is trained on mathinstruct dataset.
Downloads last month
8
Safetensors
Model size
9B params
Tensor type
BF16
·
Model tree for kyungeun/gemma-2-9b-it-mathinstruct-dpo