Exploring mergekit for Model Merge, AutoEval for Model Evaluation, and DPO for Model Fine-tuning | Towards Data Science

My observations from experimenting with model merge, evaluation, and two model fine-tuning techniques