Search

24 Nov 2023: Multilingual Models in Neural MachineTranslation. Guangyu Yang. Department of EngineeringUniversity of Cambridge. This dissertation is submitted for the degree ofMaster of Philosophy in Machine Learning and Machine Intelligence. Clare Hall August 2023. Dedicated to my loving parents. Declaration. I, Guangyu Yang of Clare Hall, being a candidate for the MPhil in Machine Learning andMachine Intelligence, hereby declare that this report and the work described in it are my ownwork, unaided except as may be specified below, and that the report does not contain materialthat has already been used to any substantial extent for a comparable purpose. All software used in this thesis was written in Python and PyTorch. The open-sourceHugging Face transformers library1 [47] was used for downloading pre-trained models andinference. The sacreBLEU library2 [26] was used to download datasets and evaluate theperformance of the models using the BLEU metric. The BLEURT library3 [34] was used toevaluate the performance of the models using the BLEURT metric. The OpenICL frameworkwas used to experiment with in-context learning. And the Direct Preference Optimizationcodebase4 [28] was used for unsupervised preference optimization with MBR. The