I am currently an ELLIS PhD student advised by Gerard de Melo at the Hasso Plattner Institute and ELLIS Unit Potsdam, Germany and co-advised by Desmond Elliott at the University of Copenhagen.

My current research focuses on multilingual NLP, tokenizers, and embeddings. In particular, I am working towards “freeing” pretrained large language models from their static vocabularies by developing better methods for tokenizer transfer and embedding initialization of new tokens [1,2]. In particular, I focus on crosslingual transfer of pretrained models, where a tokenizer mismatch with new languages can be very detrimental.

Apart from this focus I have a broader set of research interests: I have published works on computationally efficient training of large language models [3,4], extending tokenizers with a special “I Don’t Know”-token for uncertainty quantification [5] as well as conditional image generation using GANs [6] and have worked on multimodal protein modeling in a research internship with InstaDeep.

I’m currently interning at Apple with the Global Siri team in Barcelona, Spain. Previously, I completed an ML research internship with InstaDeep in Paris focusing on multimodal generative protein design and interned with SAP in Newport Beach, California as a software engineer after my undergrad. In my spare time, I enjoy playing my saxophone, chess, alpine hiking, and solo traveling.

Contries worked out of during my PhD counter: 12 🇩🇪🇸🇬🇲🇾🇹🇭🇳🇴🇯🇵🇮🇩🇫🇷🇰🇷🇬🇧🇺🇸🇪🇸

Download my CV