Publications

Knowledge Acquisition through Continued Pretraining is Difficult: A Case Study on r/AskHistorians
Jan Hoffbauer, Sylwester Sawicki, Marc Ulrich, Tolga Buz, Konstantin Dobler, Moritz Schneider, Gerard de Melo
PDF BibTeX Code
Language Adaptation on a Tight Academic Compute Budget: Tokenizer Swapping Works and Pure bfloat16 Is Enough
Konstantin Dobler, Gerard de Melo
PDF arXiv BibTeX Code
Efficient Parallelization Layouts for Large-Scale Distributed Model Training
Johannes Hagemann, Samuel Weinbach, Konstantin Dobler, Maximilian Schall, Gerard de Melo
PDF arXiv BibTeX Code
FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models
Konstantin Dobler, Gerard de Melo
PDF arXiv BibTeX Code
Art Creation with Multi-Conditional StyleGANs
Konstantin Dobler, Florian Hübscher, Jan Westphal, Alejandro Sierra-Múnera, Gerard de Melo, Ralf Krestel
PDF arXiv BibTeX Code Video
Generation of Bots Based on Observed Behavior
Gregor Berg, Andre Wenz, Bernhard Hoeppner, Thomas Bodner, Olga Cherepanova, Lasse Steffen, Jan Siebert, David Hennemann, Pascal Schulze, Konstantin Dobler, Kris-Fillip Kahl, Paul Beneke, Philipp Hoberg
PDF View on Google Patents