Research Engineer, FlexOlmo

The Allen Institute for AI (Ai2) is seeking a Research Engineer to join the FlexOlmo team, focusing on developing next-generation large language model architectures, including Mixture-of-Experts and long-context models. You will design and implement scalable machine learning pipelines and contribute to open-source research tools. This role involves collaboration with researchers to push the boundaries of LLM research and release high-impact open models.

• Building infrastructure to facilitate the next generation of LLM research
• Optimizing training and inference for language models
• Triaging between experiments and executing on the most impactful
• Bridging the gap between cutting-edge research and a widely adopted product
• Bringing software engineering best practices to a research environment
• Supporting and collaborating with an open-source community
• Releasing contributions as open-source software, model releases, and additions to Ai2’s public API and datasets

• Bachelor's degree in Data Science/CS/EE/Applied Mathematics/Statistics/ML/NLP or equivalent experience
• 4+ years experience building ML infrastructure for data preprocessing, training, evaluation, inference, deployment
• Experience in complete model development cycle: dataset construction, training, tuning, evaluation, profiling, monitoring