Senior Research Engineer for Language Technologies - Remote

About the Role

We are seeking a Senior Research Engineer for Language Technologies to join our innovative team at the Barcelona Supercomputing Center. In this remote position, you will work on cutting-edge projects in Natural Language Processing (NLP) and contribute to the development of advanced language models. You will have the opportunity to collaborate with experts in the field and access state-of-the-art computational infrastructures.

What You'll Do

• Lead the post-training team to drive alignment and instruction-tuning strategies for massive language models.
• Develop synthetic data generation pipelines to enhance model reasoning and instruction-following capabilities.
• Research and deploy comprehensive post-training strategies, including algorithm design and evaluation of instructed LLMs.
• Adapt alignment frameworks for deployment on MareNostrum 5, one of the most powerful supercomputers in Europe.
• Collaborate with local and international experts to advance the field of language technologies.

Requirements

• Degree in Computer Science, Mathematics, or a related field.
• Advanced proficiency in Python, Linux, and Bash scripting.
• Extensive experience with AI frameworks such as PyTorch, DeepSpeed, and Megatron.
• Deep knowledge of HPC infrastructure and workload managers, specifically Slurm.
• Proven capability to engineer and execute deep learning pipelines in restricted HPC environments.

Nice to Have

• Published research in Natural Language Processing.
• Hands-on experience with containerization technologies like Docker and Singularity.
• Knowledge of relational database architecture and SQL.
• Experience training large language models (LLMs).
• Fluency in Spanish and English, with knowledge of other Spanish co-official languages valued.

What We Offer

• Full-time contract with a competitive salary based on qualifications and experience.
• Flexible working hours and a supportive work environment.
• Access to extensive training programs and professional development opportunities.
• Comprehensive relocation support for candidates moving to Barcelona.
• 22 days of holidays plus 6 personal days, along with additional time off during the holiday season.