Pre-Training Engineer for Large Language Models - Remote

About the Role

We are seeking a Pre-Training Engineer for Large Language Models to join our innovative team at Poolside. This remote position allows you to work with cutting-edge technology in the field of AI and software development. You will be a key player in our mission to build foundational models for source code generation, utilizing thousands of GPUs to enhance our training and inference processes.

What You'll Do

• Propose and evaluate innovations in the training development experience and reliability.
• Enhance and maintain our training and inference codebases.
• Write high-quality code in Python (PyTorch), Cython, and C/C++.
• Perform code refactorings to improve efficiency and maintainability.
• Improve CI/CD processes to ensure smooth deployments.

Requirements

• Understanding of Large Language Models (LLM) and basic knowledge of Transformers.
• Strong engineering background with programming experience in Python, C/C++, and Linux.
• Familiarity with deep learning fundamentals and algorithmic skills.
• Experience with CI/CD and project maintenance.
• Ability to critically assess code quality and propose improvements.

Nice to Have

• Experience with modern tools and frameworks in AI development.
• Strong critical thinking skills.
• Willingness to learn and adapt to new technologies.

What We Offer

• Fully remote work with flexible hours.
• 37 days of vacation and holidays per year.
• Health insurance allowance for you and your dependents.
• Company-provided equipment for your home office.
• Well-being and learning allowances to support your growth.
• Frequent team get-togethers to foster collaboration.
• A diverse and inclusive culture that prioritizes people.