Hardware Optimization and Co-Design Engineer - Remote Opportunity

About the Role

We are seeking a talented Hardware Optimization and Co-Design Engineer to join our dynamic team at OpenAI. This remote position offers you the chance to work on cutting-edge hardware solutions tailored for advanced AI workloads. As a key member of our hardware optimization team, you will collaborate closely with software and research partners to co-design hardware that is tightly integrated with AI models.

What You'll Do

• Co-design future hardware for programmability and performance with our hardware vendors.
• Assist hardware vendors in developing optimal kernels and add support for it in our compiler.
• Develop performance estimates for critical kernels for different hardware configurations and drive decisions on compute core and memory hierarchy features.
• Build system performance models at different abstraction levels and carry out analysis to drive decisions on scaling up and scaling out.
• Work with machine learning engineers, kernel engineers, and compiler developers to understand their vision and needs from high-performance accelerators.
• Manage communication and coordination with internal and external partners.
• Influence the roadmap of hardware partners to optimize them for OpenAI’s workloads.
• Evaluate potential partners’ accelerators and platforms.

Requirements

• 4+ years of industry experience, including experience harnessing compute at scale and optimizing ML platform code to run efficiently on target hardware.
• Strong experience in software/hardware co-design.
• Deep understanding of GPU and/or other AI accelerators.
• Experience with CUDA, Triton, or a related accelerator programming language.
• Strong coding skills in C/C++ and Python.
• Familiarity with the fundamentals of deep learning computing and chip architecture/microarchitecture.

Nice to Have

• PhD in Computer Science and Engineering with a specialization in Computer Architecture, Parallel Computing, or Compilers.
• Strong understanding of LLMs and challenges related to their training and inference.

What We Offer

• Competitive salary ranging from $120,000 to $160,000 per year.
• Comprehensive relocation assistance for new employees.
• Flexible work arrangements with a hybrid model of 3 days in the office and 2 days remote.
• Opportunities for professional growth and development.
• A collaborative and inclusive work environment.

If you are excited about the prospect of co-designing hardware for AI and want to be part of a team that is pushing the boundaries of technology, apply for the Hardware Optimization and Co-Design Engineer position today!