Entry-Level AI Infrastructure Product Engineer - Remote

About the Role

We're hiring an Entry-Level AI Infrastructure Product Engineer to join our dynamic team at Katonic AI. This remote position allows you to work from anywhere in India while contributing to cutting-edge AI infrastructure projects. As a Product Engineer, you'll learn to deploy and fine-tune large language models (LLMs) at an enterprise scale, making a significant impact on our clients' operations.

What You'll Work On

• Gain hands-on experience with high-performance inference engines for LLMs, including vLLM and SGLang.
• Learn to deploy and test LLM serving infrastructure, contributing to production systems that serve inference requests.
• Run benchmarks to measure latency, throughput, and memory usage, ensuring optimal performance.
• Validate new models before production, working with industry-leading models like LLaMA and Mistral.
• Document deployment procedures and test results to enhance team knowledge.
• Collaborate with senior engineers and contribute from day one, developing your skills in a supportive environment.

Requirements

• 0-2 years of experience; fresh graduates with strong fundamentals are welcome.
• Solid Python programming skills.
• Understanding of machine learning basics, including model training and inference.
• Familiarity with deep learning concepts such as transformers and neural networks.
• Basic knowledge of Linux command line and exposure to Docker.
• Curiosity about LLMs and a debugging mindset.

Nice to Have

• Coursework or projects in machine learning or deep learning.
• Exposure to frameworks like Hugging Face, PyTorch, or TensorFlow.
• Understanding of fine-tuning concepts and APIs.
• Familiarity with cloud platforms such as AWS or GCP.

What We Offer

• Opportunity to work at the forefront of Generative AI and Agentic AI.
• Fully remote work from anywhere in India.
• Health insurance and access to GPUs for learning and experimentation.
• Mentorship from experienced ML engineers and a learning budget for courses.
• Global exposure through collaboration with teams in Sydney, Singapore, and Dubai.

Join us as an Entry-Level AI Infrastructure Product Engineer and kickstart your career in the exciting field of AI!