Senior Forward Deployed Engineer - AI Systems

About the Role

We’re hiring a Senior Forward Deployed Engineer to join our team remotely. This role offers an exciting opportunity to take AI prototypes into real-world production systems and involves relocation to Japan after approximately six months. As a Senior Forward Deployed Engineer, you will design and build scalable AI systems, working closely with enterprise customers to deliver impactful solutions.

What You'll Do

• Design and build scalable microservices using Clean Architecture.
• Deploy and operate workloads on AWS or Azure using Docker, Kubernetes, and Terraform.
• Integrate LLM APIs (OpenAI, Anthropic) and implement RAG-based systems.
• Build evaluation pipelines (RAGAS, BLEU) to measure quality and control hallucinations.
• Implement observability: logs, metrics, traces, and SLOs.
• Serve and optimize models using vLLM / TGI, considering latency, cost, and GPU constraints.
• Work directly with enterprise customers, gathering requirements and explaining technical trade-offs.
• Transition into a Japan-facing role after ~6 months.

Requirements

• 8-15 years of strong software engineering experience with a backend-heavy profile.
• Graduate from a Tier-1 engineering college (IITs, NITs, IIITs, or equivalent).
• Experience in a Tier-1 product company (global or leading Indian product firms).
• Core skills in Fine Tuning, Model Optimization, Python & SQL for batch and streaming data pipelines.
• Experience with Microservices architecture and API design.
• Proficiency in Cloud & DevOps: AWS/Azure, Docker, Kubernetes, CI/CD.
• Familiarity with GenAI systems (LLMs, vector search, RAG).
• Strong plus: ML frameworks such as PyTorch, Scikit-learn, Spark.

Nice to Have

• Experience in model serving & optimization (vLLM, TGI).
• Knowledge of GPU memory management and quantization (GGUF, AWQ).
• Understanding of Transformers and Attention mechanisms.

What We Offer

• Comprehensive relocation packages to help you move and settle in Japan.
• Commitment to learning Japanese during your tenure in India with language training/support provided.
• High ownership and visibility in your projects.
• Clear pathway to international relocation and exposure to global enterprise customers and markets.
• Opportunity to build real, production AI systems, not just demos.
• Support for long-term international career growth.