AI Platform Engineer - LLM Infrastructure (Remote)

About the Role

We're hiring an AI Platform Engineer (LLM Infrastructure) to join our team remotely. This role focuses on building an internal AI platform that enables developers to efficiently ship AI-powered services. As an AI Platform Engineer, you will work on model connectivity, prompt testing, evaluation, and the underlying AI infrastructure layer.

What You'll Do

• Build and operate the AI platform infrastructure enabling developers to ship LLM-based services faster.
• Implement and maintain Kubernetes-based runtime environments (including AKS) for AI workloads.
• Manage infrastructure as code using Terraform, including modules, environments, and CI/CD automation.
• Support LLM workflows such as RAG, agents, prompt experimentation, evaluations, and deployment patterns.
• Integrate and operate tooling like Azure AI Foundry, LiteLLM, Langfuse, and MLflow.
• Orchestrate pipelines using Kubeflow Pipelines and/or Argo Workflows for building, deploying, and evaluating models.
• Improve platform reliability and observability through monitoring, logging, tracing, and cost/performance signals.
• Collaborate closely with developers to streamline the developer experience (DX) through APIs, templates, documentation, and automation.

Requirements

• Strong hands-on experience with Kubernetes in production, preferably AKS.
• Solid Terraform expertise, including IaC best practices and multi-environment setups.
• Practical experience supporting ML/LLM workloads in a platform or DevOps/MLOps context.
• Proficiency in Python for automation, scripting, and supporting APIs/evaluation tooling.
• Understanding of CI/CD, release processes, and production-grade operations.
• Ability to work under tight timelines and deliver pragmatically.

Nice to Have

• Experience building internal developer platforms or “paved roads” for engineering teams.
• Familiarity with LLM evaluation frameworks, prompt testing workflows, and LLM observability.
• Exposure to RAG architectures, vector databases, and agentic patterns.
• Experience with Kubeflow, Argo, and ML lifecycle tooling.

What We Offer

• Long-term B2B contract with competitive salary.
• Remote work opportunities within Europe, with a preference for candidates in Croatia, Poland, Portugal, or Serbia.
• Flexible working hours aligned with European time zones.
• Collaborative team environment with a focus on innovation and efficiency.
• Opportunity to work with cutting-edge AI technologies and contribute to impactful projects.