Senior Software Engineer - AI Agentic Runtime

About the Role

We are seeking a Senior Software Engineer (Agentic Runtime) to join our dynamic team at Dialpad. This Senior Software Engineer remote position is an exciting opportunity to work on cutting-edge AI technologies that enhance customer communications. At Dialpad, we believe that every conversation matters, and as a Senior Software Engineer, you will play a crucial role in elevating these interactions through innovative solutions.

What You'll Do

• Contribute to the design, development, and maintenance of agentic runtime systems, including agent orchestration, tool execution pipelines, and multi-step reasoning loops.
• Build and optimize core runtime components, including task planners, action dispatchers, memory managers, and context window management systems.
• Work on agent coordination techniques, including dynamic tool selection, parallel agent execution, state management, and result aggregation across multi-agent workflows.
• Maintain and enhance highly scalable agentic platforms with a focus on low-latency execution, cost efficiency, and deterministic behavior.
• Ensure high availability, reliability, and fault tolerance in agent runtime services, including graceful degradation when LLM or tool calls fail.
• Collaborate with cross-functional teams — including ML researchers, product, and platform engineers — to translate agentic product requirements into robust runtime infrastructure.
• Develop and optimize real-time distributed systems, microservices, and event-driven architectures powering agentic task execution.
• Design and implement sandboxed execution environments for safe agent use of tools, code execution, and external API calls.

Requirements

• 3–6 years of experience in distributed systems, platform engineering, or ML infrastructure, with exposure to LLM-based or agentic systems strongly preferred.
• Strong understanding of agent architectures, including ReAct, plan-and-execute, and multi-agent coordination patterns.
• Deep knowledge of context management, prompt lifecycle, tool-call protocols (e.g., function calling, MCP), and agent memory strategies (short-term, episodic, and long-term).
• Experience integrating and managing external tool ecosystems, including web search, code interpreters, databases, and third-party APIs.
• Familiarity with retrieval-augmented generation (RAG) and how retrieval fits into broader agentic pipelines.
• Understanding of LLM output reliability challenges — hallucination, non-determinism, and retry/fallback strategies at runtime.
• Proficiency in Go and Python 3 (experience with Rust or TypeScript is a plus).
• Strong understanding of distributed systems, microservices, and event-driven architectures suited to long-running agent tasks.

Nice to Have

• Experience with API design using OpenAPI, Swagger, or equivalent, with an eye toward agentic interaction patterns.
• Knowledge of gRPC or equivalent RPC protocols for inter-service communication within agent runtimes.
• Experience with Docker and Kubernetes, including managing long-running or stateful agent workloads in containerized environments.
• Familiarity with cloud platforms (GCP preferred, AWS/Azure optional), including managed services relevant to agentic workloads such as queuing, secrets management, and compute autoscaling.
• Hands-on experience with Infrastructure as Code tools like Terraform or Ansible.
• Knowledge of CI/CD frameworks and continuous delivery practices, with comfort shipping infrastructure in a fast-moving research-adjacent environment.

What We Offer

• Competitive salary and benefits package.
• Robust training program to help you reach your full potential.
• Inclusive office environment designed to cultivate collaboration and connection.
• Recognition as a certified Great Place to Work.
• Opportunities for mentorship and professional growth.

If you’re excited about this role and possess the fundamental traits, the drive, and strong ambition we seek, we encourage you to apply. Join us in transforming customer communications with AI!