Senior Backend Engineer - Enterprise AI Products

About the Role

We are seeking a Senior Backend Engineer for Enterprise AI Products to join our innovative team. This remote position offers you the chance to work with cutting-edge AI technologies and contribute to the development of API-based services for enterprise customers. As a Senior Backend Engineer, you will play a pivotal role in building the infrastructure that powers our AI evaluation platform, Arena Intelligence.

What You'll Do

• Build API-based products from the ground up, focusing on low-latency and high-reliability APIs for leaderboards and models.
• Design and implement solutions for complex streaming problems, ensuring robust handling of SSE/streaming responses.
• Develop enterprise-grade infrastructure, including rate limiting, authentication, usage metering, and SOC2 compliance.
• Implement deep observability features, including distributed tracing and real-time dashboards to monitor system performance.
• Collaborate with the research team to integrate AI-centered products with our core evaluation platform.
• Contribute to the backend of our Leaderboards and Evals platforms, ensuring a unified data architecture.

Requirements

• 4+ years of backend engineering experience, particularly in distributed systems and developer-facing platforms.
• Strong proficiency in Go and/or Rust, with hands-on experience in building high-throughput APIs.
• Experience with LLM provider APIs (OpenAI, Anthropic, Google) and understanding of streaming and token management challenges.
• Solid cloud infrastructure skills, including AWS or GCP, Kubernetes, Terraform, and database systems like Postgres and Redis.
• A product-oriented mindset, focusing on developer experience and API usability.
• Comfort with ambiguity and a startup environment where scope and context may shift.

Nice to Have

• Experience in building API gateways or developer tools.
• Background in ML infrastructure or model serving frameworks.
• Familiarity with enterprise-ready features such as SSO, RBAC, and multi-tenancy.

What We Offer

• Comprehensive health, dental, and vision benefits.
• The opportunity to work on cutting-edge AI projects with a mission-driven team.
• A culture that values transparency, trust, and community impact.
• Visa sponsorship available for international candidates.