Senior Software Engineer - AI Transformation (Remote)

About the Role

We're hiring a Senior Software Engineer - AI Transformation to join our innovative team at ButterflyMX. This role offers a unique opportunity to embed AI directly into our software development process, enhancing engineering velocity and code quality. As a Senior Software Engineer working remotely, you'll play a crucial role in shaping how our organization operates and how our development teams leverage AI.

What You'll Do

• Build and maintain an internal LLM gateway that handles routing, fallbacks, and rate limiting.
• Create reusable components for common AI patterns such as RAG, function calling, and streaming responses.
• Develop SDKs or libraries that simplify AI integration for application developers.
• Implement prompt management systems and evaluation frameworks.
• Design and deploy vector database infrastructure for semantic search.
• Create monitoring dashboards for AI usage, costs, and performance metrics.
• Write technical documentation and best practice guides for AI implementation.
• Evaluate and integrate new AI services and models as they become available.

Requirements

• 5+ years of software engineering experience with a strong focus on platform/infrastructure development.
• Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.) and AI orchestration frameworks (OpenAI Agents SDK, Google ADK).
• Proficiency in Python or TypeScript.
• Knowledge of vector databases, embedding models, and RAG architectures.
• Experience building internal developer tools, SDKs, or platform services.
• Understanding of API design, authentication, and rate limiting.
• Familiarity with cloud platforms (AWS, GCP) and containerization.
• Experience with observability, monitoring, and cost management for AI systems.
• Strong documentation and communication skills.

Nice to Have

• Experience in developing AI-powered features in a SaaS environment.
• Familiarity with agile methodologies.
• Knowledge of software development best practices.

What We Offer

• Comprehensive Medical, Dental, and Vision plans (ButterflyMX covers 80% of the cost) starting day 1.
• 401(k) plan with a match.
• 10 paid holidays, 20 vacation days, 5 sick days, and 3 floating holidays.
• Basic Life and Accidental Death and Dismemberment Insurance (ButterflyMX covers 100% of the cost).
• Short and Long Term Disability (ButterflyMX covers 100% of the cost).
• Paid Family Leave and Employee Assistance Program.
• Quarterly self-care stipends.
• Access to optional benefits including pre-tax flexible healthcare spending accounts (FSA and HSA), Dependent Care FSA, and Commuter Benefits.