Remote Senior Data Engineer - AI & Health Tech

About the Role

We are recruiting a Remote Senior Data Engineer to join our innovative team at Sanctuary Computer. This role is pivotal in shaping the future of data architecture in the AI and health & wellness space. As a Senior Data Engineer, you will design and own data pipelines, workflow orchestration, and complex data integrations, ensuring the reliability and scalability of our data platform.

What You'll Do

• Monitor and maintain data pipelines, troubleshooting errors, and addressing format drift.
• Extract and enrich additional data elements from diverse sources.
• Reprocess and validate large datasets in batch workflows.
• Design and integrate new data sources into existing pipelines.
• Align and integrate extracted data with the core application data model.
• Participate in code reviews, providing constructive feedback and ensuring adherence to best practices.
• Contribute to project success by managing team velocity, project scope, budget, and timeline.
• Negotiate with clients to align project scope with budget and timeline.

Requirements

• Senior-level Python expertise.
• Experience with data/workflow orchestration tools (e.g., Prefect, Airflow, Dagster).
• Thorough understanding of ETL & data transformation for industry standard LLMs (OpenAI, Claude, etc.).
• Familiarity with Large Language Models (LLMs).
• Skilled in interfacing with APIs (OpenAI, Google Gemini/Vertex, etc.) using wrapper libraries.
• Practical experience in prompt engineering.
• 5+ years of experience in backend development (Ruby on Rails, Elixir Phoenix, Python Django, or Node Express).

Nice to Have

• Experience with Google Cloud Platform (GCP), particularly Cloud Run and Cloud Tasks.
• Knowledge of search technologies, including embeddings and vector databases.
• Familiarity with PySpark for batch data processing.
• Client-facing experience to gather requirements and provide technical solutions.
• Product management experience in defining product roadmaps.
• Engineering management experience in leading teams and mentoring developers.

What We Offer

• Competitive salary ranging from $180,000 to $270,000 per year.
• Equity options for qualified candidates.
• Flexible remote work environment.
• Opportunities for professional growth and development.
• Collaborative and creative team culture.
• Engaging projects that make a difference in the world.

Join us as a Remote Senior Data Engineer and contribute to innovative projects in the AI and health tech industries. Apply now and be part of a team that values creativity, diversity, and quality work.