Senior Data Engineer - Remote Position at Anduril Industries

About the Role

We are seeking a highly skilled Senior Data Engineer to join our team at Anduril Industries. This Senior Data Engineer remote position is pivotal in building and scaling our next-generation data platform. You will have the autonomy to architect robust systems that unlock critical business insights from complex, large-scale data.

What You’ll Do

• Design and build scalable data pipelines: Architect, develop, and maintain robust and efficient ETL/ELT pipelines to process petabyte-scale data from a wide variety of sources using platforms like Google BigQuery, Databricks, and Palantir Foundry.
• Apply software engineering principles: Treat data infrastructure as a software product. Develop reusable frameworks, libraries, and tools to accelerate data pipeline development and ensure reliability using best practices like version control, code reviews, and CI/CD.
• Architect and model data: Design and implement well-structured, performant data models and schemas in our data warehouse and data lakehouse environments, optimized for both analytical querying and application use.
• Ensure data quality and reliability: Implement comprehensive data quality checks, monitoring, and alerting to proactively identify and resolve data issues. Troubleshoot and optimize performance bottlenecks in data processing and storage layers.
• Be a force multiplier: Collaborate closely with data scientists, analysts, software engineers, and business stakeholders.

Requirements

• 5+ years of experience in a data engineering or similar software engineering role, ideally building data products in a fast-paced environment.
• Strong programming proficiency in Python.
• Hands-on expertise with at least one major cloud data platform such as Google BigQuery, Databricks, or an enterprise data system like Palantir Foundry.
• Expert-level SQL and query optimization skills on large-scale datasets.
• Solid understanding of data modeling concepts, ETL/ELT design patterns, and data warehousing/lakehouse principles.
• Experience with a major cloud environment (GCP, AWS, Azure), including its security ecosystem and containerization technologies (Docker, Kubernetes).
• Must be eligible to obtain and maintain a US Top Secret security clearance.

Nice to Have

• Hands-on experience with data orchestration and transformation tools like Spark, PySpark, and dbt.
• Experience with Infrastructure as Code (e.g., Terraform, CloudFormation) for managing data resources.
• Knowledge of real-time data streaming technologies (e.g., Kafka, Flink, Pub/Sub).
• Experience implementing CI/CD pipelines for data applications (e.g., GitHub Actions, Jenkins).
• Familiarity with data visualization tools, such as Tableau.

What We Offer

• Comprehensive medical, dental, and vision plans at little to no cost.
• Generous time off with highly competitive PTO plans.
• Access to mental health resources 24/7, including therapy and life coaching.
• Annual reimbursement for professional development.
• Company-funded commuter benefits based on your region.
• Relocation assistance available depending on role eligibility.