Astronomer01.03.26
AI SCORE 8.5

Staff Software Engineer - Observability for DataOps Platform

$215K–$250K/year

About the Role

We're hiring a Staff Software Engineer - Observability to join our team at Astronomer. In this remote role, you'll be at the forefront of our mission to empower data teams by enhancing our observability platform, which is critical for delivering insights and reliability in data operations.

What You'll Do

  • Lead the end-to-end architecture and evolution of major platform components, making foundational design decisions that will shape the long-term direction of the observability platform.
  • Build scalable, reliable, and performant features that provide visibility into customer data pipelines.
  • Collaborate closely with product, design, and engineering teams to define and deliver high-impact initiatives.
  • Write high-quality, maintainable code while following best practices in testing, CI/CD, and operational excellence.
  • Set and champion engineering standards for code quality, testing, design, and operational excellence across the team.
  • Help improve and evolve the observability platform’s tooling, infrastructure, and processes.
  • Lead and coordinate responses to complex production incidents, guiding the team towards rapid resolution and long-term improvements.
  • Proactively identify technical opportunities, risks, and gaps - and drive initiatives to address them.
  • Mentor engineers of all levels through design reviews, pairing, and feedback, contributing to the professional growth of the team.

Requirements

  • Strong technical experience building complex distributed systems, preferably with Golang, Python, Kubernetes, SQL/OLAP databases, and stream processing.
  • Hands-on experience designing, developing, and scaling production infrastructure.
  • Excellent collaboration and communication skills to work effectively across teams.
  • Focus on delivering customer value through thoughtful technical solutions.
  • Enthusiasm for contributing to a healthy, inclusive engineering culture and supporting the growth of teammates.
  • Comfort working in areas of high ambiguity, able to break down open-ended problems and drive them to completion with clarity and structure.

Nice to Have

  • Experience building or scaling data observability products.
  • Familiarity with Apache Airflow or similar workflow orchestrators.
  • Background in observability, monitoring, or infrastructure at scale (e.g., Datadog, Honeycomb, or similar).

What We Offer

  • Competitive salary range of $215,000 - $250,000, based on skills and experience.
  • Equity component as part of the compensation package.
  • Comprehensive benefits package including health, wellness, and professional development opportunities.
  • Remote work flexibility, allowing you to work from anywhere in the United States.
  • A diverse and inclusive work environment that values your unique perspectives.
Why This Job8.5 of 10

This Staff Software Engineer role at Astronomer offers a unique opportunity to lead the development of a cutting-edge observability platform in a fully remote setting.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

Proficient in Golang and Python, with a strong ability to design and implement observability features in complex data pipelines, ensuring the reliability and performance of the DataOps platform.

A self-motivated engineer with experience in remote work environments, demonstrating strong time management skills and the ability to collaborate effectively across time zones while leading architectural discussions.

Deep understanding of Kubernetes and CI/CD practices, combined with a mindset focused on continuous improvement and the ability to troubleshoot and optimize data pipelines using tools like Apache Airflow and SQL.

Learning Resources

Golang for Beginnerscourse

Career Path

Staff Software Engineer - Observability for DataOps Platform(Now)Lead Software Engineer - Data Engineering(1-2 years)Engineering Manager - Data Infrastructure(3-5 years)

Market Overview

Market Size 2024
$1.2B
Annual Growth
25.4%
AI Adoption
40%
Investment
+60%
Labour Demand
+35%
Avg Salary
$145K

Skills & Requirements

Required
GolangPythonKubernetes
Growing in Demand
KubernetesApache KafkaMicroservices Architecture
Declining
Java EEHadoop MapReduce

Domain Trends

Rise of Cloud-Native Observability Tools
The demand for cloud-native observability tools is expected to increase by 30% by 2025, driven by the need for real-time data insights in DataOps.
Integration of AI in Data Pipelines
Over 50% of organizations are expected to integrate AI into their data pipelines by 2025, enhancing predictive analytics and automation capabilities.
Shift Towards Serverless Architectures
Adoption of serverless architectures is projected to grow by 40% as companies seek to reduce operational costs and improve scalability in their DataOps platforms.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.