Senior Data Engineer - Apache Airflow & Kubernetes Remote
About the Role
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. This Senior Data Engineer remote position focuses on utilizing your expertise in Apache Airflow, DBT Core, and Kubernetes to build and optimize scalable data pipelines. You will play a critical role in supporting financial and accounting platforms while ensuring high availability and fault tolerance.
What You'll Do
- Design, develop, and maintain complex Airflow DAGs for both batch and event-driven data pipelines.
- Implement best practices for DAG performance, including dependency management, retries, and SLA monitoring.
- Lead the implementation of dbt Core, ensuring robust project structure and CI/CD integration.
- Deploy and manage data workloads on Kubernetes and OpenShift platforms.
- Monitor and tune end-to-end pipeline performance across Airflow, dbt, and data platforms.
Requirements
- 8-10+ years of hands-on experience in enterprise data engineering.
- Deep expertise in Apache Airflow DAG development and dbt Core modeling.
- Experience with cloud-native container platforms, specifically Kubernetes and OpenShift.
- Strong understanding of performance tuning and distributed workload management.
- Proven ability to troubleshoot container-level performance issues.
Nice to Have
- Experience with financial reporting and regulatory data use cases.
- Familiarity with observability solutions for proactive issue detection.
- Knowledge of data engineering standards and security best practices.
What We Offer
- Competitive salary range of $70,000 to $85,000 per year.
- Comprehensive medical, dental, and vision benefits for employees working 20+ hours per week.
- 401K Retirement Savings Plan with direct deposit and weekly payroll.
- Access to certification and training opportunities to enhance your skills.
- Join a vast network of opportunities through Yoh’s extensive talent community.
This Senior Data Engineer role offers a unique opportunity to work remotely while leveraging advanced technologies like Apache Airflow and Kubernetes. With a competitive salary and comprehensive benefits, it's an attractive position for experienced professionals.
Generating success profile...
Analyzing job requirements and market data
Loading market overview...
Analyzing market trends and skill demands
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months