Talantix.io
Braintrust•10.03.26
AI SCORE 8.5

Senior Software Engineer (Scala/​Spark) - Remote

$140K–$180K/year
RemoteAI/Big Data
Scala•Spark•Airflow•Python•Machine Learning•Data Analysis•Debugging•Continuous Deployment

About the Role

We're hiring a Senior Software Engineer (Scala/Spark) to join our dynamic Ads Marketplace team. In this remote role, you will leverage your expertise in Scala and Spark to develop algorithmic solutions that enhance Etsy's on-site advertising platform. Your contributions will directly impact how sellers grow their businesses through innovative technology.

What You'll Do

  • Develop and productionize systems that utilize machine learning and algorithmic design for real-time bidding and budget pacing.
  • Work on Spark jobs and Airflow DAG pipelines that power our production bidding and pacing systems.
  • Introduce critical refactors and author new DAGs to support the experimentation cycle.
  • Collaborate with cross-functional teams to ensure the success of your projects.
  • Measure and test your work, taking advantage of our pioneering continuous deployment system.

Requirements

  • 5+ years of production experience with Scala and Spark.
  • Strong debugging skills and a proactive approach to problem-solving.
  • Excellent communication skills and a willingness to support your team’s success.
  • A sense of self-direction and the ability to learn quickly.

Nice to Have

  • Proficiency in Airflow and Python.
  • Knowledge of ads, forecasting, or marketplace domains.
  • Experience in data analysis with a focus on data quality and testing.
  • Familiarity with observability and alerting practices.

What We Offer

  • Competitive salary between $140,000 and $180,000 annually.
  • Fully remote work environment with flexible hours.
  • Opportunities for professional growth and development.
  • A supportive and collaborative team culture.
  • Access to cutting-edge technologies and tools.
Language Requirements
EnglishC1
BasicIntermediateAdvancedNative
Why This Job8.5 of 10

This Senior Software Engineer role offers a unique opportunity to work remotely on innovative projects at Etsy. With a competitive salary and a supportive culture, it's an excellent fit for experienced Scala and Spark developers.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

→

Proficient in Scala and Spark, with hands-on experience in building scalable data processing pipelines, especially in a cloud environment like AWS or GCP.

→

Strong understanding of machine learning algorithms and their practical applications, particularly in optimizing advertising solutions and user engagement metrics.

→

Experience with Airflow for orchestrating data workflows, coupled with a debugging mindset to troubleshoot complex data issues in a remote work environment.

Learning Resources

→Scala Documentationguide
→Spark: The Definitive Guidebook
→Machine Learning with PySpark on Courseracourse

Career Path

Senior Software Engineer (Scala/Spark)(Now)→Lead Software Engineer(1-2 years)→Engineering Manager(3-5 years)

Market Overview

Market Size 2024
$9.2B
Annual Growth
22.5%
AI Adoption
45%
Investment
+150%
Labour Demand
+30%
Avg Salary
$130K

Skills & Requirements

Required
ScalaSparkAirflow
Growing in Demand
Apache KafkaKubernetesData Engineering
Declining
Java 8Hadoop MapReduce

Domain Trends

Rise of Real-time Data Processing
The demand for real-time data processing solutions is increasing, with a projected growth of 30% in the next two years as companies seek to enhance decision-making capabilities.
Integration of Machine Learning with Big Data
Over 50% of organizations are now integrating machine learning algorithms with big data platforms, indicating a significant shift towards advanced analytics in data processing.
Shift to Cloud-native Architectures
By 2025, 70% of applications in the Scala ecosystem are expected to be cloud-native, driven by the need for scalability and flexibility in software deployment.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.