Talantix.io
NVIDIA•18.02.26
AI SCORE 9.2

Remote Distinguished Engineer - Apache Spark Acceleration

$320K–$489K/year
RemoteAI/Big Data
C++•Java•Scala•Apache Spark•CUDA•RAPIDS•Kubernetes•Hadoop YARN

About the Role

We are seeking a Remote Distinguished Engineer for the Apache Spark Acceleration group at NVIDIA. This role is pivotal in driving the architecture, design, and implementation of accelerated Apache Spark and related big-data frameworks. With the rise of GPU-accelerated data processing, your expertise will help enterprises leverage accelerated computing for large-scale data processing, significantly reducing costs and latency.

What You'll Do

  • Lead the architecture, design, and implementation of accelerated Apache Spark applications.
  • Engage with open source communities such as Apache Spark, RAPIDS, and Delta Lake for technical discussions and contributions.
  • Work with NVIDIA partners to deploy GPU-enabled data analytics solutions in public cloud or on-premises clusters.
  • Present technical solutions at industry conferences and meetups, showcasing your expertise in accelerated computing.
  • Collaborate with distributed systems teams to define solutions for large-scale distributed processing challenges.
  • Provide recommendations on infrastructure, continuous integration, and testing strategies.
  • Build, test, and optimize CUDA/C++ libraries across various platforms.
  • Mentor engineering team members, fostering growth and innovation.

Requirements

  • BS, MS, or PhD in Computer Science, Computer Engineering, or a closely related field (or equivalent experience).
  • 17+ years of work or research experience in software development.
  • Outstanding technical skills in designing and implementing high-quality distributed systems.
  • Excellent programming skills in C++, Java, and/or Scala.
  • 5+ years of experience with key open-source big-data projects, contributing to Apache Spark, Apache Hadoop, or similar.
  • Strong knowledge of distributed system schedulers such as Kubernetes and Hadoop YARN.
  • Able to quickly adapt to new areas and work collaboratively across teams and geographies.

Nice to Have

  • Experience in designing and developing columnar query engines.
  • Committership at major open-source projects like Apache Spark or Apache Flink.
  • Experience with acceleration libraries (CUDA, RAPIDS, UCX).

What We Offer

  • Competitive salary ranging from $320,000 to $488,750 based on experience and location.
  • Equity options to share in the company's success.
  • Comprehensive benefits package including health, wellness, and retirement plans.
  • Flexible remote work environment, allowing for a work-life balance.
  • Opportunities for professional development and continuous learning.
  • A diverse and inclusive workplace culture.
Why This Job9.2 of 10

This Remote Distinguished Engineer role at NVIDIA offers a unique opportunity to lead in the field of accelerated computing with a competitive salary and equity options.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

→

Expert in C++ and Java with a deep understanding of performance optimization techniques for big data frameworks, particularly in the context of GPU acceleration and Apache Spark.

→

Self-motivated and disciplined in a remote work environment, demonstrating strong time management skills and the ability to drive projects independently while effectively collaborating with distributed teams.

→

Proven experience in leading architecture and design discussions, with a mindset focused on innovation and a track record of implementing scalable solutions using technologies like CUDA, RAPIDS, and Kubernetes.

Learning Resources

→C++ Programming Languageguide
→Apache Spark with Scala - Hands On with Big Data!course
→Understanding Kubernetesarticle

Career Path

Remote Distinguished Engineer - Apache Spark Acceleration(Now)→Principal Engineer - Big Data Solutions(2-4 years)→Chief Technology Officer (CTO) - Data Engineering(5-8 years)

Market Overview

Market Size 2024
$7.2B
Annual Growth
8.5%
AI Adoption in C++
45%
Investment in C++ Technologies
+25%
Labour Demand for C++ Engineers
+15%
Avg Salary for Distinguished Engineer
$150K

Skills & Requirements

Required
C++JavaScala
Growing in Demand
PythonMachine LearningData Engineering
Declining
Objective-CVisual Basic

Domain Trends

Increased Adoption of GPU Acceleration
Over 60% of organizations are adopting GPU acceleration technologies like CUDA and RAPIDS to enhance data processing speeds in Apache Spark applications.
Rise of Cloud-Native Architectures
By 2025, 70% of enterprises will have migrated to cloud-native architectures, with Kubernetes becoming the leading orchestration tool for managing containerized applications.
Integration of AI in Big Data Processing
AI integration in big data processing is expected to grow by 30% in the next two years, with C++ and Scala being key languages for developing efficient AI-driven data processing frameworks.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.