Talantix.io
Programmers.io•11.02.26
AI SCORE 8.5

Senior Databricks Architect - Remote Opportunity

$140K–$180K/year
RemoteData Engineering & ArchitectureRelocation
Databricks•PySpark•Spark SQL•Delta Lake•Unity Catalog•AWS•ETL•Data Warehousing

About the Role

We are seeking a highly skilled Senior Databricks Architect to join our team remotely. In this role, you will lead a large-scale Oracle-to-Databricks migration, covering schema migration, code conversion, and ODI job modernization. This is a fantastic opportunity for a seasoned professional to make a significant impact in a dynamic environment.

What You'll Do

  • Architect, design, and implement cloud-native data platforms using Databricks (ingestion → transformation → consumption).
  • Lead the full Oracle → Databricks migration including schema translation, ETL/ELT logic modernization, and ODI job replacement.
  • Develop reusable PySpark frameworks, data processing patterns, and orchestration using Databricks Workflows.
  • Build scalable, secure, and cost-optimized Databricks infrastructure and data pipelines.
  • Collaborate with business and technical stakeholders to drive data modernization strategy.
  • Establish development best practices, coding standards, CI/CD, and DevOps/DataOps patterns.
  • Provide technical mentorship and create training plans for engineering teams.
  • Contribute to building MLOps and advanced operations frameworks.

Requirements

  • 14+ years in Data Engineering/Architecture with at least 4+ years hands-on Databricks experience delivering end-to-end cloud data solutions.
  • Strong experience migrating from Oracle/on-prem systems to Databricks, including SQL, PL/SQL, ETL logic, and ODI pipelines.
  • Deep hands-on expertise in PySpark, Spark SQL, Delta Lake, Unity Catalog.
  • Building reusable data frameworks and designing high-performance batch and streaming pipelines.
  • Proven experience with greenfield Databricks implementations.
  • Strong understanding of cloud-native architectures on AWS and modern data platform concepts.
  • Solid knowledge of data warehousing, columnar databases, and performance optimization.
  • Good understanding of Agile/Scrum development processes.

Nice to Have

  • Experience designing Data Products, Data Mesh architectures, Data Vault or enterprise data governance models.
  • Good understanding of GoldenGate.

What We Offer

  • Competitive salary ranging from $140,000 to $180,000 per year.
  • Comprehensive relocation support for candidates willing to move.
  • Opportunities for professional growth and development.
  • Flexible remote work environment.
  • Access to cutting-edge technologies and tools.
Why This Job8.5 of 10

This Senior Databricks Architect position offers a unique opportunity to lead significant data migrations while working remotely. With a competitive salary and relocation support, it's an attractive role for seasoned professionals.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

About Programmers.io

Explore Programmers.io careers in 2026 and unlock exciting job opportunities. Browse a diverse range of remote, hybrid, and office roles tailored for tech enthusiasts. Utilize advanced filters to find your ideal position and benefit from application tracking and company insights to enhance your job search experience. Join us at Programmers.io and take the next step in your career today!

Industry
Tech
Location
Remote

Who Will Succeed Here

→

In-depth expertise in Databricks architecture, including hands-on experience with PySpark, Spark SQL, and Delta Lake, enabling efficient data processing and management.

→

Strong problem-solving mindset with the ability to navigate complex ETL processes and optimize data workflows in a remote setting, ensuring timely delivery of migration projects.

→

Proven experience in cloud environments, particularly with AWS, showcasing a deep understanding of cloud-native data solutions and best practices for data warehousing.

Learning Resources

→Databricks Academycourse
→Getting Started with PySpark on Databricksguide
→Delta Lake Documentationarticle

Career Path

Senior Databricks Architect(Now)→Lead Data Engineer or Data Platform Architect(1-2 years)→Chief Data Officer or Director of Data Engineering(3-5 years)

Market Overview

Market Size 2024
$5.2B
Annual Growth
40.5%
AI Adoption
67%
Investment
+150%
Labour Demand
+35%
Avg Salary
$145K

Skills & Requirements

Required
DatabricksPySparkSpark SQL
Growing in Demand
Apache KafkaMachine LearningDataOps
Declining
Hadoop MapReduceTraditional ETL Tools

Domain Trends

Increased Adoption of Lakehouse Architecture
Organizations are increasingly adopting lakehouse architecture, with 75% of enterprises planning to implement it by 2025, allowing for better management of both structured and unstructured data.
Integration of AI and ML in Data Processing
Over 60% of organizations are integrating AI and ML tools into their data processing workflows, enhancing predictive analytics and decision-making capabilities.
Shift to Serverless Data Solutions
The serverless data architecture market is projected to grow by 50% annually, with Databricks leading the way in providing scalable, cost-effective solutions for data warehousing.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.