Senior Databricks Administrator - Remote Position

About the Role

We are looking for a Senior Databricks Administrator to join our team in a fully remote capacity. In this role, you will manage, optimize, and secure our Databricks environment within the Azure ecosystem. As a Senior Databricks Administrator remote, you will play a crucial role in ensuring the performance and reliability of our data platform.

What You'll Do

• Administer and manage the Databricks platform on Azure, including workspace configuration and cluster lifecycle management.
• Monitor system performance, troubleshoot issues, and ensure high availability and reliability of the platform.
• Implement and manage access controls, RBAC, and data security policies.
• Optimize cluster performance and cost through effective configuration and auto-scaling strategies.
• Manage Databricks jobs, workflows, and scheduling.
• Integrate Databricks with other Azure services such as Data Lake, Azure Data Factory, and Synapse Analytics.
• Maintain and enforce data governance and compliance standards.
• Automate infrastructure provisioning using tools like Terraform or ARM templates.
• Collaborate with data engineers, architects, and DevOps teams to support data pipelines and analytics workloads.
• Perform upgrades, patching, and environment maintenance activities.
• Create and maintain documentation for configurations, processes, and best practices.

Requirements

• 5+ years of experience in data platform or cloud administration.
• Strong hands-on experience with Databricks Administration.
• Solid experience with Microsoft Azure (Azure Data Lake Storage, Azure Data Factory, Azure Synapse, etc.).
• Experience in cluster configuration, performance tuning, and cost optimization.
• Knowledge of security best practices, including identity management and data protection.
• Experience with CI/CD pipelines and infrastructure as code (Terraform preferred).
• Proficiency in Python, SQL, or Scala (for troubleshooting and support).
• Familiarity with monitoring and logging tools.
• Strong problem-solving and analytical skills.

Nice to Have

• Experience with big data technologies.
• Knowledge of machine learning frameworks.
• Familiarity with data governance tools.

What We Offer

• Competitive salary in the range of $120,000 - $150,000 per year.
• Comprehensive relocation support for candidates moving to Canada.
• Flexible remote work arrangements.
• Opportunities for professional development and training.
• Health and wellness benefits.
• Collaborative and innovative work environment.