Mid-Senior Data Developer - Remote Position
About the Role
We are seeking a talented Mid-Senior Data Developer to join our team remotely. As a Mid-Senior Data Developer, you will play a crucial role in modernizing our data architecture by migrating our on-premise Data Warehouses to a cloud-based Data Lakehouse architecture using Microsoft Azure. This position offers the opportunity to work with cutting-edge technologies and be part of a dynamic team that values innovation and collaboration.
What You'll Do
- Design and implement complex and scalable data architectures using Python/PySpark and SQL, ensuring high availability and low operational costs.
- Define modeling standards (Medallion Architecture) for the Lakehouse, ensuring structures like Star Schema and One Big Tables (OBTs) meet both technical performance and business needs.
- Establish and promote CI/CD practices, automated data quality testing, and proactive monitoring of costs and performance in the Databricks/Azure environment.
- Act as the focal point for resolving complex issues, mentoring less experienced professionals, and positively influencing the engineering culture of the team.
- Collaborate with stakeholders to transform ambiguous business requirements into robust data models (Facts, Dimensions, and abstraction layers).
Requirements
- Deep expertise in Databricks (Delta Lake, Unity Catalog, Workflows/Jobs, and Pipelines) and orchestrators like Azure Data Factory or Airflow.
- Experience in query optimization, Spark tuning, and handling large volumes of data.
- Proven ability to navigate high uncertainty environments, refining processes and translating executive needs into tangible technical solutions.
- Familiarity with development best practices (GitFlow, clean code, modularization, and design patterns).
- Strong communication skills and the ability to work collaboratively in a remote team environment.
Nice to Have
- Experience with data governance and compliance standards.
- Knowledge of machine learning concepts and their application in data engineering.
- Familiarity with agile methodologies.
What We Offer
- Health and dental insurance.
- Meal and food vouchers.
- Childcare assistance.
- Extended parental leave.
- Partnerships with gyms and wellness professionals via Wellhub (Gympass) and TotalPass.
- Profit-sharing program.
- Life insurance.
- Continuous learning platform (CI&T University).
- Discount club.
- Free online platform dedicated to promoting physical, mental health, and well-being.
This Mid-Senior Data Developer role at CI&T offers a unique opportunity to work remotely on innovative data solutions while enjoying competitive benefits.
Who Will Succeed Here
Proficiency in Python and PySpark to efficiently manipulate and analyze large datasets, with a focus on building scalable data processing pipelines using Azure Data Factory and Airflow.
Self-motivated and disciplined to thrive in a fully remote work environment, demonstrating strong time management skills and the ability to collaborate effectively with cross-functional teams via virtual platforms.
Strong understanding of data modeling principles and experience with cloud-based architectures, specifically in transitioning from on-premise solutions to Azure Data Lakehouse, showcasing a mindset geared towards continuous learning and adaptation to new technologies.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months