Azure Data Engineer - Remote

About the Role

We are seeking an experienced Azure Data Engineer to join our team remotely. In this role, you will be responsible for designing and optimizing data pipelines using Azure tools to deliver impactful data solutions that drive business success. As an Azure Data Engineer, you will collaborate with cross-functional teams to transform complex data into valuable insights.

What You'll Do

• Design and implement data storage solutions on Azure, selecting appropriate Azure data storage services and optimizing schemas for specific use cases.
• Build and maintain data pipelines for data integration and processing, ensuring scalability and efficiency using Azure Data Factory and Azure Databricks.
• Ensure data quality and accuracy through rigorous testing and validation at various stages of the data pipeline.
• Optimize data processing performance by tuning pipelines and monitoring for bottlenecks.
• Develop and maintain data models and schemas, applying best practices in data modeling.
• Collaborate with other teams to provide necessary data for analytics and reporting.
• Ensure compliance with data security and privacy regulations, including GDPR.
• Work with large datasets, performing data analysis to derive insights.

Requirements

• Proven experience in Python programming for data engineering and analytics.
• Strong proficiency in SQL, particularly Microsoft T-SQL.
• Hands-on experience with Azure data storage solutions.
• Practical knowledge of data integration frameworks, specifically Azure Databricks and Azure Data Factory.
• Solid understanding of data modeling concepts and schema design best practices.
• Strong analytical and problem-solving skills with attention to detail.
• Effective communication skills and ability to work collaboratively in cross-functional teams.

Nice to Have

• Experience with Azure Synapse and Data Lake technologies.
• Familiarity with Azure DevOps for end-to-end development and delivery.
• Knowledge of data processing algorithms and performance optimization techniques.

What We Offer

• A fully remote and flexible working setup.
• 25 days of annual leave, increasing by 1 day each year of service up to a maximum of 30 days (plus Bank Holidays).
• 1 Privilege Day.
• 4x annual salary Life Assurance.
• Market-leading pension scheme through Legal & General.
• Enhanced family-friendly policies.
• Excellent learning, training, and career development opportunities.
• 24/7 access to our Employee Assistance Programme.

Join us as an Azure Data Engineer and contribute to our mission of empowering the agriculture sector with data-driven solutions. Apply now!