Senior Data Engineer - Agribusiness Software Solutions

About the Role

We are seeking a Senior Data Engineer to join our team and contribute to our cutting-edge Agribusiness Software Solutions. As a Senior Data Engineer, you will play a pivotal role in managing the end-to-end data flow for our client's Data Analytics Platform (DAP). This is an exciting opportunity to work with advanced technologies and make a significant impact in the agricultural sector.

What You'll Do

• Build and maintain Azure Data Factory (ADF) pipelines to ingest XML/JSON data into Azure Data Lake Storage Gen2, ensuring schema mapping, cleansing, and incremental loads.
• Design and optimize data models in Azure SQL Managed Instance, focusing on indexes, partitioning, and read-only replicas for efficient reporting.
• Configure and test backup, geo-replication, and disaster recovery strategies, ensuring robust RPO/RTO.
• Automate infrastructure and deployments using Infrastructure-as-Code (IaC) and CI/CD pipelines to enhance efficiency.
• Provision and support datasets for self-service BI and reporting, empowering users with data access.
• Implement monitoring, alerting, and cost-optimization dashboards to maintain platform performance.
• Continuously tune platform performance, reliability, and cost efficiency, ensuring optimal operation.

Requirements

• 5+ years of experience designing and building data solutions on Microsoft Azure.
• 2+ years of hands-on experience with Azure Data Lake Storage Gen2 and Azure Data Factory (ADF v2).
• Expert-level T-SQL skills and performance tuning on Azure SQL Managed Instance or SQL Server.
• Hands-on experience with Infrastructure-as-Code (Bicep or Terraform) and CI/CD processes.
• Proven experience with backup, geo-replication, and disaster recovery in Azure environments.
• Strong understanding of Azure security fundamentals to ensure data protection.
• Experience with Azure Synapse Analytics is a plus.
• English proficiency at B1+ (Intermediate) or higher.

What We Offer

• Comprehensive global benefits package including technical and non-technical training for professional growth.
• Internal conferences and meetups to learn from industry experts.
• Support and mentorship from experienced employees to facilitate your professional development.
• Access to an internal startup incubator for innovative projects.
• Health insurance and wellness programs to promote a healthy lifestyle.
• Flexible work options including remote and hybrid opportunities.
• Referral program for bringing in new talent and work anniversary recognition with additional vacation days.