Senior Data Engineer - Remote Opportunity

About the Role

We're hiring a Senior Data Engineer to join our innovative team at WorkGarden (formerly Astro Sirens). This Senior Data Engineer remote position offers you the chance to work with cutting-edge technologies like Databricks, Kafka, Spark, and Python libraries to build robust data pipelines and scalable infrastructure.

What You'll Do

• Design, implement, and maintain robust and scalable data pipelines using AWS, Azure, and containerization technologies.
• Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources into data warehouses and data lakes.
• Collaborate with data scientists, analysts, and other engineers to ensure seamless data flow and availability across the organization.
• Optimize data storage and retrieval performance by utilizing cloud services like AWS Redshift and Azure Synapse.
• Work with containerization tools like Docker and Kubernetes to ensure smooth deployment, scalability, and management of data pipelines.
• Monitor, troubleshoot, and optimize data processing pipelines for performance, reliability, and cost-efficiency.
• Automate manual data processing tasks and improve data quality by implementing data validation and monitoring systems.
• Implement and maintain CI/CD pipelines for data workflow automation and deployment.

Requirements

• Excellent communication skills, specifically fluent verbal English is mandatory to explain complex technical concepts to non-technical stakeholders.
• Proven experience as a Data Engineer, with hands-on experience building and managing data pipelines.
• Strong proficiency in cloud technologies, specifically AWS (e.g., S3, Redshift, Glue) and Azure (e.g., Data Lake, Azure Synapse).
• Experience working with containerization and orchestration tools such as Docker and Kubernetes.
• Proficient in data engineering programming languages, such as Python, Java, or Scala.
• Solid experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).
• Familiarity with data processing frameworks like Apache Spark, Apache Kafka, or similar tools.
• Strong understanding of ETL/ELT processes and best practices.

Nice to Have

• Experience with data governance and security best practices in cloud environments.
• Familiarity with infrastructure-as-code tools such as Terraform or CloudFormation.
• Knowledge of data visualization tools (e.g., Power BI, Tableau) is a plus.

What We Offer

• Competitive salary and flexible payment method.
• Opportunities for growth and professional development.
• Flexible working hours and full remote work opportunity.
• Work in a collaborative, innovative, and inclusive environment.
• Be a part of a data-driven culture that is at the forefront of innovation.