About the Role
We are excited to announce a Senior Data Engineer remote position at Nearform, a leading independent team of data and AI experts. This is a permanent full-time opportunity for candidates based in Ireland. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining scalable data platforms and pipelines that drive our AI-enabled solutions.
What You'll Do
- Design, build, and optimize data pipelines and ETL processes for large-scale data ingestion and transformation.
- Develop and maintain data platforms and warehousing solutions to support analytics and business intelligence needs.
- Implement scalable data storage solutions ensuring high availability and performance.
- Enhance performance in data processing workflows for maximum speed and scalability.
- Collaborate with data scientists, analysts, and stakeholders to translate business needs into effective data engineering solutions.
- Ensure data quality, governance, and compliance across all systems.
- Support CI/CD processes for data pipeline deployments and implement best practices in DevOps for data workflows.
- Conduct code reviews and enforce best practices in version control, automation, and testing.
Requirements
- Significant experience delivering at a Senior Engineer level, specializing in Data Engineering, typically with at least 6 years of commercial experience.
- Practical experience in an agile environment.
- Extensive hands-on experience in Databricks, SQL, Python, and Spark for large-scale data processing.
- Strong expertise in data warehousing technologies (e.g., Snowflake, Redshift, BigQuery, or similar).
- Experience with distributed data processing frameworks (Spark, Hadoop, or similar).
- Deep understanding of ETL processes, data modeling, and schema design.
- Experience with cloud-based data solutions (AWS, Azure, GCP) and data lake architectures.
- Experience with automation, CI/CD for data pipelines, and Infrastructure as Code (IaC).
Nice to Have
- Experience with version control tools such as Git.
- Experience building software collaboratively.
What We Offer
- Competitive salary range of $120,000 to $140,000 per year.
- Fully remote work environment with flexible hours.
- Opportunity to work with leading enterprises and cutting-edge technologies.
- Collaborative and inclusive company culture.
- Continuous learning and professional development opportunities.
This Senior Data Engineer position at Nearform offers a unique opportunity to work remotely while engaging with cutting-edge data technologies and top-tier clients.
Generating success profile...
Analyzing job requirements and market data
Loading market overview...
Analyzing market trends and skill demands
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months