Senior Data Engineer - Remote Position

About the Role

We are seeking a Senior Data Engineer remote to join our dynamic team at CORMAC. In this role, you will be instrumental in managing and optimizing our data for powerful analytics and reporting. You will play a key role in building and maintaining scalable data processing pipelines while ensuring data integrity, security, and accessibility for business-critical applications.

What You'll Do

• Develop and maintain data processing applications using Apache Spark and Scala to process large-scale datasets efficiently.
• Monitor and optimize database performance, including indexing, query optimization, and load balancing, to ensure high availability and low-latency data access.
• Design and implement robust, scalable, and efficient database structures to support applications and data analytics.
• Deploy and manage data infrastructure on AWS.
• Assist in the migration of data between systems, including database upgrades, platform changes, and ETL processes for data integration.
• Leverage cloud-native services for data processing and storage.
• Optimize costs while maintaining performance and scalability.
• Apply various transformations like data cleansing, aggregation, and enrichment.
• Monitor data quality metrics and perform data cleansing as necessary.
• Collaborate with Product Owners and Business Analysts to refine user stories for data ingestion, processing, and reporting features.

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or a related field.
• 3+ years of experience as a Data Engineer or in a similar role.
• 2+ years of experience working with Apache Spark, Scala, and Spark SQL.
• Ability to obtain a Public Trust (Tier 1) Security Clearance.
• Experience with cloud platforms such as AWS, Google Cloud, or Azure, utilizing cloud services for data storage, processing, and retrieval.
• Knowledge of data warehousing, data lakes, and cloud computing.
• Familiarity with machine learning algorithms.
• Knowledge of ETL processes and data modeling techniques.
• Familiarity with ETL tools, REST APIs, and data integration techniques.
• Understanding of data security and compliance best practices.
• Ability to develop clear, efficient, scalable solutions for complex problems.
• Understanding of data warehousing solutions and database architecture principles.
• Effective communication and teamwork abilities.
• Strong problem-solving skills and attention to detail.

Nice to Have

• Experience using Airflow, DBT, Postgres, Databricks, Amazon EMR & RDS.
• Working experience on an Agile/Scrum or SAFe development team.

What We Offer

• Flexible work schedules with remote, hybrid, or fully in-person workplace options.
• A supportive, collaborative, and welcoming environment.
• Opportunities for professional development and growth.
• Work on impactful projects in the public healthcare sector.
• A diverse workforce that fosters creativity, collaboration, and innovation.