Staff Data Software Engineer - Remote Opportunity

About the Role

Join Lookout as a Staff Data Software Engineer in this exciting remote opportunity. As a key member of our Data Engineering team, you will contribute to the development and maintenance of our data engines, ETL pipelines, and analysis services. This role is pivotal in supporting our cloud-native security platform, which safeguards data across devices, apps, networks, and clouds. You will tackle some of the most interesting challenges in the industry, working closely with a talented team dedicated to quality and innovation.

What You'll Do

• Design and implement data pipeline orchestration for high-volume, low-latency distributed SaaS solutions.
• Create and maintain code repositories and large datasets for functional and performance testing.
• Develop and contribute to a robust test framework for our data pipelines.
• Debug test failures and triage production issues to ensure smooth operations.
• Collaborate with peer Data Engineers and other team members to understand complex systems and develop effective solutions.
• Participate in code reviews and contribute to the continuous improvement of our software development practices.
• Build automation tests that integrate into our CI/CD pipeline.
• Utilize tools such as Scala, Java, Python, and AWS services to enhance our data management capabilities.

Requirements

• 5-8+ years of experience in developing and maintaining large-scale, distributed production-class software on public cloud platforms, particularly AWS.
• Strong software engineering fundamentals, including Object-Oriented Design, data structures, and algorithms.
• Experience with data platforms, focusing on BI pipelines and cloud architecture tools such as S3, EMR, Glue, and Kafka.
• Rich experience in Big Data technologies and large-scale data platforms, especially Data Lake and Stream processing engines like Spark.
• Advanced SQL knowledge and experience with relational databases.
• Excellent written and verbal communication skills.
• Experience in ETL testing and knowledge of CI/CD tools like Jenkins is a plus.
• A BS degree in Computer Science or a related field, or equivalent work experience.

Nice to Have

• Familiarity with Docker and container orchestration.
• Experience in automation and performance tuning of Spark workloads.

What We Offer

• Competitive salary range of $130,000 - $160,000 CAD.
• Bonus and equity opportunities.
• Comprehensive benefits package.
• Flexible remote work environment.
• Opportunities for professional growth and development.
• Work with cutting-edge technologies in a dynamic team.
• Engage in meaningful work that impacts data security for millions of users.