Senior Cloud Engineer - Apache Spark, GCP, Python, Microservices

About the Role

We are seeking a Senior Cloud Engineer to join our team remotely. As a Senior Cloud Engineer, you will play a crucial role in supporting the Model Risk & Finance platform in a hybrid cloud environment, primarily utilizing Apache Spark, Google Cloud Platform (GCP), and Python. This position is ideal for someone with a strong background in backend development and distributed data processing.

What You'll Do

• Build, support, and enhance distributed data platforms and backend systems.
• Develop APIs, workflows, and platform components using Python.
• Work on large-scale Spark/PySpark data processing systems.
• Support and optimize Kubernetes/OpenShift-based environments.
• Contribute to CI/CD pipelines and platform automation.
• Debug, troubleshoot, and optimize distributed systems at scale.
• Support ongoing platform enhancements post cloud migration.

Requirements

• Strong experience with Apache Spark and PySpark.
• Hands-on experience with Google Cloud Platform (GCP).
• Proficiency in Kubernetes/OpenShift.
• Experience in Python development, particularly with Django and APIs.
• Experience with CI/CD tools such as GitHub Actions, Helm, and Harness.

Nice to Have

• Experience with AI/LLM integration and GPU or platform-level AI exposure.
• Experience with Hadoop migration.

What We Offer

• Competitive salary based on experience.
• Visa sponsorship available for qualified candidates.
• Opportunity to work in a collaborative environment with teams in the US and India.
• Engaging projects that focus on cloud migration and optimization.
• Flexible working arrangements with a hybrid work model.