Senior DataOps Engineer - Remote Position at Crypto.com
About the Role
We are seeking a Senior DataOps Engineer to join our dynamic team at Crypto.com. This Senior DataOps Engineer remote position offers an exciting opportunity to design, develop, maintain, and improve software for various projects adjacent to our core businesses. You will play a crucial role in the design of various components behind scalable applications, from frontend UI to backend infrastructure.
What You'll Do
- Manage daily operations of big data platforms such as Hadoop, Spark, Flink, and Clickhouse to ensure system stability and data security.
- Operate and administer Linux systems, utilizing scripting skills in Shell, Python, or similar languages.
- Maintain and operate big data components on cloud platforms (AWS/GCP/Azure), with hands-on experience in container technologies like Kubernetes and Docker.
- Build and maintain monitoring systems to track platform performance, optimize configurations, and troubleshoot performance issues using tools such as Datadog, Prometheus, Grafana, and Zabbix.
- Deploy, upgrade, and scale core big data components including Flink, Kafka, Spark, Impala, Clickhouse, and Kudu.
- Write and maintain technical documentation for operations, supporting platform solution design and upgrades.
- Explore and adopt new technologies to optimize operation processes and provide technical guidance to enhance client team capabilities.
Requirements
- Proven experience in big data platform operations, preferably with familiarity in CDH/CDP/HDP or similar Hadoop distributions.
- Strong proficiency in Linux administration and scripting (Shell, Python, or equivalent).
- Experience with major cloud platforms (AWS/GCP/Azure) and containerized environments (Kubernetes, Docker).
- In-depth knowledge of big data components and performance tuning, capable of independently resolving stability and scalability issues.
- Excellent technical writing and communication skills to support documentation and solution delivery.
- Self-motivated with a passion for new technologies, applying innovative approaches to optimize operations and drive efficiency.
Nice to Have
- Experience in the development of n8n workflow.
What We Offer
- Competitive salary with attractive annual leave entitlements including birthday and work anniversary.
- Flexibility in work hours and hybrid or remote setup.
- Opportunities for personal and professional growth through our internal mobility program.
- Crypto.com Visa card provided upon joining.
- A supportive and inclusive work culture where employees are empowered to think big and innovate.
Are you ready to kickstart your future with us? Join our team as a Senior DataOps Engineer remote and help us shape the future of cryptocurrency!
This Senior DataOps Engineer remote position at Crypto.com offers a competitive salary and the chance to work with cutting-edge technologies in a dynamic environment. Join a supportive team and enjoy flexible work arrangements.
Who Will Succeed Here
Proficient in using Hadoop and Spark for big data processing and analytics, demonstrating an ability to optimize data workflows and pipelines in a cloud environment.
Strong experience with container orchestration using Kubernetes and Docker, showcasing a hands-on approach to deploying and managing scalable applications in a remote work setting.
An analytical mindset with a focus on continuous integration and deployment (CI/CD) practices, ensuring that Python-based data applications are reliable and maintainable in a fast-paced tech environment.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months