Crypto.com15.02.26
AI SCORE 8.5

Senior DataOps Engineer - Remote Position at Crypto.com

$120K–$150K/year

About the Role

We are seeking a Senior DataOps Engineer to join our dynamic team at Crypto.com. This Senior DataOps Engineer remote position offers an exciting opportunity to design, develop, maintain, and improve software for various projects adjacent to our core businesses. You will play a crucial role in the design of various components behind scalable applications, from frontend UI to backend infrastructure.

What You'll Do

  • Manage daily operations of big data platforms such as Hadoop, Spark, Flink, and Clickhouse to ensure system stability and data security.
  • Operate and administer Linux systems, utilizing scripting skills in Shell, Python, or similar languages.
  • Maintain and operate big data components on cloud platforms (AWS/GCP/Azure), with hands-on experience in container technologies like Kubernetes and Docker.
  • Build and maintain monitoring systems to track platform performance, optimize configurations, and troubleshoot performance issues using tools such as Datadog, Prometheus, Grafana, and Zabbix.
  • Deploy, upgrade, and scale core big data components including Flink, Kafka, Spark, Impala, Clickhouse, and Kudu.
  • Write and maintain technical documentation for operations, supporting platform solution design and upgrades.
  • Explore and adopt new technologies to optimize operation processes and provide technical guidance to enhance client team capabilities.

Requirements

  • Proven experience in big data platform operations, preferably with familiarity in CDH/CDP/HDP or similar Hadoop distributions.
  • Strong proficiency in Linux administration and scripting (Shell, Python, or equivalent).
  • Experience with major cloud platforms (AWS/GCP/Azure) and containerized environments (Kubernetes, Docker).
  • In-depth knowledge of big data components and performance tuning, capable of independently resolving stability and scalability issues.
  • Excellent technical writing and communication skills to support documentation and solution delivery.
  • Self-motivated with a passion for new technologies, applying innovative approaches to optimize operations and drive efficiency.

Nice to Have

  • Experience in the development of n8n workflow.

What We Offer

  • Competitive salary with attractive annual leave entitlements including birthday and work anniversary.
  • Flexibility in work hours and hybrid or remote setup.
  • Opportunities for personal and professional growth through our internal mobility program.
  • Crypto.com Visa card provided upon joining.
  • A supportive and inclusive work culture where employees are empowered to think big and innovate.

Are you ready to kickstart your future with us? Join our team as a Senior DataOps Engineer remote and help us shape the future of cryptocurrency!

Language Requirements
EnglishC1
BasicIntermediateAdvancedNative
Why This Job8.5 of 10

This Senior DataOps Engineer remote position at Crypto.com offers a competitive salary and the chance to work with cutting-edge technologies in a dynamic environment. Join a supportive team and enjoy flexible work arrangements.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

Proficient in using Hadoop and Spark for big data processing and analytics, demonstrating an ability to optimize data workflows and pipelines in a cloud environment.

Strong experience with container orchestration using Kubernetes and Docker, showcasing a hands-on approach to deploying and managing scalable applications in a remote work setting.

An analytical mindset with a focus on continuous integration and deployment (CI/CD) practices, ensuring that Python-based data applications are reliable and maintainable in a fast-paced tech environment.

Learning Resources

Getting Started with Hadoopguide

Career Path

Senior DataOps Engineer(Now)Lead DataOps Engineer(1-2 years)Director of Data Engineering(3-5 years)

Market Overview

Hadoop Market Size 2024
$8.5B
Annual Growth
12.3%
AI Adoption in DataOps
45%
Investment in DataOps Tools
+35%
Labour Demand for DataOps Engineers
+20%
Avg Salary for Senior DataOps Engineer
$145K

Skills & Requirements

Required
HadoopSparkFlink
Growing in Demand
Apache KafkaData LakesMachine Learning Integration
Declining
Traditional ETL ToolsHadoop 1.x

Domain Trends

Rise of Real-Time Data Processing
The demand for real-time data processing solutions is growing, with a projected increase of 30% in adoption rates by 2025.
Shift Towards Cloud-Native DataOps
By 2024, 70% of organizations are expected to adopt cloud-native DataOps solutions, driven by the need for scalability and flexibility.
Integration of AI in DataOps
AI-driven automation in DataOps is expected to reduce operational costs by 25% while improving data accuracy and processing speed.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.