Data Engineer - Remote Position at Visa
About the Role
We are looking for a Data Engineer to join our dynamic team at Visa. As a Data Engineer remote, you will play a crucial role in building and managing data pipelines that drive analytical insights for our clients. This position is ideal for those who are passionate about data and eager to contribute to innovative data solutions.
What You'll Do
- Build and manage large-scale ETL processes to generate card-level aggregated attributes.
- Develop modular and reusable code while ensuring configurability and scalability.
- Perform thorough unit testing of each development task and document the results.
- Build, schedule, and manage Directed Acyclic Graphs (DAGs) in Apache Airflow efficiently.
- Monitor data processing tasks in the data pipelines and ensure quality control of data assets.
- Utilize strong data analytics skills to identify and resolve data issues promptly.
- Collaborate with stakeholders to understand requirements and provide clarifications.
- Participate in agile ceremonies and maintain a detail-oriented approach in daily tasks.
Requirements
- 6 months to 2 years of experience in building data pipelines and writing ETL/ELT code using Hive, PySpark, SQL, and Unix.
- Experience in writing and optimizing SQL queries in a Big Data environment.
- Familiarity with Linux/Unix environments and command line utilities.
- Proven track record in supporting production software/systems.
- Preferred experience with visualization tools like Tableau, Power BI, and D3.
- Strong communication skills and ability to understand business requirements.
- Good understanding of agile working practices.
- Ability to interact with cross-functional teams at varying levels.
Nice to Have
- Experience with code version control systems (git).
- Familiarity with data governance and data privacy principles.
- Knowledge of data warehousing concepts.
What We Offer
- Competitive salary and benefits package.
- Flexible remote work options.
- Opportunities for professional development and growth.
- Collaborative and innovative work environment.
- Access to cutting-edge technologies and tools.
This Data Engineer remote position at Visa offers a unique opportunity to work with innovative data solutions in a collaborative environment. Enjoy competitive pay and flexible work options.
Who Will Succeed Here
Proficiency in Hive and PySpark for building ETL processes, with an analytical mindset to optimize data pipelines for performance and reliability.
Adaptable and self-motivated in a remote work environment, able to independently troubleshoot issues and collaborate effectively with cross-functional teams using tools like Slack and Zoom.
Strong foundation in SQL and Unix, with a willingness to learn and implement Apache Airflow for orchestrating complex workflows and managing data pipelines.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months