Software Engineer - Web Scraping (Remote)

About the Role

Are you a talented Software Engineer with web scraping experience looking for a remote opportunity? Join one of the most prestigious buy-side quantitative hedge funds in the world. This Software Engineer - Web Scraping role offers you the chance to work with a dynamic team in New York City while enjoying the flexibility of remote work.

What You'll Do

• Design and maintain scalable, production-quality data collection pipelines targeting dynamic, JavaScript-rich web applications, leveraging both browser automation and HTTP-based extraction.
• Analyze network traffic and application behavior to extract data reliably and respond quickly to upstream site changes.
• Take full ownership of data integrity end-to-end, including validation, anomaly detection, and ongoing monitoring for freshness and completeness.
• Partner with quantitative researchers to scope dataset requirements, covering content, coverage, latency, and QA standards.
• Stay current with emerging tools and frameworks, championing targeted improvements that enhance reliability, data quality, and long-term maintainability.

Requirements

• Proven track record of developing and maintaining production-grade web scrapers and crawlers using tools such as Playwright, Selenium, and/or direct HTTP extraction techniques.
• Excellent Python experience is a must.
• Hands-on experience designing robust data pipelines, including orchestration, monitoring, and automated workflows for quality assurance and failure recovery.
• Strong analytical skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment.

Nice to Have

• Experience with data integrity and monitoring tools.
• Familiarity with quantitative finance concepts.
• Knowledge of additional programming languages.

What We Offer

• Competitive total compensation ranging from $200,000 to $400,000 based on experience.
• Fully covered medical, dental, and vision insurance.
• Tuition and student loan reimbursement.
• Excellent 401(k) matching program.
• Comprehensive relocation support for those moving to New York City.