The role, as published
About the company
Our client is a fast-growing software company.
The role
Raydar is recruiting for this role on behalf of our client. Own production infrastructure that supports large-scale automated data collection from websites that try to restrict it. The work spans network routing, session handling and troubleshooting stubborn intermittent faults, with full ownership from the first day.
What you'll do
- Design and run proxy pools, session handling and isolated outbound traffic at scale.
- Maintain a high rate of successful requests even when target sites deploy strong anti-automation protections.
- Develop and maintain systems that manage browser identity signals and handle verification challenges.
- Oversee the reliability and cost profile of the proxy layer.
- Investigate elusive, intermittent failures across the stack and resolve them permanently.
What we're looking for
- Hands-on, production-scale experience building proxy systems or data extraction pipelines that operate against hostile website defenses.
- Recent experience, within the last 2 years, working around strong anti-bot protections as a hands-on individual contributor.
- Production experience managing browser and TLS identity signals and automated challenge handling.
- Proficiency in Go and/or Python.
- Strong grounding in core networking, such as transport and application protocols, connection reuse and proxy coordination.
- Full ownership of production systems, including on-call duty.
- A commitment to reliability and comfort working on messy, adversarial problems.
- A preference for shipping, measuring and iterating quickly.
Bonus points
- Experience with monitoring and alerting tools such as Prometheus and Grafana.
Benefits
- Health, dental and vision coverage
- Life and disability insurance
- Paid parental leave
Location and work model
- San Francisco Bay Area, California, United States
- Hybrid
- Full-time
Compensation, as the posting describes it
- Equity
- Flexible time off
- Retirement plan