Backend Infrastructure Engineer, Anti-Bot
True Talent Solutions Partners · San Francisco · onsite
ABOUT THE ROLE
Join a team building infrastructure for a web data extraction platform in the AI and SaaS space. You will own production systems that help maintain reliable extraction from websites with sophisticated automated-access defenses.
WHAT YOU'LL DO
- Architect and operate proxy rotation, IP and session management, and isolated egress systems at scale.
- Improve extraction success rates against anti-bot and anti-scraping defenses.
- Build and maintain browser and TLS fingerprint management, CAPTCHA handling, and challenge-solving infrastructure.
- Manage the reliability and cost efficiency of the proxy layer.
- Investigate intermittent failures across the stack and implement lasting fixes.
WHAT WE'RE LOOKING FOR
- More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction at production scale.
- Recent hands-on experience bypassing aggressive anti-bot defenses and ownership of related production success-rate metrics.
- Experience with proxy rotation, IP and session management, egress isolation, browser and TLS fingerprinting, and CAPTCHA or challenge handling.
- Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
- Experience operating end-to-end production systems, including on-call responsibilities and observability tooling such as Prometheus and Grafana.
- A practical, reliability-focused approach to debugging and iterating on systems in production.
COMPENSATION & BENEFITS
Base salary is $235,000 to $260,000 USD annually. Visa sponsorship is available.
LOCATION
Hybrid in San Francisco, California, United States.