Backend Infrastructure Engineer, Anti-Bot
True Talent Solutions Partners · San Francisco · onsite
ABOUT THE ROLE
Join a team building the infrastructure behind a web data extraction platform for AI applications. You will own production systems that keep extraction fast and reliable against websites using sophisticated automated-access defenses.
WHAT YOU'LL DO
- Architect and operate proxy rotation, IP and session management, and isolated egress infrastructure at scale.
- Improve extraction success rates against websites that actively block automated access.
- Build and maintain browser and TLS fingerprint management, CAPTCHA handling, and challenge-solving systems.
- Monitor proxy-layer reliability and cost efficiency, and manage its operating economics.
- Diagnose intermittent failures across the stack, implement durable fixes, and support systems in production.
WHAT WE'RE LOOKING FOR
- More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction, with recent hands-on work in this area.
- Production experience architecting proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
- Experience bypassing major anti-bot defenses, such as Akamai, DataDome, Cloudflare, or Kasada, and owning extraction success-rate metrics.
- Production experience with browser and TLS fingerprinting, CAPTCHA or challenge handling, and high-volume extraction against adversarial defenses.
- Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
- Experience owning production systems end to end, including on-call, observability, and tools such as Prometheus and Grafana.
COMPENSATION & BENEFITS
Base salary: $235,000 to $260,000 USD annually. Visa sponsorship is available.
LOCATION
Hybrid role based in San Francisco, California, United States.