Staff Security Engineer
Robots and Pencils · United States · Canada
Staff Security Engineer
This position is remote based in the US or Canada
Applicants outside of the US and Canada will not be considered for this role
Company Overview
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for our clients. We're all in on AWS, combining deep UX capability with senior engineering talent to get AI into production fast and keep it there.
We’ve earned the trust of leaders across Consumer Products and Retail, Education, Energy, Financial Services, Healthcare, and Manufacturing and more, and earned a reputation as the nimble alternative to traditional global systems integrators. Founded in 2009, with delivery centers in Canada, the United States, Eastern Europe, and Latin America, we are smaller, faster, and more senior by design. Our teams average 15+ years of experience. We move fast, sweat the details, and build things that actually ship.
Position Overview
We're hiring Staff Security Engineers to lead the security of the cloud applications and AI systems we build and ship for clients, and to deploy across a range of client engagements. This role is ideal for an experienced engineer who can define security architecture and standards, own the hardest security problems end-to-end, and provide technical leadership across teams.
In this role, you will work as a key technical leader on a cross-functional team, defining security architecture across cloud infrastructure (AWS, GCP, and Kubernetes), application code, and AI/LLM workloads. You'll lead threat modeling and security reviews, write production Python and Terraform, turn compliance obligations into automated evidence, mentor more junior engineers, and partner closely with engineering and leadership to ensure the systems we ship are secure, reliable, and built to last.
Why This Role Matters
At Robots & Pencils, we design AI systems for a human world. Our name says it all. Robots and pencils means engineering paired with creativity, because every agent we ship has to work for real people in real workflows. That balance is baked into how we operate.
Every role here contributes directly to that mission. Here, you shape how AI systems integrate into enterprise operations, how teams move at real velocity, and how products create measurable impact for clients and the people they serve. We ship production-ready AI in 30 to 45 days. That pace demands people who take ownership, lead with craft, and care deeply about what they put their name on.
What You’ll Do
You'll do hands-on security engineering across the areas below, listed in priority order.
Craft & Delivery
Required
- Application security and secure engineering: deep expertise in secure coding practices, the OWASP Top 10, vulnerability management, and secure code review. Lead threat modeling and security design reviews across web, API, cloud-native, and AI systems, setting how risk is identified and prioritized.
- Cloud security architecture: design controls across identity, network, and data layers, including secrets management and encryption. Bring deep AWS IAM expertise: cross-account trust, permission boundaries, IAM Identity Center or an equivalent federation model, policy evaluation, and Organizations with service control policies. IAM experience that stops at attaching managed policies is not sufficient.
- Kubernetes security at meaningful scale: RBAC, admission control, Helm, and workload identity federation into cloud IAM. Local or single-cluster experience will not transfer.
- Production Python: comfortable writing production Python against cloud provider SDKs, not just scripting. You will build configuration baselines, provisioning workflows, scheduled jobs, log pipelines, CLI tooling, and evidence automation.
- Terraform: module design, state management, drift, and reviewing other teams' plans.
- Security automation in CI/CD: embed security automation and policy-as-code into pipelines, driving shift-left detection across teams.
- Compliance and audit evidence: own control implementation for SOC 2, ISO 27001, PCI, or equivalent frameworks, and automate evidence collection wherever possible. Willingness to do audit evidence work is mandatory.
- Securing AI and LLM-powered applications: own the security of AI systems in production, defining defenses against prompt injection, data leakage, model abuse, and agentic-AI threats.
- SQL for investigation and evidence: Athena, BigQuery, Presto, Snowflake, or equivalent. You will query your way to most answers.
Preferred
- Using AI within security workflows: LLM APIs, tool and function calling, and multi-step agent flows for detection and triage.
- Securing AI training and inference infrastructure, including GPU clusters, at scale.
- Cloud account lifecycle: automated provisioning and decommissioning, baselining, and inventory, including desired-state reconciliation, blast-radius reasoning, and safe rollout.
- Working knowledge of GCP, with hands-on experience in IAM, organization policy, deny policies, audit logging, and GKE.
- Detection engineering, logging, and incident response practices at scale.
- Observability fundamentals: metrics pipelines, SLI and SLO definition, and alert design, with Prometheus, Grafana, or OpenTelemetry.
- Penetration testing.
- Experience working in multi-vendor environments.
Nice to have
- Policy-as-code tooling (Open Policy Agent/Rego, Kyverno, Cloud Custodian).
- Cloud security posture management tooling (Wiz, Prisma Cloud, Orca, Prowler).
- SIEM tooling.
- PKI and certificate lifecycle.
- Azure.
- Cilium, eBPF, Envoy, and the Kubernetes Gateway API.
- Go or Rust.
- Distributed job scheduling.
Collaboration & Communication
- Partner with product, engineering, and leadership to shape security strategy and align technical direction with business outcomes
- Translate complex security tradeoffs, risks, and opportunities into clear narratives that drive decision-making across technical and non-technical stakeholders
- Lead security reviews and technical discussions, raising the bar for engineering rigor and constructive challenge across the team
- Engage closely with engineering, data, and client teams to align security work with broader business priorities and measurable outcomes
Leadership & Influence
- Define security architecture and engineering standards, bringing depth on tradeoffs, long-term implications, and responsible AI practices
- Mentor and grow junior and mid-level engineers, multiplying impact through coaching, code reviews, and pairing on hard problems
- Take ownership of the most ambiguous and highest-stakes pieces of work, driving them through to production with care for reliability, cost, and safety
What You’ll Bring
- 7+ years of professional security or software engineering experience, with at least 3 years leading application and cloud security initiatives.
- 4+ years in cloud platform engineering, cloud security engineering, or infrastructure production engineering.
- Demonstrated leadership and technical mentoring experience across a team or organization.
- Strong stakeholder communication skills across technical and non-technical audiences.
- Demonstrable, day-to-day usage and expert knowledge of AI-forward tools such as Claude and Cursor.
- Excellent problem-solving skills and sound judgment when requirements and risks are unclear.
You’ll Do Well Here if You Are
- A doer. You see something broken and fix it. You'd rather move on clarity than wait for certainty.
- A fast learner who knows you don't know everything. The AI landscape changes weekly. You're senior enough to know better and curious enough to keep learning anyway.
- Direct in a way that makes the work better. You give honest feedback. You'd rather have the hard conversation than blow smoke.
- Obsessed with craft.